Page MenuHomePhabricator

Operationalize dbt jobs: all moderator models
Closed, DeclinedPublic

Description

We have developed several dbt-jobs as part of Active Moderators metrics and Active UWERs metrics. The models need to be operationalized to automatically update each month.

I have submitted an airflow-dags MR: https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/2304

dbt models ready for operationalization:

dbt model that does not need to be operationalized, because it's a set of purely historical data from Mar 2025-Apr 2026:

dbt model that will be ready for operationalization once MR !117 is merged:

  • active_moderators_monthly.sql

Event Timeline

CMyrick-WMF renamed this task from Operationalize dbt models: automate monthly updates for moderator metrics to Operationalize dbt models for monthly Moderators and UWERs metrics.Jun 23 2026, 9:04 PM
CMyrick-WMF added subscribers: Snwachukwu, Milimetric.
CMyrick-WMF renamed this task from Operationalize dbt models for monthly Moderators and UWERs metrics to Operationalize dbt jobs: all moderator models.Jun 24 2026, 4:28 PM

@amastilovic I'm going to mark this as declined, since last quarter we discovered that we can't automate the moderators models until there's an update to our dbt-airflow configuration that accommodates for models that have monthly and daily/hourly data sources they need to pull from. You created this ticket regarding the fix that's needed: https://phabricator.wikimedia.org/T430579.

In the meantime, we agreed that the moderators models will need to be run manually by DPE each month. I will submit monthly requests as phab tickets, starting today.