Maniphest T420069

Schedule three new monthly DBT models for Movement Insights
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	amastilovic
	Fri, Mar 13, 10:13 PM

Description

Schedule the following three DBT models from the dbt-jobs repository:

constructive_activations_dbt
constructive_activation_rate_dbt
retained_newcomers_dbt

Event Timeline

amastilovic created this task.Fri, Mar 13, 10:13 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFri, Mar 13, 10:13 PM

mforns moved this task from Next Up to In progress on the Data-Engineering (Q3 FY25/26 January 1st - March 31th) board.Mon, Mar 16, 4:14 PM

For some reason Phab link to GitLab doesn't seem to be working so here's the related airflow-dags change that's been merged already: https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/2089

Update: we tried this today and the test failed. Discovered a bug where the same dbt model run works when run manually but not from within the Skein operator. DE is working on a fix

Update: I've finally figured out the reason this was failing in Airflow - the skein driver was running out of memory and silently exiting. I've fixed the DAG: https://airflow.wikimedia.org/dags/dbt_demo/grid

amastilovic closed this task as Resolved.Thu, Mar 26, 7:29 PM

ldelench_wmf added a project: OKR-Work (WE1 FY2025-26).Thu, Mar 26, 9:31 PM

GGoncalves-WMF awarded a token.Fri, Mar 27, 10:05 AM

Ahoelzl moved this task from In progress to Done on the Data-Engineering (Q3 FY25/26 January 1st - March 31th) board.Fri, Mar 27, 10:54 PM

Schedule three new monthly DBT models for Movement InsightsClosed, ResolvedPublicActions

Description

Event Timeline

Schedule three new monthly DBT models for Movement Insights
Closed, ResolvedPublic
Actions