Data pipeline to load cx_translators to Data Lake, at wmf_product
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	KCVelaga_WMF
	Dec 23 2024, 1:27 PM

Description

https://www.mediawiki.org/wiki/Extension:ContentTranslation/cx_translators_table

to be loaded to Data Lake at

wmf_product.cx_translators

Related Objects
Search...

Status	Assigned	Task
Resolved	KCVelaga_WMF	T365813 Develop a unified Content Translation (CX) metrics dashboard
Resolved	KCVelaga_WMF	T393561 Setup pipelines to load CX extension tables into Data Lake, at wmf_product
Resolved	KCVelaga_WMF	T382706 Data pipeline to load cx_translators to Data Lake, at wmf_product

Event Timeline

KCVelaga_WMF created this task.Dec 23 2024, 1:27 PM

KCVelaga_WMF updated the task description. (Show Details)

kcvelaga opened https://gitlab.wikimedia.org/repos/product-analytics/data-pipelines/-/merge_requests/31

Files to fetch and load cx_translators table

bearloga merged https://gitlab.wikimedia.org/repos/product-analytics/data-pipelines/-/merge_requests/31

Files to fetch and load cx_translators table

Maintenance_bot removed a project: Patch-For-Review.Jan 15 2025, 3:30 PM

KCVelaga_WMF changed the task status from Open to In Progress.Jan 16 2025, 10:10 AM

KCVelaga_WMF moved this task from Incoming to In progress on the LPL Analytics board.

KCVelaga_WMF edited projects, added Product-Analytics (Kanban); removed Product-Analytics.

mpopov mentioned this in T389662: NEW/CHANGE FEATURE REQUEST: Make Event Registration Tool's data available in Data Lake.Mar 21 2025, 6:50 PM

kcvelaga updated https://gitlab.wikimedia.org/repos/product-analytics/data-pipelines/-/merge_requests/37

Partition cx_translators table by snapshot_date

kcvelaga merged https://gitlab.wikimedia.org/repos/product-analytics/data-pipelines/-/merge_requests/37

Partition cx_translators table by snapshot_date

KCVelaga_WMF renamed this task from Setup pipelines to load CX extension tables into Data Lake, at wmf_raw to Setup pipelines to load CX extension tables into Data Lake, at wmf_product.May 6 2025, 9:31 PM

KCVelaga_WMF triaged this task as Medium priority.

KCVelaga_WMF updated the task description. (Show Details)

kcvelaga opened https://gitlab.wikimedia.org/repos/product-analytics/content-translation-airflow-jobs/-/merge_requests/2

Job script to fetch and load cx_translators to Data Lake

kcvelaga merged https://gitlab.wikimedia.org/repos/product-analytics/content-translation-airflow-jobs/-/merge_requests/2

Job script to fetch and load cx_translators to Data Lake

kcvelaga opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1288

CX Translators daily DAG

KCVelaga_WMF renamed this task from Setup pipelines to load CX extension tables into Data Lake, at wmf_product to Data pipeline to load cx_translators to Data Lake, at wmf_product.May 7 2025, 8:33 AM

KCVelaga_WMF updated the task description. (Show Details)

KCVelaga_WMF edited parent tasks, added: T393561: Setup pipelines to load CX extension tables into Data Lake, at wmf_product; removed: T365813: Develop a unified Content Translation (CX) metrics dashboard.

KCVelaga_WMF removed a subtask: T393559: Data pipeline to load cx_translations to Data Lake, at wmf_product.

KCVelaga_WMF moved this task from Next 2 weeks to Needs Review on the Product-Analytics (Kanban) board.

KCVelaga_WMF added a subscriber: • PWaigi-WMF.

KCVelaga_WMF moved this task from In progress to Review/sign-off on the LPL Analytics board.May 7 2025, 8:35 AM

kcvelaga merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1288

CX Translators daily DAG

KCVelaga_WMF closed this task as Resolved.May 16 2025, 3:35 PM

KCVelaga_WMF updated the task description. (Show Details)

KCVelaga_WMF removed a project: Patch-For-Review.