Page MenuHomePhabricator
Create Task
Maniphest T393559

Data pipeline to load cx_translations to Data Lake, at wmf_product
Closed, ResolvedPublic
Actions

Description

https://www.mediawiki.org/wiki/Extension:ContentTranslation/cx_translations_table

to be loaded to Data Lake at

wmf_product.cx_translations

Related Objects
Search...

Event Timeline

KCVelaga_WMF created this task.May 7 2025, 8:28 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 7 2025, 8:28 AM
KCVelaga_WMF edited parent tasks, added: T393561: Setup pipelines to load CX extension tables into Data Lake, at wmf_product; removed: T382706: Data pipeline to load cx_translators to Data Lake, at wmf_product.May 7 2025, 8:34 AM
KCVelaga_WMF removed a subtask: T393560: Data pipeline to load cx_corpora to Data Lake, at wmf_product.
CodeReviewBot added a project: Patch-For-Review.May 7 2025, 10:35 AM

kcvelaga opened https://gitlab.wikimedia.org/repos/product-analytics/data-pipelines/-/merge_requests/39

CX Translations and Corpora tables

KCVelaga_WMF renamed this task from Data pipleine to load cx_translations to Data Lake, at wmf_product to Data pipeline to load cx_translations to Data Lake, at wmf_product.May 7 2025, 10:36 AM
KCVelaga_WMF added a subscriber: • PWaigi-WMF.
CodeReviewBot added a comment.May 8 2025, 3:25 PM

kcvelaga opened https://gitlab.wikimedia.org/repos/product-analytics/content-translation-airflow-jobs/-/merge_requests/4

CX Translations and Corpora job scripts

CodeReviewBot added a comment.May 8 2025, 3:25 PM

kcvelaga merged https://gitlab.wikimedia.org/repos/product-analytics/content-translation-airflow-jobs/-/merge_requests/4

CX Translations and Corpora job scripts

CodeReviewBot added a comment.May 14 2025, 9:42 AM

kcvelaga merged https://gitlab.wikimedia.org/repos/product-analytics/data-pipelines/-/merge_requests/39

CX Translations and Corpora tables

Maintenance_bot removed a project: Patch-For-Review.May 14 2025, 10:30 AM
CodeReviewBot added a project: Patch-For-Review.May 14 2025, 11:28 AM

kcvelaga opened https://gitlab.wikimedia.org/repos/product-analytics/content-translation-airflow-jobs/-/merge_requests/5

Update query commit IDs - translations and corpora

CodeReviewBot added a comment.May 14 2025, 11:29 AM

kcvelaga merged https://gitlab.wikimedia.org/repos/product-analytics/content-translation-airflow-jobs/-/merge_requests/5

Update query commit IDs - translations and corpora

Maintenance_bot removed a project: Patch-For-Review.May 14 2025, 11:30 AM
CodeReviewBot added a project: Patch-For-Review.May 14 2025, 12:05 PM

kcvelaga opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1318

CX Translations daily load DAG

KCVelaga_WMF changed the task status from Open to In Progress.May 14 2025, 12:06 PM
CodeReviewBot added a comment.May 19 2025, 8:49 AM

kcvelaga merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1318

CX Translations daily load DAG

Stashbot added a comment.May 19 2025, 8:51 AM

Mentioned in SAL (#wikimedia-operations) [2025-05-19T08:51:54Z] <kcvelaga@deploy1003> Started deploy [airflow-dags/analytics_product@472cc1c]: T393559

Stashbot added a comment.May 19 2025, 8:52 AM

Mentioned in SAL (#wikimedia-operations) [2025-05-19T08:52:56Z] <kcvelaga@deploy1003> Finished deploy [airflow-dags/analytics_product@472cc1c]: T393559 (duration: 01m 14s)

Maintenance_bot removed a project: Patch-For-Review.May 19 2025, 9:30 AM
KCVelaga_WMF moved this task from Incoming to Priority on the LPL Analytics board.May 19 2025, 9:03 PM
KCVelaga_WMF closed this task as Resolved.May 20 2025, 8:03 PM
KCVelaga_WMF updated the task description. (Show Details)
KCVelaga_WMF added a project: Product-Analytics (Kanban).
KCVelaga_WMF moved this task from Next 2 weeks to Done on the Product-Analytics (Kanban) board.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits