Maniphest T396207

Setup Toolforge jobs to fetch and load CX metrics data to Data Lake.
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	KCVelaga_WMF
	Jun 6 2025, 11:11 AM

Tags

Referenced Files

None

Subscribers

Description

Using

https://wikitech.wikimedia.org/wiki/Help:Toolforge/Jobs_framework

setup Toolforge jobs to fetch the data from https://analytics.wikimedia.org/published/reports/content_translation/
and load to a database in ToolsDB, which the public Superset instance will access.

Daily monitoring metrics - published translations
Daily monitoring metrics - in progress translations
Monthly key metrics
Monthly deletion stats metrics
Monthly MT service usage metrics

https://gitlab.wikimedia.org/repos/product-analytics/content-translation-toolforge-jobs/-/tree/main/scripts/python?ref_type=heads

Details

Related Changes in GitLab:

	Title	Reference	Author	Source Branch	Dest Branch
	Scripts to update CX monthly metrics, deletion stats, mt service, suggestions	repos/product-analytics/content-translation-toolforge-jobs!3	kcvelaga	monthly-metrics	main

Customize query in GitLab

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		KCVelaga_WMF	T365813 Develop a unified Content Translation (CX) metrics dashboard
		Resolved		KCVelaga_WMF	T396207 Setup Toolforge jobs to fetch and load CX metrics data to Data Lake.

Event Timeline

KCVelaga_WMF created this task.Jun 6 2025, 11:11 AM

KCVelaga_WMF changed the task status from Open to In Progress.

KCVelaga_WMF triaged this task as Medium priority.

KCVelaga_WMF moved this task from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.

kcvelaga opened https://gitlab.wikimedia.org/repos/product-analytics/content-translation-toolforge-jobs/-/merge_requests/1

Initial repo files

kcvelaga merged https://gitlab.wikimedia.org/repos/product-analytics/content-translation-toolforge-jobs/-/merge_requests/1

Initial repo files

Maintenance_bot removed a project: Patch-For-Review.Jun 6 2025, 3:31 PM

kcvelaga opened https://gitlab.wikimedia.org/repos/product-analytics/content-translation-toolforge-jobs/-/merge_requests/2

Script to fetch and load daily snapshots for published and draft translations

kcvelaga merged https://gitlab.wikimedia.org/repos/product-analytics/content-translation-toolforge-jobs/-/merge_requests/2

Script to fetch and load daily snapshots for published and draft translations

Maintenance_bot removed a project: Patch-For-Review.Jun 10 2025, 6:30 AM

KCVelaga_WMF updated the task description. (Show Details)Jun 16 2025, 12:50 PM

kcvelaga opened https://gitlab.wikimedia.org/repos/product-analytics/content-translation-toolforge-jobs/-/merge_requests/3

Scripts to update CX monthly metrics, deletion stats, mt service, suggestions

kcvelaga merged https://gitlab.wikimedia.org/repos/product-analytics/content-translation-toolforge-jobs/-/merge_requests/3

Scripts to update CX monthly metrics, deletion stats, mt service, suggestions

Maintenance_bot removed a project: Patch-For-Review.Jul 1 2025, 11:30 AM

KCVelaga_WMF closed this task as Resolved.Jul 2 2025, 6:06 AM

KCVelaga_WMF updated the task description. (Show Details)