Retire the movement metrics Superset dashboards
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	nshahquinn-wmf
	Mar 9 2024, 2:26 AM

Description

The movement metrics Superset dashboards are not fully functional since the data tables needed for the charts are not migrated to Airflow. We decided to not migrate them since the usage of these dashboards has dwindled over time.

We will preserve some of the custom queries from the dashboard in this repo .

To read more about our reasoning behind the deprecation pls see this document.

Related Objects
Search...

Status	Assigned	Task
Resolved	Mayakp.wiki	T359700 Retire the movement metrics Superset dashboards
Resolved	nshahquinn-wmf	T333225 Migrate the movement_metrics ETL jobs to Airflow
Declined	None	T308077 Add partitioning to editors tables
Declined	None	T314541 Update the active_editors table with an Airflow job
Resolved	nshahquinn-wmf	T359691 Remove any unnecessary intermediate tables managed by the movement_metrics ETL job
Resolved	nshahquinn-wmf	T359690 Determine if any intermediate tables managed by the movement_metrics ETL job can be removed
Resolved	nshahquinn-wmf	T359687 Determine which metrics and charts can be eliminated from the movement-metrics repository
Resolved	nshahquinn-wmf	T359696 Study Airflow and do any necessary set-up
Resolved	brennen	T360956 Create new GitLab project group: movement-insights
Resolved	nshahquinn-wmf	T360491 Decide how to handle metric corrections
Declined	nshahquinn-wmf	T362593 Update the content_interactions table with an Airflow job
Resolved	nshahquinn-wmf	T362594 Update the editor_month table with an Airflow job
Resolved	nshahquinn-wmf	T362595 Update the new_editors table with an Airflow job
Open	Hghani	T370196 Retire the old movement metrics job and intermediate tables

Event Timeline

nshahquinn-wmf created this task.Mar 9 2024, 2:26 AM

nshahquinn-wmf triaged this task as Medium priority.

nshahquinn-wmf added a subtask: T333225: Migrate the movement_metrics ETL jobs to Airflow.Mar 9 2024, 2:28 AM

JAnstee_WMF moved this task from Incoming to Backlog on the Movement-Insights board.Mar 13 2024, 8:42 PM

nshahquinn-wmf moved this task from Backlog to Visualization on the Movement-Metrics board.May 16 2024, 1:29 AM

nshahquinn-wmf removed a parent task: T359207: Improve the delivery of the movement movements (SDS 2.6.2).Jun 23 2024, 12:29 AM

nshahquinn-wmf updated the task description. (Show Details)Jan 30 2025, 3:22 AM

I've proposed retiring the dashboards; my reasoning is in this proposal (WMF only).

We are going to hold off on a decision until @Mayakp.wiki is back from vacation (18 Feb) and has a chance to weigh in.

@nshahquinn-wmf - I think the proposal is linked back to this phab task. Can you pls update with the correct link? thanks :)

@Mayakp.wiki oh, oops! It's updated now.

Mayakp.wiki mentioned this in T369226: [MI 1] Reporting, Data Visualization, and Data Communications.Aug 7 2025, 10:32 PM

Moving it back to Doing as I'm working on deprecating the dashboards and preserving the queries.

Mayakp.wiki renamed this task from Ensure that movement metrics Superset dashboards are functional and performant to Retire the movement metrics Superset dashboards.Aug 26 2025, 11:29 PM

Mayakp.wiki updated the task description. (Show Details)

Mayakp.wiki mentioned this in T362593: Update the content_interactions table with an Airflow job.

The 3 dashboards are now deleted. Amen

nshahquinn-wmf closed subtask T333225: Migrate the movement_metrics ETL jobs to Airflow as Resolved.Aug 31 2025, 10:09 PM

nshahquinn-wmf mentioned this in T333225: Migrate the movement_metrics ETL jobs to Airflow.

nshahquinn-wmf mentioned this in T314541: Update the active_editors table with an Airflow job.Aug 31 2025, 10:33 PM