Page MenuHomePhabricator

Develop a unified Automoderator Activity Dashboard (v1)
Closed, ResolvedPublic

Description

Need
Automoderator has been deployed on the the first pilot wikis, with plans to rollout to couple of other wikis soon. At the moment we're tracking the pilot metrics manually with a weekly run. Eventually, a publicly accessible dashboard as communities would also be interested in AM's activity is needed, that is updated at least daily.

Solution

  • A public Superset dashboard to monitor activity of Automoderator, both by the team and the community as required.
  • Addition of new wikis, which mainly a work on the data pipeline side should be easy.

Steps involved

#StepTaskNotes
1Identify all the metrics (+dependent data sources) to be tracked with v1 of the dashboardT371981Pilot metrics are in T362610 (weekly reports)
-Make an exhaustive list of available metrics for future consideration
2Iterate based on the initial dashboard mockup designmockup based on testwiki (iterations can be done after the data is available)
3Develop Airflow-based pipelines for the necessary metrics to be calculatedT374705sub-tasks: T375062, T375153
4Privacy review of the data to be published (L3SC request as it would be Medium Risk according to guidelines)request
5Jobs to publish the datasets to https://analytics.wikimedia.org/published/datasets/ -this will not be a separate job
6Jobs to read and update Toolforge ToolsDB from the published datasetsT374705
7Develop the queries required for the dashboard on Superset
8Build and publish the first version of the dashboard & communicate

Note: This is a goal for FY 24 Q1, so this should be ready by the end of quarter.


Details

Due Date
Sep 29 2024, 6:30 PM

Event Timeline

KCVelaga_WMF renamed this task from Automoderator Activity Dashboard (v1) to Develop a unified Automoderator Activity Dashboard (v1).Jul 31 2024, 11:53 AM
KCVelaga_WMF triaged this task as Medium priority.
KCVelaga_WMF updated the task description. (Show Details)
KCVelaga_WMF set Due Date to Sep 29 2024, 6:30 PM.
KCVelaga_WMF moved this task from Triage to Current Quarter on the Product-Analytics board.

As I've said a few times already, this is incredible!

I've added links to the project page and to the deployment steps, so that the dashboard is linked from Automoderator's user page when it gets deployed.

I still need to notify id.wiki, uk.wiki, and tr.wiki of the dashboard and give them filtered links. Will do that soon.

@Dogu @Renvoy @BAPerdana-WMF I'm pleased to let you know that you should now be able to access a dashboard with key metrics about Automoderator's activity. We recommend adding a link to this on Automoderator's user page so that editors can easily find it! The overall dashboard is at https://superset.wmcloud.org/superset/dashboard/unified-automoderator-activity-dashboard/, but it can be filtered to your specific wiki. I've generated links which are filtered to each of your wikis below: