**Need**
Automoderator has been deployed on the the first pilot wikis, with plans to rollout to couple of other wikis soon. At the moment we're tracking the pilot metrics manually with a weekly run. Eventually, a publicly accessible dashboard as communities would also be interested in AM's activity is needed, that is updated at least daily.
**Solution**
* A public Superset dashboard to monitor activity of Automoderator, both by the team and the community as required.
* The dashboard will live at https://superset.wmcloud.org/
* Addition of new wikis, which mainly a work on the data pipeline side should be easy.
**Steps involved**
| # | Step | Task | Notes |
|----|------------------------------------------------------------------------------------------------|-------|--------|
| 1 | Identify all the metrics (+dependent data sources) to be tracked with v1 of the dashboard | T371981 | Pilot metrics are in T362610 ([[ https://nbviewer.org/urls/gitlab.wikimedia.org/kcvelaga/automoderator-measurement/-/raw/main/pilot_analysis/trwiki_activity.ipynb?flush_cache=true | weekly reports ]]) |
| - | Make an exhaustive list of available metrics for future consideration | |
| 2 | Iterate based on the initial dashboard mockup design | | [[ https://superset.wmcloud.org/superset/dashboard/37/ | mockup based on testwiki ]]
| 3 | Develop Airflow-based pipelines for the necessary metrics to be calculated | | |
| 4 | Privacy review of the data to be published | | |
| 5 | Jobs to publish the datasets to https://analytics.wikimedia.org/published/datasets/ | | |
| 6 | Jobs to read and update Toolforge ToolsDB from the published datasets | | |
| 7 | Develop the queries required for the dashboard on Superset | | |
| 8 | Build and publish the first version of the dashboard & communicate | | |
//Note: This is a goal for FY 24 Q1, so this should be ready by the end of quarter.//