Measure and monitor metrics for IRS enwiki trial in different phases based on Measurement Plan. Also include setting up metrics in Test Kitchen.
Superset Dashboard: https://superset.wikimedia.org/superset/dashboard/irs_enwiki_rollout
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T423040 [Epic] IRS enwiki trial | |||
| Resolved | cchen | T424556 Analysis for IRS enwiki trial |
Event Timeline
Comment Actions
@cchen , can you also add here how many reports were there reported on ANI / Teahouse etc, to be able to compare before the release and after the release numbers?
Comment Actions
Clarification after conversation: we will not do a specific sessions implementation to determine the attribution of the IRS report -> ANI (or others) report and instead to do a correlation that the user name who clicked on the link in IRS also created an edit in the ANI (or others). This also means it would be helpful to know how many reports were created on those pages before the release and after the release, to try to see the impact historically.
Comment Actions
Metrics are monitored in the superset dashboard https://superset.wikimedia.org/superset/dashboard/irs_enwiki_rollout