The new version of CheckUser (Special:Investigate) will be deployed to all wikis in the next few weeks. This task is to track all the things we will be measuring.
Metrics
Adoption: Comparing usage for the new tool versus the old tool
- How often Special:Investigate is accessed?
- How often Special:Checkuser is accessed?
User experience
- How many users does an investigation start with?
- How many records are fetched per investigation?
- How often did we display incomplete results to the user?
- How long did a user spend waiting for the results?
Feature usage
- Over the course of an investigation how often did a user access the individual tabs
over the course of the investigation?
Reframe the question as we cannot track the usage over the course of the investigation yet. It depends on the development of a "Done" button.
- How many times did a user pin a highlight?
- How often did the block feature get used and how many users were blocked?
User reliance on external IP tools
- Which tools under the IP address were clicked and how many times?
Other metrics we'd like to track after we have developed a 'Done' button
- How often did a user quit the investigation (page close or back button) while the results were being generated?
- How many users are under investigation by the time the investigation ends?
- We'll probably be getting this data on a weekly basis for all the wikis that has local checkusers. We should get this data for all wikis on a slower cadence.
Schema:
Related ticket:
https://phabricator.wikimedia.org/T246951#6148694
Report:
Dashboard is refreshed weekly and published at:
https://analytics.wikimedia.org/published/notebooks/AHT/Special_Investigate_Dashboard.html
