As part of our planning for next year (FY24/25) we have drafted the following KR for WE1.3:
Increase user satisfaction in 4 moderation products by X%.
If we are to understand whether we increased satisfaction in certain products, we need to know what the baseline numbers are. If we take a broad approach this may also help us prioritise which products to focus on - which tools are moderators currently least satisfied with?
Possible products/interfaces in which to survey
- AbuseFilter
- Watchlist
- RecentChanges
- Spam blacklist
- FlaggedRevisions
- PageTriage
- Page protection
- Page deletion
- Revision deletion (Special:RevisionDelete)
- Mobile web interfaces
- ...
Additionally, although out of scope for 'content moderation', Trust & Safety Product would find it valuable to collect the same data for the following products:
- Special:Block
- Special:CheckUser
- Special:Investigate
- ...
Open questions
- How can we best survey users of these tools - QuickSurveys?
- If QuickSurveys, what decisions do we need to make. There are a wide range of sampling options.
- Note that QuickSurveys currently only works on article pages (T360996)
- We also get less targeting with QuickSurveys - we might be better defining our list of patrollers/admins and contacting them directly.
- What should we be asking?
- Which tools should we survey? A partial list has been started above.