Background

Conduct an analysis at 30 days after the last release to all Wikis

• Release date: May 22
• 30 Days: June 21

The Task

• Compare results to baseline data that was collected
• Visualize and present the data in a way that is easily understandable to the team

Requirements

• The data should be based on the metrics in the Epic

At 30 days:

Validation

• Key Indicator 1: 65% of Target mature audiences that use the tool say they find it helpful for maintaining the quality of wikis and would recommend it to other patrollers (to be measured qualitatively, and then at 30-day point with survey)
• Key Indicator 2: 10% of target mature audiences interacted with another user by sending thanks or a talk page message.
• Key Indicator 3: 10% of target mature audiences engage with filter for preferences
• Key Indicator 4: 65% of Target mature audiences engage with the tool at least once in a thirty day window

Guardrails:

• Experienced users without rollback rights, users that have and have not used alternative patrolling tools equally understand the workflow (Completed with usability testing)
• We do not receive reports of tool being used to negatively target underrepresented content or contributors based on in-app reporting mechanisms

Curiosities:

• How does use of our tool compare to other patrolling tools when looking at MediaWiki Tags (SWViewer, Huggle, and Twinkle)
• Do we see an increase in Undo/Rollback/Thank events
• How popular is this task with our target audience relative to other Suggested Edits task?
• What actions are most popular in the feature?
• For Saved messages:
  • How often do users create messages from scratch instead of using an example message?
  • How often do users modify an example message before sending?
  • How often do users modify an example message and save that version to "Your Messages"?
  • How often do users click on each of the 10 example messages?
• For templates
  • How often are users using a Template while posting talk pages messages messages in Edit Patrol?
  • How often are they saving a message to "Your Messages" that contains a template?

Target Quant Languages

• Indonesian
• French
• Chinese
• Spanish
• Igbo
• English