Research question: Does Automoderator reduce the workload of human patrollers in countering vandalism?

Evaluation method: Proportion of edits reverted back by Automoderator, human patrollers, and tool assisted human patrollers

With revert times less than 1 hr, 8 hrs, 24 hrs, and 48 hrs

Note: tool-assisted (e.g. Huggle, Twinkle, SWViewer) human patrollers may not be applicable for all wikis, in which case, that category can be dropped during comparison

Baseline
This data point will obviously be 0 before Automoderator is deployed. We would like to see the distribution across these three categories pre- and post- deployment.

Question: What is the breakdown of vandalism edits reverted by Automoderator, human patrollers, and tool assisted human patrollers?

This analysis should be done individually for the top 10 Wikipedia projects by editing activity: en, es, ja, de, fr, ru, zh, it, pt, fa, plus our pilot id.wiki

Here we will try out our operational definitions:

Vandalism

• Edit from account with <25 edits or anonymous user
• Reverted by a different editor
• Revert happens within 24 hours
• Edit is in the main namespace

Patroller
Users with ...
any of the following user rights:

• rollback
• review
• patrol
• block
• delete