One of the features of an edit we could filter on is user groups - we already know for certain that administrators should never be reverted, but it's less clear-cut whether users with other user rights should be. One of the complications is that user groups are different on different wikis - it would be hard for us to hard-code them all into Automoderator and maintain them over time. We probably want to give this to each community to configure in detail.
One user right which is available on many wikis is extendedconfirmed. The right is granted automatically, typically after 500 edits and 30-90 days of activity depending on the wiki. We could imagine filtering out extendedconfirmed users by default too, but we need to check the data to confirm whether this would improve Automoderator's accuracy.
Questions
For enwiki, fawiki, jawiki, and zhwiki, while ignoring the edits we already want to skip*:
- What is the distribution of Revert Risk scores for all users and extended confirmed users?
- How many edits by extended confirmed users have a Revert Risk score greater than 0.97?
Please also produce a data file containing the edits with scores greater than 0.97 so that we can spot check the accuracy of this score. This can be randomly sampled down to ~1000 edits per wiki if there are more edits than this.
*Edits made by administrators; Edits made by bots; Edits which are self-reverts; New page creations