We want to avoid using revert risk scores for identifying potential vandalism and using that in our evaluations, as Automoderator itself will be using the revert risk. Instead, we are proposing a criteria on what usually makes an edit an vandalizing edit. The goal of this data is analyse how this compares with the revert scores and if we need to modify the criteria based on patterns observed.
Proposed criteria
- Edit from account with <25 edits or anonymous user
- Reverted by a different editor
- Revert happens within 24 hours
- Edit is in the main namespace