= Hypothesis =
**If we enable communities to automatically prevent or revert obvious vandalism, moderators will have more time to spend on other activities.** This project will use the Research team's revert prediction model, and we may explore integrating it with AbuseFilter, or creating an automated anti-vandalism revert system. Targets and KRs for this project will be set collaboratively with the community.
= Goals =
- Reduce moderation backlogs by preventing bad edits from entering patroller queues
- Give moderators confidence that automoderation is reliable and is not producing significant false positives
- Ensure that editors caught in a false positive have clear avenues to flag the error / have their edit reinstated
= Proposed solution =
Build functionality which enables editors to revert edits which meet a threshold in the revert-prediction model created by the #research team.
Give communities control over the product's configuration, so that they can:
- Locally turn it on or off
- Set the revert threshold
- Customise further aspects of how the feature operates
//Mockup//
{F37013027}
= Model =
{T314384} ([[ https://meta.wikimedia.org/wiki/Research:Develop_a_ML-based_service_to_predict_reverts_on_Wikipedia | Meta ]], [[ https://meta.wikimedia.org/wiki/Machine_learning_models/Proposed/Multilingual_revert_risk | model card]]).
There are two version of the model: Language-agnostic and multilingual. The multilingual model is more accurate, but only available in 48 languages, as documented in the model card.
The model is only currently trained on namespace 0 (article/main space). It has been trained on Wikipedia and Wikidata, but could be trained on other projects.
= Existing volunteer-maintained solutions =
| Project | Bot
| ----- | -----
| en.wiki | [[ https://en.wikipedia.org/wiki/User:ClueBot_NG | ClueBot NG ]]
| es.wiki | [[ https://es.wikipedia.org/wiki/Usuario:SeroBOT | SeroBOT ]]
| fr.wiki & pt.wiki | [[ https://fr.wikipedia.org/wiki/Utilisateur:Salebot | Salebot ]]
| fa.wiki | [[ https://fa.wikipedia.org/wiki/%DA%A9%D8%A7%D8%B1%D8%A8%D8%B1:Dexbot | Dexbot ]]
| bg.wiki | [[ https://bg.wikipedia.org/wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB:PSS_9 | PSS 9 ]]
| simple.wiki | [[ https://simple.wikipedia.org/wiki/User:ChenzwBot | ChenzwBot ]]
| ru.wiki | [[ https://ru.wikipedia.org/wiki/%D0%A3%D1%87%D0%B0%D1%81%D1%82%D0%BD%D0%B8%D1%86%D0%B0:%D0%A0%D0%B5%D0%B9%D0%BC%D1%83_%D0%A5%D0%B0%D0%BA%D1%83%D1%80%D0%B5%D0%B9 | Рейму Хакурей ]]
| ro.wiki | [[ https://ro.wikipedia.org/wiki/Utilizator:PatrocleBot | PatrocleBot ]]
= Relevant community discussions =
- [[ https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2022/Larger_suggestions/Automatic_vandalism/spam_detection_and_revert_in_more_wikis | Community Wishlist Survey 2022/Larger suggestions/Automatic vandalism/spam detection and revert in more wikis]] (meta)
- [[ https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2022/Admins_and_patrollers/Expose_ORES_scores_in_AbuseFilter | Community Wishlist Survey 2022/Admins and patrollers/Expose ORES scores in AbuseFilter ]] (meta)
- [[ https://fa.wikipedia.org/w/index.php?title=%D9%88%DB%8C%DA%A9%DB%8C%E2%80%8C%D9%BE%D8%AF%DB%8C%D8%A7:%D9%82%D9%87%D9%88%D9%87%E2%80%8C%D8%AE%D8%A7%D9%86%D9%87/%D8%A7%D8%AC%D8%B1%D8%A7%DB%8C%DB%8C/%D8%A8%D8%A7%DB%8C%DA%AF%D8%A7%D9%86%DB%8C_%DB%B5%DB%B0&oldid=35362739#%D9%85%D9%85%D9%86%D9%88%D8%B9%DB%8C%D8%AA_%D9%85%D8%AC%D8%AF%D8%AF_%D9%88%DB%8C%D8%B1%D8%A7%DB%8C%D8%B4_%D8%A2%DB%8C%E2%80%8C%D9%BE%DB%8C | Re-prohibition of IP editing ]] (fa.wiki)
= Open questions =
- What is the best technical approach? Options include:
- An extension with a system account, using #growthexperiments-communityconfiguration
- An externally-hosted tool using a more standard bot account
- Can we improve the experience of receiving a false positive revert, as compared to the volunteer-maintained bots?
- How can we quantify the impact this product will have? Positive (reducing moderator burdens) and negative (false positives for new users)
- Is integration with AbuseFilter an option? (T299436)