Change Details

We want to learn more about existing solutions for automated anti-vandalism so that we can make informed decisions for Automoderator. Nine Wikipedia communities have developed bots which automatically revert edits based on algorithms - generally machine learning models. We want to understand how much of the anti-vandalism burden these bots take on in their communities so that we make informed judgements about the potential impact of Automoderator. | Project | Bot | ----- | ----- | en.wiki | [[ https://en.wikipedia.org/wiki/User:ClueBot_NG | ClueBot NG ]] | es.wiki | [[ https://es.wikipedia.org/wiki/Usuario:SeroBOT | SeroBOT ]] | fr.wiki & pt.wiki | [[ https://fr.wikipedia.org/wiki/Utilisateur:Salebot | Salebot ]] | fa.wiki | [[ https://fa.wikipedia.org/wiki/%DA%A9%D8%A7%D8%B1%D8%A8%D8%B1:Dexbot | Dexbot ]] | bg.wiki | [[ https://bg.wikipedia.org/wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB:PSS_9 | PSS 9 ]] | simple.wiki | [[ https://simple.wikipedia.org/wiki/User:ChenzwBot | ChenzwBot ]] | ru.wiki | [[ https://ru.wikipedia.org/wiki/%D0%A3%D1%87%D0%B0%D1%81%D1%82%D0%BD%D0%B8%D1%86%D0%B0:%D0%A0%D0%B5%D0%B9%D0%BC%D1%83_%D0%A5%D0%B0%D0%BA%D1%83%D1%80%D0%B5%D0%B9 | Рейму Хакурей ]] | ro.wiki | [[ https://ro.wikipedia.org/wiki/Utilizator:PatrocleBot | PatrocleBot ]] **Questions** * In each of the Wikimedia projects above, how many reverts does their anti-vandalism bot make per day, on average? * What is this as a percentage of all reverts made within 24 hours of an edit occurring?

We want to learn more about existing solutions for automated anti-vandalism so that we can make informed decisions for Automoderator. Nine Wikipedia communities have developed bots which automatically revert edits based on algorithms - generally machine learning models. We want to understand how much of the anti-vandalism burden these bots take on in their communities so that we make informed judgements about the potential impact of Automoderator. | Project | Bot | ----- | ----- | en.wiki | [[ https://en.wikipedia.org/wiki/User:ClueBot_NG | ClueBot NG ]] | es.wiki | [[ https://es.wikipedia.org/wiki/Usuario:SeroBOT | SeroBOT ]] | fr.wiki & pt.wiki | [[ https://fr.wikipedia.org/wiki/Utilisateur:Salebot | Salebot ]] | fa.wiki | [[ https://fa.wikipedia.org/wiki/%DA%A9%D8%A7%D8%B1%D8%A8%D8%B1:Dexbot | Dexbot ]] | bg.wiki | [[ https://bg.wikipedia.org/wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB:PSS_9 | PSS 9 ]] | simple.wiki | [[ https://simple.wikipedia.org/wiki/User:ChenzwBot | ChenzwBot ]] | ru.wiki | [[ https://ru.wikipedia.org/wiki/%D0%A3%D1%87%D0%B0%D1%81%D1%82%D0%BD%D0%B8%D1%86%D0%B0:%D0%A0%D0%B5%D0%B9%D0%BC%D1%83_%D0%A5%D0%B0%D0%BA%D1%83%D1%80%D0%B5%D0%B9 | Рейму Хакурей ]] | ro.wiki | [[ https://ro.wikipedia.org/wiki/Utilizator:PatrocleBot | PatrocleBot ]] **Questions** * In each of the Wikimedia projects above, how many reverts does their anti-vandalism bot make per day, on average? * What is this as a percentage of all reverts made within 24 hours of an edit occurring? **Expanded scope:** Initial data shows that on average 10% of the bot reverts are reverted back. However, it may be that the vandal actors whose edits had been reverted were reverting them back. So we want to investigate further here, to understand the following: - How of many of the reverts are possibly vandalism? Not all reverted edits are necessarily vandal edits. While there is no direct way to determine this, exploring revert rate by user segmentation might be helpful comparative data (registered vs. anonymous, split edit buckets etc.) - Who are reverting the reverts of the anti-vandal bots? - [[https://es.wikipedia.org/wiki/Usuario:PatruBOT|PatruBOT]] was the first anti-vandal bot on Spanish Wikipedia before SeroBot. Analyse the false positive rate of PatruBot before it was shutdown

We want to learn more about existing solutions for automated anti-vandalism so that we can make informed decisions for Automoderator. Nine Wikipedia communities have developed bots which automatically revert edits based on algorithms - generally machine learning models. We want to understand how much of the anti-vandalism burden these bots take on in their communities so that we make informed judgements about the potential impact of Automoderator. | Project | Bot | ----- | ----- | en.wiki | [[ https://en.wikipedia.org/wiki/User:ClueBot_NG | ClueBot NG ]] | es.wiki | [[ https://es.wikipedia.org/wiki/Usuario:SeroBOT | SeroBOT ]] | fr.wiki & pt.wiki | [[ https://fr.wikipedia.org/wiki/Utilisateur:Salebot | Salebot ]] | fa.wiki | [[ https://fa.wikipedia.org/wiki/%DA%A9%D8%A7%D8%B1%D8%A8%D8%B1:Dexbot | Dexbot ]] | bg.wiki | [[ https://bg.wikipedia.org/wiki/%D0%9F%D0%BE%D1%82%D1%80%D0%B5%D0%B1%D0%B8%D1%82%D0%B5%D0%BB:PSS_9 | PSS 9 ]] | simple.wiki | [[ https://simple.wikipedia.org/wiki/User:ChenzwBot | ChenzwBot ]] | ru.wiki | [[ https://ru.wikipedia.org/wiki/%D0%A3%D1%87%D0%B0%D1%81%D1%82%D0%BD%D0%B8%D1%86%D0%B0:%D0%A0%D0%B5%D0%B9%D0%BC%D1%83_%D0%A5%D0%B0%D0%BA%D1%83%D1%80%D0%B5%D0%B9 | Рейму Хакурей ]] | ro.wiki | [[ https://ro.wikipedia.org/wiki/Utilizator:PatrocleBot | PatrocleBot ]] **Questions** * In each of the Wikimedia projects above, how many reverts does their anti-vandalism bot make per day, on average? * What is this as a percentage of all reverts made within 24 hours of an edit occurring? **Expanded scope:** Initial data shows that on average 10% of the bot reverts are reverted back. However, it may be that the vandal actors whose edits had been reverted were reverting them back. So we want to investigate further here, to understand the following: - How of many of the reverts are possibly vandalism? Not all reverted edits are necessarily vandal edits. While there is no direct way to determine this, exploring revert rate by user segmentation might be helpful comparative data (registered vs. anonymous, split edit buckets etc.) - Who are reverting the reverts of the anti-vandal bots? - [[https://es.wikipedia.org/wiki/Usuario:PatruBOT|PatruBOT]] was the first anti-vandal bot on Spanish Wikipedia before SeroBot. Analyse the false positive rate of PatruBot before it was shutdown