Just renamed this to be a little more clear to me. I'm not quite sure how we'd set this up. We need a lot of determinism in revscoring to have things work. But it's possible that we can store snapshots in revscoring to account for changes on the wiki.

Is this still wanted nowadays?

Yeah. I think this is really interesting. We'd need to so some thinking about how it could work with our pipelines for building models.

Here are some examples of existing lists, of varying quality and formats, used by other tools:

• https://pt.wikipedia.org/wiki/WP:Software/Anti-vandal_tool/badwords
• https://pt.wikipedia.org/wiki/User:Alchimista/Aleph_Bot/Express%C3%B5es
• https://pt.wikipedia.org/wiki/User:Salebot/Config
• https://pt.wikipedia.org/wiki/WP:Projetos/AntiVandalismo/Express%C3%B5es_problem%C3%A1ticas
• https://pt.wikipedia.org/wiki/User:O_Politizador/curiosidades_apagadas/Lista_de_express%C3%B5es_idiom%C3%A1ticas_com_palavras_de_baixo_cal%C3%A3o

There are also some edit filters which contain such lists:

• https://pt.wikipedia.org/wiki/WP:Filtro_de_edi%C3%A7%C3%B5es

And for typos:

• https://en.wikipedia.org/wiki/WP:Lists_of_common_misspellings/For_machines#The_Machine-Readable_List

It is not uncommon for some good faith edit to add a new expression (or badly written regex) to such lists and then breaking (to some extent) the tools which use them (e.g. increasing its false positives).

We can probably handle the breaking changes by having a manual step where we pull a new version of a badwords list from the wiki. If fitness measure go down, we know something was broken.