Page MenuHomePhabricator

Evaluate the impact of temporary accounts on automoderator
Closed, ResolvedPublic

Description

The Trust and Safety team recently enable temporary accounts on some wikis. This feature hides IP addresses, replacing them with a conventional and temporary username. Since it is known that the language agnostic model is biased against IPs and the multilingual one is trying to solve that, an evaluation of the models, but also of the behavior of Automoderator in general, would be useful before the temporary accounts become generally available.

Event Timeline

A very early empirical look at how PatrocleBot works (using multilingual model) shows no changes in revert numbers.

but also of the behavior of Automoderator in general, would be useful before the temporary accounts become generally available.

See also T374920: Coordinate AutoModerator rollout with pilot wiki deployments

See also also T352839: RevertRisk model readiness for temporary accounts, where it was determined that the models should work largely the same - treating temporary accounts the same as unregistered users for now.

I can confirm that this is the expected behavior.

See also also T352839: RevertRisk model readiness for temporary accounts, where it was determined that the models should work largely the same - treating temporary accounts the same as unregistered users for now.

Thanks for the quick responses, I guess we can close the task then! Just one question: is this documented somewhere on-wiki for future users?

kostajh claimed this task.

Thanks for the quick responses, I guess we can close the task then! Just one question: is this documented somewhere on-wiki for future users?

I made a small edit here https://meta.wikimedia.org/w/index.php?title=Machine_learning_models/Production/Language-agnostic_revert_risk&oldid=27733137