Page MenuHomePhabricator

Automoderator pilot deployment metrics (idwiki)
Open, Needs TriagePublic


Key metrics to be tracked:

  • Volume: Number of reverts (split: anonymous, newcomers, non-newcomers)
  • False positive: Revert rate of AM reverts by non-new editors
  • Pageviews of vandalized content
  • Proportion of edits reverted by human/AM/tool
  • False negatives: average risk of score of edits reverted by human patrollers

A Superset dashboard can be created for most of the metrics, and rest can be reported on wiki.