Page MenuHomePhabricator

Emit revertrisk scores to statsd and plot in Grafana
Open, Needs TriagePublic

Description

On revertrisk score fetch in ORES extension:

  • increment a counter for each revision score that is greater than the minimal threshold (0.50) for a revision to be considered as "likely to be reverted".
    • If we plot these in Grafana, we'll be able to see spikes in attempts to flood a wiki with likely-to-be-reverted content.

On revert (In WikimediaEvents, most likely):

  • increment a counter when an edit is reverted, and the "likely to be reverted" score in ORES was > 0.50 for the revision being reverted
    • ... increment a counter if the "likely to be reverted" score was < 0.50.

That would help us visualize the accuracy of the results

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

One question for clarification: what piece of software would be talking to statsd? RR as it runs on LW cannot access any statsd atm, since it is mostly isolated.

SO would this run on whatever client is querying RR on LiftWing?

  • increment a counter for each revision score that is greater than the minimal threshold (0.50) for a revision to be considered as "likely to be reverted".

I plan to emit this from ORES extension or possibly in WikimediaEvents using the hook that ORES extension provides after fetching a score.

Change 994194 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/ORES@master] revertrisk: Increment statsd counters for likely/unlikely to reverted

https://gerrit.wikimedia.org/r/994194