Page MenuHomePhabricator

Analyse time to revert TA edits for April
Closed, ResolvedPublic

Description

Summary

We need an updated report for the 4.8 KR metric measuring how quickly bad-faith edits made by temporary accounts are reverted by patrollers.

Metric

Reduce by 40% the time it takes from when a bad-faith edit is made by a temporary account to the revert of that edit by a patroller, over a 7-day window, for 75% of those reverts.

Metric definition
Bad-faith edits are defined as:

  • Edits made by temporary accounts.
  • Reverted by a non-bot user with extended rights.
  • “Extended rights” means at least the right to reveal temporary account IP addresses. These users are assumed to be patrollers.

Baseline and target

  • Baseline: 75% of reverts defined this way were reverted within 5.83 hours.
  • Target: 75% of reverts defined this way are reverted within 4.1 hours.

Task

Please generate a report showing how this metric performed from April 1 to April 23. (Since the data end on 30 April, we do not know which of the edits in the last 7 days of the month will have been reverted within 7 days.)

The report should include:

  • The P75 time between the temporary-account edit and the patroller revert.

Nice to have

  • Please also include a weekly trend showing how this metric has evolved since January 2026, with one data point per week.

For the weekly trend, please include:

  • Week start date.
  • P75 revert time.

Related Objects

Event Timeline

Analysis

Weekly trend since temporary accounts were deployed to English Wikipedia (5 November, so the first full day of data is 6 November 2025):

image.png (1,002×539 px, 65 KB)

Rolling averages are included for 4-week and 12-week periods, since the weekly data are very noisy.

Week ending12-week rolling average P 75 time to revert
25 Jan (first data point that includes 12 weeks of data)4.90 hours
19 April (last data point that includes 12 weeks of data)4.25 hours

Difference: 13%

Notes
  • It is difficult to draw firm conclusions about the % reduction in time to revert bad-faith edits from temporary accounts from this data, since temporary accounts have not been deployed for long enough to experience an annual cycle.
  • However, there appears to be no clear upwards trend to suggest that revert times are quickly escalating. We potentially see a downwards trend, though we would need to observe for longer to see if this continues.