Page MenuHomePhabricator

[SPIKE] Decide whether adjustments are needed to Edit Check (references) heuristic
Closed, ResolvedPublic

Description

Prior to starting the A/B test to evaluate the impact of the references Edit Check (T342930), it's important that we be confident the heuristic is configured to sufficiently minimize false positive and false negatives.

This task involves the work of revisiting the initial heuristic thresholds [i] to ensure the above is true.

Background

This task was, in part, prompted by the decision the Editing Team made on 30 Aug 2023 to limit the edits the reference Edit Check can be activated within to edits that involve people adding a new paragraph.[ii]


i. T324730, T340086, and T345121
ii. T345121

Event Timeline

ppelberg moved this task from Untriaged to Upcoming on the Editing-team board.
ppelberg moved this task from To Triage to Triaged on the VisualEditor board.
ppelberg claimed this task.

At present, we are not aware of any adjustments needed to the Reference Check's heuristic, as evidenced by the positive impact it's been proven to have and the enthusiasm volunteers have expressed for enabling the feature. [i][ii]


i. https://www.mediawiki.org/wiki/Edit_check#Reference_Check_A/B_Test
ii. https://www.mediawiki.org/wiki/Edit_check/Deployment_status