In T378777, we will evolve the desktop Reference Check experience by presenting the Check in a side rail that will live adjacent to the editable content, rather than presenting the Check within the editable content.
This task involves the work of analyzing how –if at all – the change described above (and visualized below) impacts the Edit Check guardrail metrics we've established.
Change
Before T378777 | After T378777
 |  |
Decision(s) to be made
- What – if any – further investigations will we prioritize doing to understand what might be contributing to the changes in the "Metrics" detailed in the "Research questions" section below?
Research questions
- Do we notice a change in how likely the Reference Check is to be disrupting people as measured by:
- Edit completion rate
- False positive report rate
- Revert rate
- Proportion of new content edits that include a reference
- Do we notice a change in how likely the Reference Check is to cause people to publish constructive edits as measured by:
- Absolute number of people who are adding a citation as a result of this rule change
- Proportion of edits Edit Check was activated within that result in a new reference being added (and the edit not being reverted)