T378777 changed the desktop Reference Check experience by presenting the check in a side rail located adjacent to the editable content, rather than presenting the Check within the editable content.
T380539 analyzed how this change impacted the Edit Check guardrail metrics we’ve established by reviewing data two weeks before and after the change.
This task builds on T380539 by looking specifically about how/if the change T378777 introduced impacted constructive activation. [1]
Decision(s) to be made
The information this task generates will be used to help the WE 1.2 KR develop a better understanding of how we are tracking against the 10% improvement target we set (T371726) and ultimately, decide what – if any – adjustments we make to the strategy that's informing the approach we're taking to cause this change.
Research question(s)
- 1. What – if any – impact did the change T378777 introduce have on constructive activation in the two weeks before and after the change was deployed?
Note: we think we can use the query we ran in T360829 to establish the baseline for constructive activation in this context as well.
i. , Constructive activation defined as: "The percentage of newcomers making at least one edit to an article in the main namespace of a Wikipedia project on a mobile device within 24 hours of registration (also on a mobile device) and that edit not being reverted within 48 hours of being published."