Background
In T293946: Enable talk for mobile users on enwiki, we introduced a change that allows mobile anons to see the talk tab at the top of the page. We would like to analyze what impact this change had on the overall editing behavior on mobile talk pages as well as on the mobile website as a whole.
Instrumentation spec and metrics collection
Instrumentation spec: https://docs.google.com/spreadsheets/d/11o7ZBtFff2Bi2L0kD-qC1c4XS82QqVs8fjcms824aO0/edit#gid=0
Metrics collection document: https://docs.google.com/spreadsheets/d/1wCI5SxwlTt0GTFzCW3H3wMFx_-FiTtBuW4WlNbQU9_M/edit#gid=0
Research questions
| ID | Research question | Evaluation metrics |
|---|---|---|
| 1. | Did showing the Talk tab within Minerva Neue to everyone who is visiting en.wiki while logged out contribute to an increase in disruption to other volunteers? | 1) Percentage of logged out users who are blocked after publishing a change to a talk page 2) Percentage of edits logged out users make to talk pages that are reverted |
| 2. | Did showing the Talk tab within Minerva Neue to everyone who is visiting en.wiki while logged out contribute to logged out users participating more on talk pages? | 1) The number edits logged out users publish to talk pages that are not reverted within 48 hours 2) The percentage of new comments and topics IP editors publish that receive a response (and vice versa) |
| 3. | Did showing the Talk tab within Minerva Neue to everyone who is visiting en.wiki while logged out contribute to them making helpful changes to content in the main namespace? | 1) Number of main namespace edits IP editors make that are not reverted within 48 hours, 2) Percentage of edits IP editors make to the main namespaces that are not reverted within 48 hours |