User Story:
As a the Growth team, I want to interpret the initial WE1.2.6 alpha test results, so that we can understand the impact on constructive activation on mobile.
Before we launch a full experiment, we will release a temporary "alpha" version of the Surfacing Structured Tasks work to answer some major unknowns and learn quickly.
Related:
- T377098: Experiment Analysis: Surfacing Structured Tasks experiment (WE1.2.6 / WE1.2.9)
- T377096: Measurement Plan: Surfacing Structured Tasks experiment (WE1.2.6)
- T377097: Instrumentation: Surfacing Structured Tasks experiment (WE1.2.6)
Task scope:
Analyze the initial data from the WE1.2.6 alpha test.
| Question | Metric | Type of Metric |
|---|---|---|
| How many newcomers will end up seeing this type of suggestion? | Impressions | Primary Metric for Alpha test |
| How many newcomers end up deciding to proceede with the suggestion? | CTR (for the affirmative option on the pop-up) | Secondary Metric for Alpha test |
| How many newcomers end up completing "add a link" task in constructive way? | Constructive Activation | Primary Metric for Experiment (ideally we can gather this data in the alpha test, but this can wait for T377098: Experiment Analysis: Surfacing Structured Tasks experiment (WE1.2.6 / WE1.2.9) if necessary). |
Background
- Project page: Constructive activation experimentation
- Related epic: T362584: [EPIC] Surface Structured Tasks to new editors (FY24/25: WE1.2.3 & WE1.2.6 & WE1.2.9)
- Related work: Structured tasks & Edit check
Current full-page editing experiences require too much context, patience, and trial and error for many newcomers to contribute constructively. To support a new generation of volunteers, we will increase the number and availability of smaller, structured, and more task-specific editing workflows (E.g. Edit Check and Structured Tasks). The Growth team will primarily focus on Structured Tasks, while working closely with the Editing team to ensure our work integrates well with Edit Check.
This project aims to address the following user problem: Getting started editing on Wikipedia is difficult and especially frustrating on mobile devices. I want the editing interface to provide the in-the-moment policy and technical guidance I need, so my initial efforts aren't reverted.
This project aims to achieve the following user outcome: As a new Wikipedia volunteer, I feel confident and enthusiastic about contributing to the Wikimedia movement by editing Wikipedia articles. The tools provided guide me step-by-step, limit distractions, and allow me to learn progressively so I can successfully contribute on my mobile device.
As part of the Growth team 2024/2025 Annual Plan, the Growth team will explore various ways to increase constructive activation on mobile. This is part of the Wikimedia Foundation 2024-2025 Annual Plan, specifically the Wiki Experiences 1.2 Key Result
Acceptance Criteria
- Share alpha test analysis: Impressions, CTR, and (if possible) Constructive Activation.