T431858 will make it so newcomers editing en.wiki on mobile will be shown VE by default.
This task involves the work of analyzing core editing metrics in the 2 weeks before and after this change.
Analysis approach
We'll compute and compare each of the metrics below for the 2 weeks before and after VE becomes enabled as the default mobile editing interface for newcomers at en.wiki.
Audience
Distinct registered users with ≤100 cumulative edits, to align with DE1.1 KPI definition.
Core editing metrics
| Metric | Definition | Logged-in | Logged-out | Notes |
|---|---|---|---|---|
| [DE1.1 KPI] Distinct registered users who make a constructive edit | Proportion and number of registered users with 100 or fewer edits who publish as least one constructive edit on mobile web (edit was not reverted within 48 hours) on a main namespace. Where the denominator in this context refers to users who make an edit attempt (defined as the interface reaching ready). [1] | ✅ Yes | ❌ No | not implemented |
| Edit completion rate | The proportion of editing sessions on a main namespace that successfully save an edit (saveSuccess) after the editor interface was ready (ready). | ✅ Yes | ✅ Yes | |
| Constructive edit rate | Proportion of published main namespace edits that are constructive (not reverted within 48 hours of being published) | ✅ Yes | ✅ Yes | |
| Revert rate | Proportion of published main namespace edits that are reverted within 48 hours of being published | ✅ Yes | ✅ Yes | |
| 24-hr Constructive activation | Proportion of newly registered accounts that make at least one constructive edit in the main namespace within 24 hours of account registration, where constructive means the edit was not reverted within 48 hours of being published. | ✅ Yes | ✅ Yes | |
| 2nd week retention | Percentage of contributors who return to publish at least one edit (any namespace) during their second week (day 7-14 ) after their initial constructive edit on a main namespace after experiment exposure. | ✅ Yes | ❌ No | Not instrumented |
| Edit abandonment rate (w/ and w/o changes) | Proportion of main namespace edit attempts that were abandoned with the user discarding changes (abandon). Proportion of main namespace edit attempts that were abandoned with no changes (nochange). | ✅ Yes | ✅ Yes | |
NOTE: All metrics will be limited to mobile web edits to the main namespace on English Wikipedia.