| ppelberg | |
| May 29 2019, 6:38 PM |
| F29538702: section-editing-daily.png | |
| Jun 17 2019, 10:00 PM |
This tasks represents the work involved with deciding whether to turn mobile Section Editing for all registered contributors. Currently it is only live for 50%. See T218851 for more details.
Completing this tasks depends on this being completed: T223302: Check on Section Editing A/B test results
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T209955 [EPIC: Focus] Isolate Section Editing | |||
| Resolved | ppelberg | T224615 Decide next steps for Section Editing (mobile) |
Okay, here are the daily user counts, VE session counts, sessions/user rates, and edit completion (success) rates:
Key takeaways from the analysis:
- No clear change in sessions/user
- The average number of sessions per user was 1.94 in the control group and 1.948 in the treatment group; this change was not statistically significant
- We're good to keep section editing on without worrying that it may negatively impact this metric
- Clear improvement in completion rate
- There was statistically significant (p-value = 0.034) improvement of 0.98% (in probability of completion) on average
- For example: on Korean Wikipedia the probability that a started mobile VE session would would end in an edit goes from 36.75% to 37.73% when section editing is enabled
- The greatest impact is estimated to be on Catalan Wikipedia, where the improvement is 1.042% (from 45.36% in controls to 46.41% in treatment)
- Refer to https://analytics.wikimedia.org/datasets/editing-reports/section-editing-experiment.html#Per-wiki-improvements for additional examples
- This roughly translates to 1 more completed VE edit for every 100 started if section editing is enabled than if it's not; or, viewed in another way, 1 fewer abandoned VE edit for every 100 started
@ppelberg: My analysis of the data suggests that we should do a full rollout of section editing on mobile VE :D
