Page MenuHomePhabricator

Decide next steps for Section Editing (mobile)
Closed, ResolvedPublic

Description

Overview

This tasks represents the work involved with deciding whether to turn mobile Section Editing for all registered contributors. Currently it is only live for 50%. See T218851 for more details.

Dependencies

Completing this tasks depends on this being completed: T223302: Check on Section Editing A/B test results

Done

  • Decide whether to turn mobile Section Editing on for all registered contributors

Event Timeline

ppelberg created this task.May 29 2019, 6:38 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 29 2019, 6:38 PM
ppelberg closed this task as Resolved.Jun 17 2019, 10:00 PM
ppelberg added a subscriber: mpopov.

Okay, here are the daily user counts, VE session counts, sessions/user rates, and edit completion (success) rates:


Key takeaways from the analysis:

  • No clear change in sessions/user
    • The average number of sessions per user was 1.94 in the control group and 1.948 in the treatment group; this change was not statistically significant
    • We're good to keep section editing on without worrying that it may negatively impact this metric
  • Clear improvement in completion rate
    • There was statistically significant (p-value = 0.034) improvement of 0.98% (in probability of completion) on average
    • This roughly translates to 1 more completed VE edit for every 100 started if section editing is enabled than if it's not; or, viewed in another way, 1 fewer abandoned VE edit for every 100 started

@ppelberg: My analysis of the data suggests that we should do a full rollout of section editing on mobile VE :D

We will be turning off the A/B test and rolling out Section Editing to all mobile VE today. See: T225645#5259886

Restricted Application added a project: User-Ryasmeen. · View Herald TranscriptJun 17 2019, 10:00 PM
ppelberg updated the task description. (Show Details)Jun 17 2019, 10:00 PM