Page MenuHomePhabricator
Create Task
Maniphest T227338

Test visual editor as the default mobile editor on select wikis
Closed, ResolvedPublic
Actions

Description

We are running a randomized experiment to see the potential effects of making the visual editor the default editor on mobile. This task covers the experiment, its preparations, and its analysis; T221185 covers feature improvements needed for the visual editor to be the default.

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedNoneT255327 [Epic] Evaluate which editing interface should be shown by default
 ResolvedNoneT227338 Test visual editor as the default mobile editor on select wikis
 DuplicateppelbergT221187 VE mobile default: create measurement specifications and experiment plan
 ResolvedMay 29 2019nshahquinn-wmfT221195 VE mobile default: design A/B test
 ResolvedJTannerWMFT225209 Consult legal about A/B test instrumentation
 ResolvedppelbergT221188 VE mobile default: identify wikis for trial
 Resolved• Whatamidoing-WMFT221200 VE mobile default: community outreach
 ResolvedDLynchT221196 Set mobile VE as default for target wikis in A/B test
 Resolvednshahquinn-wmfT221197 VE mobile default: A/B test post-deployment data checks
 ResolvedDLynchT226847 Mobile editors do not log new revision IDs on saveSuccess
 ResolvedJul 6 2019ppelbergT227099 Post A/B test analysis caveats to project page
 ResolvedDLynchT227317 Oversample mobile wikitext EditAttemptStep events on default editor A/B test wikis
 ResolvedppelbergT227897 Editing lede section in VE mobile loads the whole article
 DuplicateppelbergT221192 VE mobile default: make experiment plan
 ResolvedppelbergT226687 Determine decision points for VE as default
 DuplicateNoneT221199 VE mobile default: implement on select wikis
 ResolvedDLynchT221191 VE mobile default: start tracking editor switches on mobile + desktop
 ResolvedppelbergT221867 Update MediaWiki project page
 ResolvedppelbergT221189 VE mobile default: create MediaWiki project page
 ResolvedmatmarexT227670 Don't show the "Welcome to Wikipedia" overlay on mobile ve
 Resolvednshahquinn-wmfT229426 Check on VE as default A/B test results
 Declinednshahquinn-wmfT230827 Write up experiment plan
 ResolvedppelbergT232175 Investigate VE as default A/B test findings
 ResolvedmatmarexT232237 VE mobile default test buckets are unbalanced
 ResolvedppelbergT234277 Decide how we move forward with the A/B test
 ResolvedppelbergT235101 Rerun mobile VE as default A/B test
 ResolvedDLynchT236337 Create new way to bucket contributors
ResolvedMayakp.wikiT236338 QA new bucketing patch
 ResolvedMayakp.wikiT235104 QA for EventLogging patch
 ResolvedRyasmeenT233470 Mobile VE toolbar doesn't stay onscreen on iOS 13 when keyboard is open
 ResolvedppelbergT221198 VE mobile default: analyze A/B test results
 ResolvedppelbergT243641 Instrument mobile wikitext editor fallback worfklow
 ResolvedDLynchT243648 QA mobile wikitext fallback workflow instrumentation
 ResolvedMNeislerT259196 Calculate revert rate baseline
 ResolvedDLynchT302356 Deploy config change to "turn off" mobile VE A/B test

Event Timeline

nshahquinn-wmf created this task.Jul 5 2019, 3:46 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 5 2019, 3:46 PM
nshahquinn-wmf added subtasks: T221187: VE mobile default: create measurement specifications and experiment plan, T226687: Determine decision points for VE as default, T221199: VE mobile default: implement on select wikis, T221191: VE mobile default: start tracking editor switches on mobile + desktop, T221867: Update MediaWiki project page, T221189: VE mobile default: create MediaWiki project page.Jul 5 2019, 3:50 PM
nshahquinn-wmf mentioned this in T221185: Prepare visual editor to be a default mobile editor.Jul 5 2019, 3:53 PM
ppelberg added a subtask: T227670: Don't show the "Welcome to Wikipedia" overlay on mobile ve.Jul 10 2019, 2:34 PM
JTannerWMF moved this task from To Triage to Epics on the VisualEditor board.Jul 16 2019, 4:58 PM
ppelberg added a subtask: T229426: Check on VE as default A/B test results.Jul 31 2019, 2:27 PM
ppelberg closed subtask T227670: Don't show the "Welcome to Wikipedia" overlay on mobile ve as Resolved.Sep 3 2019, 12:04 AM
ppelberg closed subtask T221191: VE mobile default: start tracking editor switches on mobile + desktop as Resolved.Sep 3 2019, 1:42 AM
nshahquinn-wmf closed subtask T229426: Check on VE as default A/B test results as Resolved.Sep 5 2019, 3:55 PM
ppelberg added a subtask: T232175: Investigate VE as default A/B test findings.Sep 6 2019, 12:03 AM
kzimmerman closed subtask T230827: Write up experiment plan as Declined.Sep 10 2019, 6:37 PM
ppelberg closed subtask T226687: Determine decision points for VE as default as Resolved.Sep 19 2019, 2:16 AM
ppelberg closed subtask T234277: Decide how we move forward with the A/B test as Resolved.Oct 9 2019, 3:37 PM
ppelberg mentioned this in T237075: Investigate drop in mobile VE edit completion rate among unregistered users.Nov 12 2019, 1:30 AM
Alsee subscribed.Nov 23 2019, 8:36 AM
Mayakp.wiki closed subtask T235104: QA for EventLogging patch as Resolved.Dec 4 2019, 9:02 PM
ppelberg mentioned this in T243641: Instrument mobile wikitext editor fallback worfklow.Jan 25 2020, 12:02 AM
ppelberg closed subtask T235101: Rerun mobile VE as default A/B test as Resolved.Feb 15 2020, 2:06 AM
ppelberg closed subtask T232175: Investigate VE as default A/B test findings as Resolved.Jun 13 2020, 2:04 AM
ppelberg added a parent task: T255327: [Epic] Evaluate which editing interface should be shown by default.Jun 15 2020, 4:52 AM
nshahquinn-wmf closed this task as Resolved.Jan 15 2025, 10:53 PM

Done a long time ago. Results at https://www.mediawiki.org/wiki/VisualEditor_on_mobile/VE_mobile_default#06_April_2023:_A/B_test_results.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits