Rerun mobile VE as default A/B test
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	ppelberg
	Oct 9 2019, 3:16 PM

Description

This task represents the work that needs to be done before the test can officially start. More details follow...

In T234277, we decided to rerun the VE as default A/B test. Our rationale is posted in this comment: T234277#5542833

Outside of how we bucket contributors [1], no other changes are needing to be made to the A/B test [2].

Done

Engineering QA for T232237#5548323 is completed
Product Analytics QA for T232237#5548323 is completed. See task: T235104
Fix for T233470 is deployed
Bucketing patch is deployed T236337
Bucketing patch is QA'd T236338

Related Objects
Search...

Status	Assigned	Task
Open	None	T255327 [Epic] Evaluate which editing interface should be shown by default
Open	None	T227338 Test visual editor as the default mobile editor on select wikis
Resolved	ppelberg	T235101 Rerun mobile VE as default A/B test
Resolved	DLynch	T236337 Create new way to bucket contributors
Resolved	Mayakp.wiki	T236338 QA new bucketing patch
Resolved	Mayakp.wiki	T235104 QA for EventLogging patch
Resolved	Ryasmeen	T233470 Mobile VE toolbar doesn't stay onscreen on iOS 13 when keyboard is open
Resolved	ppelberg	T221198 VE mobile default: analyze A/B test results
Resolved	ppelberg	T243641 Instrument mobile wikitext editor fallback worfklow
Resolved	DLynch	T243648 QA mobile wikitext fallback workflow instrumentation
Resolved	MNeisler	T259196 Calculate revert rate baseline
Resolved	DLynch	T302356 Deploy config change to "turn off" mobile VE A/B test

Event Timeline

ppelberg created this task.Oct 9 2019, 3:16 PM

ppelberg updated the task description. (Show Details)Oct 9 2019, 3:22 PM

ppelberg edited projects, added VisualEditor (Current work); removed VisualEditor.

ppelberg moved this task from Incoming to In progress on the VisualEditor (Current work) board.

ppelberg updated the task description. (Show Details)Oct 9 2019, 3:36 PM

ppelberg mentioned this in T234277: Decide how we move forward with the A/B test.

Engineering QA for T232237#5548323 is completed
Product Analytics QA for T232237#5548323 is completed. See task: T235104

Documenting a conversation from this morning's standup related to the above...

Engineering QA can happen as soon as tomorrow, considering this patch (see below) will be live on all wikis by then
Product Analytics QA can happen as soon as tomorrow, considering the patch (see below) will be live on all wikis by then. See: T235104

cc @matmarex @Mayakp.wiki

Patch for engineering QA:

In T232237#5548323, @gerritbot wrote:

Change 539933 merged by jenkins-bot:
[mediawiki/extensions/MobileFrontend@master] Load editor EventLogging code earlier

https://gerrit.wikimedia.org/r/539933

ppelberg moved this task from In progress to Stalled/Waiting on the VisualEditor (Current work) board.Oct 10 2019, 9:59 PM

Update

Engineering QA for T232237#5548323 is just awaiting confirmation from the Web team that the patch doesn't slow down page load times
Product Analytics QA for T232237#5548323 is in progress: T235104#5573854

In T235101#5578097, @ppelberg wrote:

Update

~~Engineering QA for T232237#5548323 is just awaiting confirmation from the Web team that the patch doesn't slow down page load times~~

@Jdlrobson shared helpful graphs with us here: T232237#5578104

Krinkle renamed this task from Rerun VE as default A/B test to Rerun mobile VE as default A/B test.Oct 18 2019, 8:47 PM

Engineering QA is complete.

See: T232237#5588023

Also, thank you for renaming this task, @Krinkle.

ppelberg updated the task description. (Show Details)Oct 18 2019, 8:59 PM

Update to task description