Create new way to bucket contributors
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	ppelberg
	Oct 24 2019, 12:15 AM

Description

In T235949, we learned the way we had been bucketing contributors in the A/B test caused harmful consequences.

As a result, we now need a new approach to bucketing contributors in the A/B test.

This tasks is about creating and implementing that approach.

Done

We have deployed a patch that makes it so 50% of the contributors from Participating Wikis [i] who meet the criteria we set in T221195 will be shown VE as their default mobile editor and 50% will be shown wikitext as their default mobile editor.
On Thursday, 31-October, we SWATed the config change that will "turn the A/B test back on"

i. Participating wikis
Copied from T221196

Azerbaijani
Bulgarian
Cantonese
Catalan
Croatian
Danish
Estonian
Finnish
Greek
Hungarian
Malay
Malayalam
Norwegian
Portugese
Romanian
Serbian
Swedish
Tamil
Thai
Urdu

The URLs for each of the wikis above are here: https://office.wikimedia.org/wiki/Community_Relations_Specialists/Audiences/Mobile_visual_editor#Delivery_list

Details

Subject	Repo	Branch	Lines +/-
Re-enable mobile editor A/B testing	operations/mediawiki-config	master	+20 -0
VE-as-default: check preferredEditor before logging a/b buckets	mediawiki/extensions/MobileFrontend	master	+13 -8
Move editor A/B test bucketing code from PHP to JS, don't use cookies	mediawiki/extensions/MobileFrontend	master	+52 -58

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T255327 [Epic] Evaluate which editing interface should be shown by default
Open	None	T227338 Test visual editor as the default mobile editor on select wikis
Resolved	ppelberg	T235101 Rerun mobile VE as default A/B test
Resolved	DLynch	T236337 Create new way to bucket contributors

Event Timeline

ppelberg created this task.Oct 24 2019, 12:15 AM

Restricted Application added subscribers: Strainu, • Petar.petkovic, jeblad, jhsoby. · View Herald TranscriptOct 24 2019, 12:15 AM

ppelberg triaged this task as High priority.Oct 24 2019, 12:15 AM

ppelberg mentioned this in T235101: Rerun mobile VE as default A/B test.

ppelberg mentioned this in T236338: QA new bucketing patch.Oct 24 2019, 12:19 AM

ppelberg mentioned this in T235104: QA for EventLogging patch.

I can take this over while David is absent.

I am moving this to In Progress since @matmarex is working on it

Change 545983 had a related patch set uploaded (by Bartosz Dziewoński; owner: Bartosz Dziewoński):
[mediawiki/extensions/MobileFrontend@master] Move editor A/B test bucketing code from PHP to JS, don't use cookies

https://gerrit.wikimedia.org/r/545983

gerritbot added a project: Patch-For-Review.Oct 25 2019, 12:17 AM

Change 546502 had a related patch set uploaded (by DLynch; owner: DLynch):
[mediawiki/extensions/MobileFrontend@master] VE-as-default: check preferredEditor before logging a/b buckets

https://gerrit.wikimedia.org/r/546502

Change 545983 merged by jenkins-bot:
[mediawiki/extensions/MobileFrontend@master] Move editor A/B test bucketing code from PHP to JS, don't use cookies

https://gerrit.wikimedia.org/r/545983

Change 546502 merged by jenkins-bot:
[mediawiki/extensions/MobileFrontend@master] VE-as-default: check preferredEditor before logging a/b buckets

https://gerrit.wikimedia.org/r/546502

Maintenance_bot removed a project: Patch-For-Review.Oct 28 2019, 4:10 PM

matmarex moved this task from In progress to Product owner review on the VisualEditor (Current work) board.Oct 28 2019, 6:45 PM

Documenting the conversation we had during today's standup meeting:

This patch will be merged tomorrow and live on all wikis this Thursday, 31-October.
Also on Thursday, 31-October, we will need to SWAT the config change that will "turn the A/B test back on"; I'm adding this as an additional item to the task description's "Done" section

ppelberg updated the task description. (Show Details)Oct 28 2019, 8:32 PM

ppelberg moved this task from Product owner review to Incoming on the VisualEditor (Current work) board.

Change 546724 had a related patch set uploaded (by DLynch; owner: DLynch):
[operations/mediawiki-config@master] Re-enable mobile editor A/B testing

https://gerrit.wikimedia.org/r/546724

gerritbot added a project: Patch-For-Review.Oct 28 2019, 8:34 PM

ppelberg reassigned this task from matmarex to DLynch.Oct 28 2019, 8:35 PM

Change 546724 merged by jenkins-bot:
[operations/mediawiki-config@master] Re-enable mobile editor A/B testing

https://gerrit.wikimedia.org/r/546724

Maintenance_bot removed a project: Patch-For-Review.Oct 31 2019, 11:10 PM

Mentioned in SAL (#wikimedia-operations) [2019-10-31T23:21:57Z] <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 02bf4b8: Re-enable mobile editor A/B testing (T236337) (duration: 00m 52s)