Page MenuHomePhabricator

Create new way to bucket contributors
Closed, ResolvedPublic

Description

In T235949, we learned the way we had been bucketing contributors in the A/B test caused harmful consequences.

As a result, we now need a new approach to bucketing contributors in the A/B test.

This tasks is about creating and implementing that approach.

Done

  • We have deployed a patch that makes it so 50% of the contributors from Participating Wikis [i] who meet the criteria we set in T221195 will be shown VE as their default mobile editor and 50% will be shown wikitext as their default mobile editor.
  • On Thursday, 31-October, we SWATed the config change that will "turn the A/B test back on"

i. Participating wikis
Copied from T221196

  • Azerbaijani
  • Bulgarian
  • Cantonese
  • Catalan
  • Croatian
  • Danish
  • Estonian
  • Finnish
  • Greek
  • Hungarian
  • Malay
  • Malayalam
  • Norwegian
  • Portugese
  • Romanian
  • Serbian
  • Swedish
  • Tamil
  • Thai
  • Urdu

The URLs for each of the wikis above are here: https://office.wikimedia.org/wiki/Community_Relations_Specialists/Audiences/Mobile_visual_editor#Delivery_list

Details

Related Gerrit Patches:
operations/mediawiki-config : masterRe-enable mobile editor A/B testing
mediawiki/extensions/MobileFrontend : masterVE-as-default: check preferredEditor before logging a/b buckets
mediawiki/extensions/MobileFrontend : masterMove editor A/B test bucketing code from PHP to JS, don't use cookies

Event Timeline

Restricted Application added subscribers: Strainu, Petar.petkovic, jeblad, jhsoby. · View Herald TranscriptThu, Oct 24, 12:15 AM
ppelberg triaged this task as High priority.Thu, Oct 24, 12:15 AM
matmarex claimed this task.Thu, Oct 24, 5:35 PM

I can take this over while David is absent.

I am moving this to In Progress since @matmarex is working on it

Change 545983 had a related patch set uploaded (by Bartosz Dziewoński; owner: Bartosz Dziewoński):
[mediawiki/extensions/MobileFrontend@master] Move editor A/B test bucketing code from PHP to JS, don't use cookies

https://gerrit.wikimedia.org/r/545983

Change 546502 had a related patch set uploaded (by DLynch; owner: DLynch):
[mediawiki/extensions/MobileFrontend@master] VE-as-default: check preferredEditor before logging a/b buckets

https://gerrit.wikimedia.org/r/546502

Change 545983 merged by jenkins-bot:
[mediawiki/extensions/MobileFrontend@master] Move editor A/B test bucketing code from PHP to JS, don't use cookies

https://gerrit.wikimedia.org/r/545983

Change 546502 merged by jenkins-bot:
[mediawiki/extensions/MobileFrontend@master] VE-as-default: check preferredEditor before logging a/b buckets

https://gerrit.wikimedia.org/r/546502

Documenting the conversation we had during today's standup meeting:

  • This patch will be merged tomorrow and live on all wikis this Thursday, 31-October.
  • Also on Thursday, 31-October, we will need to SWAT the config change that will "turn the A/B test back on"; I'm adding this as an additional item to the task description's "Done" section
ppelberg updated the task description. (Show Details)Mon, Oct 28, 8:32 PM

Change 546724 had a related patch set uploaded (by DLynch; owner: DLynch):
[operations/mediawiki-config@master] Re-enable mobile editor A/B testing

https://gerrit.wikimedia.org/r/546724

ppelberg reassigned this task from matmarex to DLynch.Mon, Oct 28, 8:35 PM

Change 546724 merged by jenkins-bot:
[operations/mediawiki-config@master] Re-enable mobile editor A/B testing

https://gerrit.wikimedia.org/r/546724

Mentioned in SAL (#wikimedia-operations) [2019-10-31T23:21:57Z] <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 02bf4b8: Re-enable mobile editor A/B testing (T236337) (duration: 00m 52s)

ppelberg closed this task as Resolved.Fri, Nov 1, 4:04 PM
ppelberg updated the task description. (Show Details)