Page MenuHomePhabricator

Turn off A/B test for language switching on pilot wikis
Closed, ResolvedPublic2 Estimated Story Points

Description

Background

In T269093: Deploy new language switching location to test wikis and begin A/B test pt 1 we enabled the A/B test for language switching. After collecting sufficient data, we are now ready to turn the test off and go to 100% on all pilot wikis with the new functionality.

Acceptance criteria

  • Disable A/B test for language switching button
  • All pilot wikis should receive the new treatment for logged-in and logged-out users

Event Timeline

@ovasileva we can't verify the bucketing during the A/B test however as outlined in T280825#7209793 we could test the bucketing /after/ the data has been collected to verify that by adding a new event for every user that would have been bucketed.

@ovasileva we can't verify the bucketing during the A/B test however as outlined in T280825#7209793 we could test the bucketing /after/ the data has been collected to verify that by adding a new event for every user that would have been bucketed.

I think that makes sense. In that case, we can go ahead and turn off the A/B test and do the check afterwards. @MNeisler - does that sound okay to you?

@ovasileva we can't verify the bucketing during the A/B test however as outlined in T280825#7209793 we could test the bucketing /after/ the data has been collected to verify that by adding a new event for every user that would have been bucketed.

I think that makes sense. In that case, we can go ahead and turn off the A/B test and do the check afterwards. @MNeisler - does that sound okay to you?

LGoto changed the point value for this task from 1 to 2.Jul 15 2021, 5:15 PM

Change 704867 had a related patch set uploaded (by Clare Ming; author: Clare Ming):

[operations/mediawiki-config@master] Update config for language switching on pilot wikis

https://gerrit.wikimedia.org/r/704867

cjming moved this task from Doing to Code Review on the Web-Team-Backlog (Kanbanana-FY-2020-21) board.
cjming subscribed.

Change 704867 merged by jenkins-bot:

[operations/mediawiki-config@master] Update config for language switching on pilot wikis

https://gerrit.wikimedia.org/r/704867

Mentioned in SAL (#wikimedia-operations) [2021-07-20T11:18:44Z] <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:704867|Update config for language switching on pilot wikis (T286459)]] (duration: 00m 59s)

nray reassigned this task from nray to cjming.
nray subscribed.