| EBernhardson | |
| Jan 23 2019, 8:03 PM |
With the new profiles code deploying this week (T213106) we have everything in place to run the AB test for the new profiles (T213105). This should be run in the same way as the previous english test (T211033), and analyzed with the same report/metrics.
Change 484334 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[operations/mediawiki-config@master] Add wbsearchentities profiles for de, fr, es
Change 486154 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[operations/mediawiki-config@master] Turn on wbsearchentities ab test in de, fr, es
Change 484334 merged by jenkins-bot:
[operations/mediawiki-config@master] Add wbsearchentities profiles for de, fr, es
Mentioned in SAL (#wikimedia-operations) [2019-01-25T00:37:57Z] <ebernhardson@deploy1001> Synchronized wmf-config/WikibaseSearchSettings.php: SWAT T214515 gerrit:484334: Add wbsearchentities profiles for de, fr, es (duration: 00m 45s)
Change 486154 merged by jenkins-bot:
[operations/mediawiki-config@master] Turn on wbsearchentities ab test in de, fr, es
Mentioned in SAL (#wikimedia-operations) [2019-01-25T00:46:27Z] <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT T214515 gerrit:486154: Turn on wbsearchentities ab test in de, fr, es (duration: 00m 46s)
Change 488588 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[operations/mediawiki-config@master] Turn off wbsearchentities ab test in de, fr, es
Change 488588 merged by jenkins-bot:
[operations/mediawiki-config@master] Turn off wbsearchentities ab test in de, fr, es
Mentioned in SAL (#wikimedia-operations) [2019-02-08T00:22:02Z] <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT gerrit:488588 phab:T214515 Turn off wikidata wbsearchentities ab test in de, fr, es (duration: 02m 55s)
AB test reports published. Clicks@1 improved in all languages with no regressions in other metrics. Clicks@1 starts around 78-80% and improves by 2-5% to 83-85% depending on language. Will deploy these profiles as the new defaults.
Change 489780 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[operations/mediawiki-config@master] Promote new wbsearchentities profiles to default
Change 489780 merged by jenkins-bot:
[operations/mediawiki-config@master] Promote new wbsearchentities profiles to default
Mentioned in SAL (#wikimedia-operations) [2019-02-12T00:28:05Z] <ebernhardson@deploy1001> Synchronized wmf-config/WikibaseSearchSettings.php: gerrit:489780 T214515 Promote new wbsearchentities profiles to default in de, fr, es (duration: 00m 46s)