Page MenuHomePhabricator

Re-run glent m0 AB test
Closed, ResolvedPublic

Description

The first run of this test had two problems:

  • The wrong UI message was displayed, telling users that they were seeing rewritten query results (they were not) instead of telling them we have a query suggestion
  • The logging didn't record which requests had results provided by glent. If the impact was large this wouldn't matter, but M0 in particular provides low volume but high precision suggestions. To measure any changes here we need to know exactly which requests had a glent suggestion.

Both of these have been addressed and deployed, re-run the test.

Event Timeline

Change 576951 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[mediawiki/extensions/WikimediaEvents@master] [search] Turn on glent m0 AB test

https://gerrit.wikimedia.org/r/576951

Change 576952 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[operations/mediawiki-config@master] [cirrus] Configuration for glent m0 AB test

https://gerrit.wikimedia.org/r/576952

Change 576952 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] Configuration for glent m0 AB test

https://gerrit.wikimedia.org/r/576952

Change 579353 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[mediawiki/extensions/WikimediaEvents@wmf/1.35.0-wmf.23] [search] Turn on glent m0 AB test

https://gerrit.wikimedia.org/r/579353

Change 576951 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@master] [search] Turn on glent m0 AB test

https://gerrit.wikimedia.org/r/576951

Change 579353 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@wmf/1.35.0-wmf.23] [search] Turn on glent m0 AB test

https://gerrit.wikimedia.org/r/579353