Let's use this to turn on the A/B test for the interleaved results 2-way test.
Description
Description
| Status | Assigned | Task | ||
|---|---|---|---|---|
| Open | None | T174064 [FY 2017-18 Objective] Implement advanced search methodologies | ||
| Resolved | EBernhardson | T161632 [Epic] Improve search by researching and deploying machine learning to re-rank search results | ||
| Resolved | EBernhardson | T162369 Evaluate rescore windows for learning to rank | ||
| Resolved | None | T174066 [Q1 2017-18 Objective] Perform load and A/B tests on new models (interleaved search results) | ||
| Resolved | EBernhardson | T150032 Add support for interleaved results in 2-way A/B test | ||
| Resolved | debt | T171212 Interleaved results A/B test: turn on | ||
| Resolved | EBernhardson | T171213 Interleaved results A/B test: check that data is flowing the way we expect | ||
| Resolved | debt | T171214 Interleaved results A/B test: turn off test | ||
| Resolved | mpopov | T171215 Interleaved results A/B test: analysis of data | ||
| Declined | EBernhardson | T171984 Turn on test of LTR with standard AB buckets and an interleaved bucket. |
Event Timeline
Comment Actions
Change 368471 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[mediawiki/extensions/WikimediaEvents@master] Turn on search LTR test
Comment Actions
Change 369594 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[operations/mediawiki-config@master] CirrusSearch configuration for LTR AB test
Comment Actions
Change 368471 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@master] Turn on search LTR test
Comment Actions
Change 370112 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[mediawiki/extensions/WikimediaEvents@wmf/1.30.0-wmf.12] Turn on search LTR test
Comment Actions
Change 369594 merged by jenkins-bot:
[operations/mediawiki-config@master] CirrusSearch configuration for LTR AB test
Comment Actions
Change 370112 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@wmf/1.30.0-wmf.12] Turn on search LTR test
Comment Actions
Mentioned in SAL (#wikimedia-operations) [2017-08-03T23:43:51Z] <ebernhardson@tin> Synchronized php-1.30.0-wmf.12/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: T171212: Turn on CirrusSearch MLR AB test (duration: 00m 46s)
Comment Actions
Change 370124 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@master] Disable CirrusSearch AB test
Comment Actions
Change 370126 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[mediawiki/extensions/WikimediaEvents@wmf/1.30.0-wmf.12] Disable CirrusSearch AB test
Comment Actions
Change 370127 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[operations/mediawiki-config@master] Update CirrusSearch AB test rescore profiles
Comment Actions
Change 370126 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@wmf/1.30.0-wmf.12] Disable CirrusSearch AB test
Comment Actions
Change 370128 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[mediawiki/extensions/WikimediaEvents@master] Turn on CirrusSearch MLR AB test
Comment Actions
Added a pull request to the plugin to potentially resolve this problem as well: https://github.com/o19s/elasticsearch-learning-to-rank/pull/66
Comment Actions
Change 370127 merged by jenkins-bot:
[operations/mediawiki-config@master] Update CirrusSearch AB test rescore profiles
Comment Actions
Change 370128 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@master] Turn on CirrusSearch MLR AB test
Comment Actions
Mentioned in SAL (#wikimedia-operations) [2017-08-07T18:53:56Z] <ebernhardson@tin> Synchronized wmf-config/CirrusSearch-production.php: T171212 - Update CirrusSearch AB test rescore profiles (duration: 00m 46s)
Comment Actions
Change 370516 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[mediawiki/extensions/WikimediaEvents@wmf/1.30.0-wmf.12] Turn on CirrusSearch MLR AB test
Comment Actions
Change 370516 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@wmf/1.30.0-wmf.12] Turn on CirrusSearch MLR AB test
Comment Actions
Mentioned in SAL (#wikimedia-operations) [2017-08-07T19:05:58Z] <ebernhardson@tin> Synchronized php-1.30.0-wmf.12/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: T171212 - Turn on CirrusSearch MLR AB test (duration: 00m 46s)