Page MenuHomePhabricator
Create Task
Maniphest T171212

Interleaved results A/B test: turn on
Closed, ResolvedPublic
Actions

Description

Let's use this to turn on the A/B test for the interleaved results 2-way test.

Details

ProjectBranchLines +/-Subject
mediawiki/extensions/WikimediaEventswmf/1.30.0-wmf.12+3 -4Turn on CirrusSearch MLR AB test
mediawiki/extensions/WikimediaEventsmaster+3 -4Turn on CirrusSearch MLR AB test
operations/mediawiki-configmaster+2 -2Update CirrusSearch AB test rescore profiles
mediawiki/extensions/WikimediaEventswmf/1.30.0-wmf.12+3 -3Disable CirrusSearch AB test
mediawiki/extensions/WikimediaEventsmaster+3 -3Disable CirrusSearch AB test
mediawiki/extensions/WikimediaEventswmf/1.30.0-wmf.12+18 -5Turn on search LTR test
operations/mediawiki-configmaster+109 -0CirrusSearch configuration for LTR AB test
mediawiki/extensions/WikimediaEventsmaster+18 -5Turn on search LTR test
Customize query in gerrit

Related Objects
Search...

Event Timeline

debt created this task.Jul 20 2017, 7:51 PM
Restricted Application edited projects, added Discovery-Search; removed Discovery-Search (Current work). · View Herald TranscriptJul 20 2017, 7:51 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
debt moved this task from needs triage to Up Next on the Discovery-Search board.Jul 27 2017, 5:14 PM
gerritbot added a subscriber: gerritbot.Jul 28 2017, 7:00 PM

Change 368471 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[mediawiki/extensions/WikimediaEvents@master] Turn on search LTR test

https://gerrit.wikimedia.org/r/368471

gerritbot added a project: Patch-For-Review.Jul 28 2017, 7:00 PM
gerritbot added a comment.Aug 2 2017, 4:57 AM

Change 369594 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[operations/mediawiki-config@master] CirrusSearch configuration for LTR AB test

https://gerrit.wikimedia.org/r/369594

debt edited projects, added Discovery-Search (Current work); removed Discovery-Search.Aug 3 2017, 9:41 PM
debt moved this task from Incoming to Needs Reporting on the Discovery-Search (Current work) board.
gerritbot added a comment.Aug 3 2017, 10:58 PM

Change 368471 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@master] Turn on search LTR test

https://gerrit.wikimedia.org/r/368471

gerritbot added a comment.Aug 3 2017, 10:59 PM

Change 370112 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[mediawiki/extensions/WikimediaEvents@wmf/1.30.0-wmf.12] Turn on search LTR test

https://gerrit.wikimedia.org/r/370112

ReleaseTaggerBot added a project: MW-1.30-release-notes (WMF-deploy-2017-08-08_(1.30.0-wmf.13)).Aug 3 2017, 11:00 PM
gerritbot added a comment.Aug 3 2017, 11:03 PM

Change 369594 merged by jenkins-bot:
[operations/mediawiki-config@master] CirrusSearch configuration for LTR AB test

https://gerrit.wikimedia.org/r/369594

gerritbot added a comment.Aug 3 2017, 11:15 PM

Change 370112 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@wmf/1.30.0-wmf.12] Turn on search LTR test

https://gerrit.wikimedia.org/r/370112

Stashbot added a subscriber: Stashbot.Aug 3 2017, 11:43 PM

Mentioned in SAL (#wikimedia-operations) [2017-08-03T23:43:51Z] <ebernhardson@tin> Synchronized php-1.30.0-wmf.12/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: T171212: Turn on CirrusSearch MLR AB test (duration: 00m 46s)

ReleaseTaggerBot edited projects, added MW-1.30-release-notes (WMF-deploy-2017-08-01_(1.30.0-wmf.12)); removed MW-1.30-release-notes (WMF-deploy-2017-08-08_(1.30.0-wmf.13)).Aug 4 2017, 12:00 AM
gerritbot added a comment.Aug 4 2017, 12:23 AM

Change 370124 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@master] Disable CirrusSearch AB test

https://gerrit.wikimedia.org/r/370124

gerritbot added a comment.Aug 4 2017, 12:30 AM

Change 370126 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[mediawiki/extensions/WikimediaEvents@wmf/1.30.0-wmf.12] Disable CirrusSearch AB test

https://gerrit.wikimedia.org/r/370126

gerritbot added a comment.Aug 4 2017, 12:35 AM

Change 370127 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[operations/mediawiki-config@master] Update CirrusSearch AB test rescore profiles

https://gerrit.wikimedia.org/r/370127

gerritbot added a comment.Aug 4 2017, 12:37 AM

Change 370126 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@wmf/1.30.0-wmf.12] Disable CirrusSearch AB test

https://gerrit.wikimedia.org/r/370126

gerritbot added a comment.Aug 4 2017, 12:38 AM

Change 370128 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[mediawiki/extensions/WikimediaEvents@master] Turn on CirrusSearch MLR AB test

https://gerrit.wikimedia.org/r/370128

ReleaseTaggerBot edited projects, added MW-1.30-release-notes (WMF-deploy-2017-08-08_(1.30.0-wmf.13)); removed MW-1.30-release-notes (WMF-deploy-2017-08-01_(1.30.0-wmf.12)).Aug 4 2017, 1:01 AM
EBernhardson moved this task from Needs Reporting to Needs review on the Discovery-Search (Current work) board.Aug 4 2017, 2:49 AM
EBernhardson added a subscriber: EBernhardson.

Added a pull request to the plugin to potentially resolve this problem as well: https://github.com/o19s/elasticsearch-learning-to-rank/pull/66

gerritbot added a comment.Aug 7 2017, 6:49 PM

Change 370127 merged by jenkins-bot:
[operations/mediawiki-config@master] Update CirrusSearch AB test rescore profiles

https://gerrit.wikimedia.org/r/370127

gerritbot added a comment.Aug 7 2017, 6:53 PM

Change 370128 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@master] Turn on CirrusSearch MLR AB test

https://gerrit.wikimedia.org/r/370128

Stashbot added a comment.Aug 7 2017, 6:53 PM

Mentioned in SAL (#wikimedia-operations) [2017-08-07T18:53:56Z] <ebernhardson@tin> Synchronized wmf-config/CirrusSearch-production.php: T171212 - Update CirrusSearch AB test rescore profiles (duration: 00m 46s)

gerritbot added a comment.Aug 7 2017, 6:54 PM

Change 370516 had a related patch set uploaded (by EBernhardson; owner: EBernhardson):
[mediawiki/extensions/WikimediaEvents@wmf/1.30.0-wmf.12] Turn on CirrusSearch MLR AB test

https://gerrit.wikimedia.org/r/370516

gerritbot added a comment.Aug 7 2017, 6:56 PM

Change 370516 merged by jenkins-bot:
[mediawiki/extensions/WikimediaEvents@wmf/1.30.0-wmf.12] Turn on CirrusSearch MLR AB test

https://gerrit.wikimedia.org/r/370516

ReleaseTaggerBot edited projects, added MW-1.30-release-notes (WMF-deploy-2017-08-01_(1.30.0-wmf.12)); removed MW-1.30-release-notes (WMF-deploy-2017-08-08_(1.30.0-wmf.13)).Aug 7 2017, 7:00 PM
Stashbot added a comment.Aug 7 2017, 7:05 PM

Mentioned in SAL (#wikimedia-operations) [2017-08-07T19:05:58Z] <ebernhardson@tin> Synchronized php-1.30.0-wmf.12/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: T171212 - Turn on CirrusSearch MLR AB test (duration: 00m 46s)

EBernhardson moved this task from Needs review to Needs Reporting on the Discovery-Search (Current work) board.Aug 7 2017, 10:58 PM
debt closed this task as Resolved.Aug 14 2017, 6:46 PM
debt claimed this task.

This test was turned on Aug 7th, 2017

EBjune added a parent task: T174066: [Q1 2017-18 Objective] Perform load and A/B tests on new models (interleaved search results).Aug 31 2017, 4:46 PM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL