This ticket is a reminder to turn off the test the week of Feb 13, 2017 - as long as we've received sufficient data.
Description
Details
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • debt | T139310 [UI design] Search Results page: re-design page display of search results across languages | |||
| Resolved | • debt | T145917 [EPIC] Front end: cross-wiki search results display | |||
| Resolved | • debt | T146667 Display of cross-wiki search results: add in new results in right sidebar | |||
| Resolved | Jdrewniak | T149806 [A/B/C Test] Add cross-wiki search results in a right sidebar | |||
| Resolved | EBernhardson | T157942 turn off sistersearch A/B/C test on 2017-02-21 |
Event Timeline
Now updated to 21st February, as sampling rate was too low and it's being increased today. Running tests for a week to capture some degree of periodicity is good.
Reposting from this comment for clarity in updating the sampling (bucketing) rate and why the test is being extended:
After discussing in IRC decided to increase from 1:200 EL, 1:10 test (1:2000 overall to test) on two low volume wikis (catalan and persian) to 1:10 EL, 1:2 test, for 1:20 overall (100x more sessions). The remaining two medium volume wikis (italian and polish) increased to 1:50 EL, 1:2 test, for 1:100 overall (20x more sessions).
Change 339008 had a related patch set uploaded (by EBernhardson):
Turn off sister search AB test.
Change 339010 had a related patch set uploaded (by EBernhardson):
Turn off sister search AB test.
Change 339011 had a related patch set uploaded (by EBernhardson):
Turn off sister search AB test.
Mentioned in SAL (#wikimedia-operations) [2017-02-22T00:16:01Z] <thcipriani@tin> Synchronized php-1.29.0-wmf.13/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: SWAT: [[gerrit:339011|Turn off sister search AB test.]] T157942 (duration: 00m 43s)
Mentioned in SAL (#wikimedia-operations) [2017-02-22T00:17:07Z] <thcipriani@tin> Synchronized php-1.29.0-wmf.12/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: SWAT: [[gerrit:339010|Turn off sister search AB test.]] T157942 (duration: 00m 39s)