Page MenuHomePhabricator

Code A/B test for AND operator relaxation test
Closed, ResolvedPublic

Description

Write A/B test for AND operator relaxation test described in T114773.

The primary idea here is to integrate with the existing TestSearchSatisfaction schema. Split the users into two buckets with half as control, and half participating in the test. There is a special query parameter which enables the common terms query, this should be set for all search queries (top-right search bar when enter is pressed, along with Special:Search) that are participating the test and not in the control bucket.

The schema needs to additionally record which bucket (control or test) the user is in.

Event Timeline

Deskana created this task.Oct 8 2015, 4:42 PM
Deskana raised the priority of this task from to Normal.
Deskana updated the task description. (Show Details)
Deskana added subscribers: mpopov, Deskana, Aklapper.
EBernhardson updated the task description. (Show Details)Oct 8 2015, 4:45 PM
EBernhardson set Security to None.
EBernhardson moved this task from Needs triage to Search on the Discovery board.Oct 8 2015, 4:56 PM
ksmith moved this task from Search to On Sprint Board on the Discovery board.Oct 8 2015, 5:00 PM

Change 245627 had a related patch set uploaded (by EBernhardson):
Add common terms A/B test to search satisfaction

https://gerrit.wikimedia.org/r/245627

Change 245627 merged by jenkins-bot:
Add common terms A/B test to search satisfaction

https://gerrit.wikimedia.org/r/245627

Change 246122 had a related patch set uploaded (by EBernhardson):
Add common terms A/B test to search satisfaction

https://gerrit.wikimedia.org/r/246122

Change 246123 had a related patch set uploaded (by EBernhardson):
Add common terms A/B test to search satisfaction

https://gerrit.wikimedia.org/r/246123

Change 246122 merged by jenkins-bot:
Add common terms A/B test to search satisfaction

https://gerrit.wikimedia.org/r/246122

Change 246123 merged by EBernhardson:
Add common terms A/B test to search satisfaction

https://gerrit.wikimedia.org/r/246123

Deskana closed this task as Resolved.Oct 20 2015, 2:45 PM
Deskana moved this task from Done to Resolved on the Discovery-Search (Current work) board.