Page MenuHomePhabricator

Perform A/B test for search location change
Closed, DuplicatePublic

Description

Description

We would like to do two A/B test on the changes planned to the search widget as a part of the desktop improvements project:

  • Moving the search bar to the header of the page (target 2.5% overall increase in search sessions initiated, monitor and report on search sessions completed)
  • Switching the current search widget to the new search widget (target 2.5% overall increase in search sessions initiated, monitor and report on search sessions completed)
  • Individual test will be performed per wiki for logged-in user only (nice to have: all users)

Additional background in T256100, T249366, T251740, and T257698.

This tasks covers the a/b test for changing the location of the search widget

Acceptance criteria

  • Enable A/B test to all test wikis
  • Run test for 2 weeks
  • Disable A/B test

Related Objects

StatusSubtypeAssignedTask
OpenNone
Openovasileva
OpenNone
DeclinedNone
Openjlinehan
Openjlinehan
ResolvedNone
Resolvedjlinehan
Resolvedjlinehan
ResolvedOttomata
ResolvedOttomata
ResolvedSpikeJdlrobson
Resolvedjlinehan
Openjlinehan
Resolvedjlinehan
Resolvedjlinehan
Resolvedjlinehan
Resolvedjlinehan
ResolvedJdlrobson
Resolvedjlinehan
Openjlinehan
Openjlinehan
OpenNone
OpenNone
OpenNone
Openjlinehan
OpenNone
OpenNone
Openovasileva
OpenNone
Resolvedovasileva
OpenMNeisler
ResolvedJdlrobson
Duplicateovasileva
ResolvedMNeisler

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 31 2020, 2:45 PM
Jdlrobson added a subscriber: Jdlrobson.

Analysis is blocked on T259250 but this looks relatively easy to estimate once that's complete. I'll move this to "upcoming" when the subtasks are completed.

Jdlrobson reassigned this task from Jdlrobson to ovasileva.Sep 14 2020, 5:12 PM

Blocked on QA for new fields and A/B test and roll out to office wiki T262207. Earliest date we can deploy is 14th September. Assigning to Olga to decide when this can become unblocked