Page MenuHomePhabricator

Analyze results of A/B test on suggester (on or after 2015-09-22)
Closed, ResolvedPublic4 Estimated Story Points

Assigned To
Authored By
Deskana
Sep 8 2015, 8:22 PM
Referenced Files
F2757462: Completion Suggester Analysis Report.html
Oct 22 2015, 4:57 PM
Unknown Object (File)
Oct 22 2015, 4:52 PM
Unknown Object (File)
Oct 22 2015, 12:16 AM

Event Timeline

Deskana raised the priority of this task from to High.
Deskana updated the task description. (Show Details)
Deskana subscribed.
mpopov renamed this task from Analyse results of A/B test on suggester (on or after 2015-09-15) to Analyse results of A/B test on suggester (on or after 2015-09-22).Sep 17 2015, 1:08 AM
mpopov renamed this task from Analyse results of A/B test on suggester (on or after 2015-09-22) to Analyze results of A/B test on suggester (on or after 2015-09-22).
mpopov edited a custom field.
Deskana lowered the priority of this task from High to Medium.Sep 22 2015, 8:19 PM

Working on T115274 because that will greatly improve the quality of the analysis in this task and the analysis of the results of the test we're launching soon.

Pre-final draft: {F2752600}

Awaiting review from @Ironholds

  • in the opening para, some kinds of pages, not kind
  • R is software? ;p

    I'm not comfortable saying it's our recommendation we switch to the new method. We can see that users have a greater outcome of getting results. This does not equate to a better outcome. The new approach may increase the number of results, for example, while also decreasing the quality of those results. I'd like us to look at least at clickthrough rates as a basic satisfaction heuristic before we recommend anything.

Final draft: