Page MenuHomePhabricator

Document best practices for A/B testing
Open, Needs TriagePublic

Description

  • Email research-interested groups with strawman proposal
  • Consolidate discussion into a set of recommended best practices on Meta
  • Announce the location to WMF product and research-interested groups

Event Timeline

Halfak created this task.Jan 18 2016, 7:23 PM
Halfak raised the priority of this task from to Needs Triage.
Halfak updated the task description. (Show Details)
Halfak added a project: Research.
Halfak moved this task to Staged on the Research board.
Halfak added a subscriber: Halfak.
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptJan 18 2016, 7:23 PM
Halfak updated the task description. (Show Details)Jan 18 2016, 7:25 PM
Halfak set Security to None.
Halfak added a subscriber: ksmith.
DarTar assigned this task to Halfak.Jan 28 2016, 11:56 PM
DarTar added a project: Research-consulting.
DarTar removed a subscriber: Halfak.

You might draw inspiration (or blatantly copy from) https://meta.wikimedia.org/wiki/Discovery/Testing and whatever you end up with should feed back into that. Pinging @mpopov so he's aware.

Halfak edited projects, added Research; removed Research-Backlog.Jun 30 2016, 10:11 PM
Halfak removed Halfak as the assignee of this task.Jul 13 2017, 2:16 PM
Halfak added a subscriber: Halfak.
leila added a subscriber: leila.Aug 31 2017, 5:43 PM

@Halfak I'll move this to backlog. Please feel free to move it around as needed, or decline it if you see you won't be doing it. :)

leila edited projects, added Research-Backlog; removed Research.Aug 31 2017, 5:43 PM

Which specific team is supposed to look at this task?
Please associate at least one active project with this task (via the Add Action...Change Project Tags dropdown). (Documentation is a too broad meta tag here.) This will allow others to get notified and see this task when looking at the corresponding project workboard. Thanks.

@leila, @Halfak: Which specific team is supposed to look at this task? Please add more context. Thanks!

Either we should decline this task or pass it on to Product-Analytics, I think. @kzimmerman, do you already have a documented set of practices for product experiments, evaluation, and documentation?

We currently have a landing page for this (https://wikitech.wikimedia.org/wiki/A/B_testing) and plan to flesh it out more. I believe we also have a task for this; I'll merge the two.