Page MenuHomePhabricator

Document best practices for A/B testing
Closed, DeclinedPublic

Description

  • Email research-interested groups with strawman proposal
  • Consolidate discussion into a set of recommended best practices on Meta
  • Announce the location to WMF product and research-interested groups

Related Objects

StatusSubtypeAssignedTask
DeclinedNone
Declinedmpopov

Event Timeline

Halfak raised the priority of this task from to Needs Triage.
Halfak updated the task description. (Show Details)
Halfak added a project: Research.
Halfak moved this task to Backlog on the Research board.
Halfak subscribed.
Halfak set Security to None.
Halfak added a subscriber: ksmith.

You might draw inspiration (or blatantly copy from) https://meta.wikimedia.org/wiki/Discovery/Testing and whatever you end up with should feed back into that. Pinging @mpopov so he's aware.

Halfak subscribed.

@Halfak I'll move this to backlog. Please feel free to move it around as needed, or decline it if you see you won't be doing it. :)

Which specific team is supposed to look at this task?
Please associate at least one active project with this task (via the Add Action...Change Project Tags dropdown). (Documentation is a too broad meta tag here.) This will allow others to get notified and see this task when looking at the corresponding project workboard. Thanks.

@leila, @Halfak: Which specific team is supposed to look at this task? Please add more context. Thanks!

Either we should decline this task or pass it on to Product-Analytics, I think. @kzimmerman, do you already have a documented set of practices for product experiments, evaluation, and documentation?

We currently have a landing page for this (https://wikitech.wikimedia.org/wiki/A/B_testing) and plan to flesh it out more. I believe we also have a task for this; I'll merge the two.

kzimmerman moved this task from Triage to Needs Investigation on the Product-Analytics board.

@mpopov is going to be gathering information and best practices for A/B testing; assigning to him to merge/associate with other tickets as needed.

kzimmerman triaged this task as Medium priority.Oct 28 2019, 8:51 PM