Page MenuHomePhabricator

[TRACKING] Adopt or build an A/B testing library
Closed, DeclinedPublic

Description

As a developer that routinely builds A/B tests
I want to adopt or build a library that reduces the cost of building an A/B test
So that I can focus on building A and B

Development's Requirements

  • The library must have a client- and server-side component for setting up and getting values in experimental condition
    • It would be beneficial to have the client- and server-side components expose the same API
TODO
  • Gather requirements from Research (@Halfak)
  • Explore A/B testing library landscape (#619)
  • Gather requirements from Development (@phuedx @matthewflaschen @robm17)
  • Evaluate existing A/B testing libraries against R&D's requirements
  • Adopt/design and build an API for running A/B tests
  • Evangelise!
  • Speak to other people about what we're planning on doing

Trello card: p4sx3qd4

  • column: Current Sprint To Do
  • labels: Research (blue)

Event Timeline

Here's the etherpad that I typed up for @phuedx. https://etherpad.wikimedia.org/p/AB_testing_requirements

I think we still need to iterate on that so that the meaning is clear.

Mass-declining tasks that only have the now defunct Growth-Team associated but no other projects, as announced in https://phabricator.wikimedia.org/T127072 - Feel free to reopen this task if it is still valid by associating an active project and resetting its status.