This task involves the work with implementing the bucketing logic for the A/B test of the suite of mobile DiscussionTools we will be running in T298062.
Bucketing requirements
- Everyone who is accessing a mobile talk page on any of the wikis listed in the Participating wikis, logged in and logged out, should have a 50% chance of being included/bucketed into the A/B test's control or test group
- Bucketing should be done on a per-Wikipedia basis. 50% of people within a given wiki should be placed within the control group; 50% should be bucketed in the test group
- People should remain in the same group for the duration of the test (even if they explicitly turn on or off discussion tool preferences). NOTE: Need to confirm if changes in desktop preferences impact mobile web preferences.
Instrumentation-Related Requirements
- Within the A/B test, we are able to distinguish all events logged for the control group and the test group.
- We are able to track if/when someone in the test group adjusts any of the discussion tool-related preferences.
NOTE: the bucketing requires above assumes that no one at the Participating wikis will have had access to any and all mobile discussion tools prior to this A/B test beginning.
Participating wikis
| Wiki | Project |
|---|---|
| 1. | az.wiki |
| 2. | de.wiki |
| 3. | es.wiki |
| 4. | fa.wiki |
| 5. | hi.wiki |
| 6. | id.wiki |
| 7. | it.wiki |
| 8. | nl.wiki |
| 9. | pl.wiki |
| 10. | pt.wiki |
| 11. | ro.wiki |
| 12. | ru.wiki |
| 13. | th.wiki |
| 14. | tr.wiki |
| 15. | uk.wiki |
See T314950 for how the list above came to be.
Minimal test case
@DLynch to populate on bucketing requirements are implemented
Done
- A patch has been deployed that meets what's described in the ===Bucketing requirements section above
-
Editing QA has verified people are being bucketed on the client side on the beta cluster- QA will happen in T321961.
-
Once A/B test is started in T321961, @MNeisler will verify that bucketing is being logged as expected server-side- QA will happen in T321961.