Page MenuHomePhabricator

Verify that data from A/B test on suggester is coming through correctly (on or after 2015-09-17) redux
Closed, ResolvedPublic1 Estimated Story Points

Description

Now that the test has been restarted, we should verify that the data is coming in correctly and as expected.

Event Timeline

Deskana raised the priority of this task from to High.
Deskana updated the task description. (Show Details)
Deskana added a subscriber: Deskana.
Deskana renamed this task from Verify that data from A/B test on suggester is coming through correctly (on or after 2015-09-17) to Verify that data from A/B test on suggester is coming through correctly (on or after 2015-09-17) redux.Sep 16 2015, 8:12 PM
Deskana set Security to None.
mpopov edited a custom field.

Browsers seem ok https://github.com/wikimedia-research/CompletionSuggestionTest/blob/master/data_validation/browsers.png

Sampling within both wikis seems fine: https://github.com/wikimedia-research/CompletionSuggestionTest/blob/master/data_validation/wiki.png

I don't like that the group proportions within dewiki are just barely within 2 standard deviations of each other. They should be a lot closer to 50/50 than 55/45.

Deskana moved this task from Needs triage to Analysis on the Discovery board.