This ticket is to capture the work needed to be done to analyze the results of the A/B test for the descriptive text for the sister project links.
Please see the epic ticket for further information: https://phabricator.wikimedia.org/T131238
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | debt | T133732 Release to production (Egg): adding descriptive text to sister project links | |||
| Resolved | debt | T131238 [EPIC] Wikipedia.org A/B Test (Egg): add descriptive text to sister project links | |||
| Resolved | mpopov | T132716 A/B Test (Egg): Analyze the results of the addition of descriptive text to sister project links |
Event Timeline
Comment Actions
Moving into the Discovery-Analysis (Current work) for @mpopov to start as he has time.
We ran the test from May 3 - 10, 2016, which should have gathered enough data for analysis, even though the average daily clickthrough rate for these links is quite small.
Comment Actions
First (final?) draft of the report: https://github.com/wikimedia-research/Discovery-Portal-Test-SisterProjects/blob/master/report.pdf
Once OK'd, will upload to Commons.
Comment Actions
I'm a bit confused on the math - we average around 13M a day in pageviews to the portal ...does the 22.4K visits during that week just the bucketed amount of visits?
Comment Actions
@debt Yup. Just those that 1. got into event logging, 2. had english as a preferred lang, and 3. had 2 in 5 chance of getting into the A/B test