Page MenuHomePhabricator

Personalized first day: determine the survey's effect on editor activation rate
Closed, ResolvedPublic

Description

Our experiment plan for the welcome survey states that we start out with a one-month A/B test . That month is now completed, so I need to run some statistical tests to determine the survey's effect on editor activation rate.

The results of that will then be used to decide what kind of experiments we run with Variant C, per T210868.

Event Timeline

nettrom_WMF triaged this task as High priority.
nettrom_WMF created this task.
nettrom_WMF moved this task from Triage to Next Up on the Product-Analytics board.

This analysis has been done, and a short writeup of the results is now available. Our conclusion is that we do not see a significant difference in activation rate between users who get the survey, and users in the control group.

Thanks, @nettrom_WMF. I think this is exactly what we needed. I added some section headings and an infobox to the page. I'll start linking it to our other materials.