Page MenuHomePhabricator

Analyze welcome survey experiment in Basque Wikipedia
Closed, DeclinedPublic

Description

The welcome survey will be deployed to Basque Wikipedia with an experiment in which half of users receive Variation A and half receive no survey. After gathering about a month of data, we will analyze the differences in abandonment rate and differences in activation rate between the treatment and control groups.

This analysis should cover the same metrics as were pursued for other target wikis in T206380.

Event Timeline

The welcome survey will be deployed to Basque Wikipedia with an experiment in which half of users receive Variation A and half receive no survey. After gathering about a month of data, we will analyze the differences in abandonment rate and differences in activation rate between the treatment and control groups.

@MMiller_WMF In T233063 we decided this won't be an A/B test, should we keep this task around?

MMiller_WMF closed this task as Declined.Sep 25 2019, 3:13 PM

Good point, @kostajh. While I was thinking we could also take a look by checking out the time series, I think the registrations come in too slowly for that method to tell us much. We'll need to rely on qualitative assessments on the ground to know whether the survey is causing any issues. I'll decline this task.