Page MenuHomePhabricator

Welcome survey: turn off for Vietnamese Wikipedia
Closed, ResolvedPublic

Description

@SBisson @Catrope @kostajh -- after @nettrom_WMF's analysis from T206380#5045440, we see that the group receiving Variation A in Vietnamese Wikipedia has a higher abandonment rate than those in the control group. This is only occurring in desktop. Mobile shows no differences.

Though we don't know exactly why this is happening, we want to turn off the survey in Vietnamese in case it is turning away good new editors. We will continue to investigate and potentially turn the survey back on later.

Event Timeline

Change 498166 had a related patch set uploaded (by Sbisson; owner: Sbisson):
[operations/mediawiki-config@master] Disable Welcome survey on viwiki

https://gerrit.wikimedia.org/r/498166

@Trizek-WMF -- we decided to turn off the Vietnamese survey because our experiment found that the treatment group has a higher abandonment rate than the control group (just on desktop). This still may be due to bots or something, but now that we know the survey is associated with abandonment rate, we want to be safe and turn it off for now while we investigate. Could you please inform the community about this change?

MMiller_WMF updated the task description. (Show Details)Mar 21 2019, 5:56 PM

Change 498166 merged by jenkins-bot:
[operations/mediawiki-config@master] Disable Welcome survey on viwiki

https://gerrit.wikimedia.org/r/498166

@Trizek-WMF : I just posted T206380#5045440 with the results of the analysis, in case you'd like to refer to that.

The survey is now disabled on viwiki

nettrom_WMF updated the task description. (Show Details)Mar 22 2019, 4:10 PM
Etonkovidova closed this task as Resolved.Mar 22 2019, 4:15 PM