Page MenuHomePhabricator

Welcome survey: turn off for Vietnamese Wikipedia
Closed, ResolvedPublic


@SBisson @Catrope @kostajh -- after @nettrom_WMF's analysis from T206380#5045440, we see that the group receiving Variation A in Vietnamese Wikipedia has a higher abandonment rate than those in the control group. This is only occurring in desktop. Mobile shows no differences.

Though we don't know exactly why this is happening, we want to turn off the survey in Vietnamese in case it is turning away good new editors. We will continue to investigate and potentially turn the survey back on later.

Event Timeline

Change 498166 had a related patch set uploaded (by Sbisson; owner: Sbisson):
[operations/mediawiki-config@master] Disable Welcome survey on viwiki

@Trizek-WMF -- we decided to turn off the Vietnamese survey because our experiment found that the treatment group has a higher abandonment rate than the control group (just on desktop). This still may be due to bots or something, but now that we know the survey is associated with abandonment rate, we want to be safe and turn it off for now while we investigate. Could you please inform the community about this change?

Change 498166 merged by jenkins-bot:
[operations/mediawiki-config@master] Disable Welcome survey on viwiki

@Trizek-WMF : I just posted T206380#5045440 with the results of the analysis, in case you'd like to refer to that.