@SBisson @Catrope @kostajh -- after @nettrom_WMF's analysis from T206380#5045440, we see that the group receiving Variation A in Vietnamese Wikipedia has a higher abandonment rate than those in the control group. This is only occurring in desktop. Mobile shows no differences.
Though we don't know exactly why this is happening, we want to turn off the survey in Vietnamese in case it is turning away good new editors. We will continue to investigate and potentially turn the survey back on later.
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| Disable Welcome survey on viwiki | operations/mediawiki-config | master | +0 -2 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | MMiller_WMF | T206365 [EPIC] Growth: Welcome survey | |||
| Resolved | MMiller_WMF | T213356 Personalized first day: activate for Vietnamese Wikipedia | |||
| Resolved | SBisson | T218920 Welcome survey: turn off for Vietnamese Wikipedia |
Change 498166 had a related patch set uploaded (by Sbisson; owner: Sbisson):
[operations/mediawiki-config@master] Disable Welcome survey on viwiki
@Trizek-WMF -- we decided to turn off the Vietnamese survey because our experiment found that the treatment group has a higher abandonment rate than the control group (just on desktop). This still may be due to bots or something, but now that we know the survey is associated with abandonment rate, we want to be safe and turn it off for now while we investigate. Could you please inform the community about this change?
Change 498166 merged by jenkins-bot:
[operations/mediawiki-config@master] Disable Welcome survey on viwiki
@Trizek-WMF : I just posted T206380#5045440 with the results of the analysis, in case you'd like to refer to that.
We are considering to turn the welcome survey on again, see T325376: Welcome survey: communication and deployment to Vietnamese Wikipedia.