Page MenuHomePhabricator

Emailability: basic measurement
Open, MediumPublic

Description

We have decided that we will not be implementing controlled A/B tests to measure the changes we will be making for this emailability initiative. That's because of the effort required around running experiments, because we intend to make the sort of changes that we don't expect to have negative impacts, and because increasing emailability is not a core goal of our team.

Instead, we want to do some basic longitudinal tracking. We want to know:

  • Number of accounts created, by day, during the weeks surrounding the change.
  • Percent of users adding emails on Special:CreateAccount during the few weeks leading up to the change.
  • Percent of users adding emails on Special:CreateAccount during the few weeks after the change.
  • Percent of users verifying their emails during the few weeks leading up to the change.
  • Percent of users verifying their emails during the few weeks after to the change.

All of this should be split by platform (desktop/mobile) and wiki (Czech/Korean/Vietnamese).

We may also want to remove (or otherwise account for) users who add email addresses via the welcome survey or help panel features.

Event Timeline

JTannerWMF moved this task from Inbox to Q1 2019-20 on the Growth-Team board.Mar 6 2019, 7:28 PM
JTannerWMF moved this task from Q1 2019-20 to Q2 2019-20 on the Growth-Team board.

Our team has decided that we will not be working on this project during Q4. Moving it to the next fiscal year.

nettrom_WMF triaged this task as Medium priority.Apr 3 2019, 5:10 PM
nettrom_WMF moved this task from Triage to Backlog on the Product-Analytics board.