@SBisson @kostajh @Catrope -- I am able to reproduce this issue. I'm tagging you in case the problem and solution are immediately obvious to you. We can discuss this in an upcoming team meeting.

I think that decision belongs to @nettrom_WMF. Let us know!

@SBisson -- I think that having those two separate checkboxes could be okay. If we do it like that, I think I would want the language for the two to be:

Assigned to @nettrom_WMF because the first step is proposing an outline for these reports.

Now that the help panel has been deployed for five weeks, we should have enough data to run the analysis for the activation experiment. Discussed with @nettrom_WMF today that this is a current priority.

Assigning to @nettrom_WMF to begin the first thing in the checklist: drafting the initial measurement plan.

@nettrom_WMF -- EditorJourney was deployed in Vietnamese on Jan 16 and the welcome survey was deployed on Jan 24. Could we use the period in between to get a sense of the abandonment rate of users who don't get a survey (even though it's not a real A/B test because of the temporal change?)

Assigning to @Trizek-WMF because the next step is to discuss this issue with the Vietnamese community to see if they have any insight.

I sent notes back to @nettrom_WMF on 2019-02-19, and the next step is to tighten up the notebook, and discuss with the Growth team during social time during the week of 2019-02-25.

@nettrom_WMF sent me a first draft of the leading indicators in a Jupyter notebook on 2019-02-19.

@Trizek-WMF -- where did you list the five help links supplied by the community? I don't see it on this task -- maybe it is listed somewhere else?

Thanks, @Catrope. It's been so long since I created my English Wikipedia and Mediawiki.org accounts that I forgot that those confirmation emails are different. Since the technology exists for customizing the content, and since those two wikis don't include any mention of IP addresses, I think that makes it seem like we wouldn't be missing anything major by doing the work in this task.

Thanks, @Izno. Enough time has passed since my comment that our team agrees -- there's no reason not to ask for email in multiple places (unless it gets to the point where it is annoying to the user). It turns out, though, in our welcome survey that few users actually add their emails.

@kostajh @Catrope @SBisson -- following our deep dive conversation today, I added bullet points that hammer out specifics in terms of what is different and what is the same between the help panel and help module. Please go over these and post here if there are any other outstanding considerations.

@SBisson -- how do you recommend we do the preferences and treatment/control situation?

I updated this task to incorporate our decisions from our deep dive meeting today. I believe this addresses the discussion that @Trizek-WMF and @kostajh were having about the creation of user pages.

This is ready to be picked up.

@Etonkovidova -- thanks for the questions.

We decided to try to find a real fix this morning, and decide during standup what to do for the 11 AM SWAT window.

Thanks, @nettrom_WMF. So it sounds like you are okay with not capturing the page_id and page_title for the Help and Wikipedia namespaces in reading mode. We'll talk this week about updating our experiment plans.

The aforementioned work will happen in T216081. Resolving this specific task because the work is done.

Thanks, @Urbanecm. @JTannerWMF is going to work on summarizing the results.

I am going to keep this task in my column until we decide whether we want to use Variation A or Variation C as the default survey in more wikis. If Variation C, then we will need to consider the issues brought up in this task. We should be making a decision on that within weeks.

Since we gathered some information and we have decided not to take any action at the moment, I'm going to resolve this. Thank you, @EBernhardson.

@Trizek-WMF -- I think the simple answer is that we want to deploy as soon as the Vietnamese translations are ready and the community is ready. But I understand it will help to have a target date (that we could change). How about Feb 26, two weeks from today?

@kostajh -- I think it would be fine to redact instead of obfuscate. I don't imagine that we will care to know whether a newcomer is repeatedly opening the help panel on the same page. We would also be letting go of knowing on which help pages the newcomers open the help panel -- but we can use EditorJourney to know that for the first 24 hours. @nettrom_WMF, what do you think?

Note: I'm wondering whether we can consider a more prominent design for this notification, perhaps something that appears next to the email field once one is entered, as opposed to gray text underneath it.

Declining this task because we've decided it's not urgent.