1. How often do users skip the form without filling any of it out?

We can capture the use of the skip button but there are other ways to skip: the user may close the page, click on a link in the left nav, enter facebook dot com in the address bar, etc. If we measure conversion with the submitted responses, everybody else in the target group can be assumed to have skipped after a reasonable time (24h?)

2. How often do users fill out some of the questions before dismissing/skipping the form? Which questions?

This one is tricky. I was assuming that we would not capture any of the data if the user decides to skip. Is it ok to capture that they have provided some data but not the data itself?

We can also add how long they've been on the form before submitting or skipping.

3. How often do users click on other links that are contained in the form?

Yes, this is captured by the PageViews instrumentation (understanding first day).

In T206379#4680019, @SBisson wrote:

1. How often do users skip the form without filling any of it out?

We can capture the use of the skip button but there are other ways to skip: the user may close the page, click on a link in the left nav, enter facebook dot com in the address bar, etc. If we measure conversion with the submitted responses, everybody else in the target group can be assumed to have skipped after a reasonable time (24h?)

I'm not so worried about users that enter in another URL to skip, but is it possible to also capture when users click on other links on the page that are *outside* of the form but still within the page, eg. the user searches for an article instead or clicks on "Random article" in the side nav? Knowing that would help determine how much the amount of Special page chrome deters completion (assuming we start off with the var A design in T206372)...

The PageViews schema will capture any navigation using the links on the standard chrome.

Running an experiment to figure out how much the chrome affects completion rate is interesting but I don't know if it's realistic this quarter.

Regarding question 1, applying a heuristic that defines that the user abandoned the form seems applicable, within a "reasonable time" as @SBisson suggests. Given that they're shown the form immediately after creation, I would consider applying the one hour rule for session abandonment here (e.g. an edit session is abandoned if more than one hour elapses before the next edit), there's plenty of precedent in the literature for that window.

I hadn't thought of capturing when users abandon the form by closing the tab or going to a different URL. @SBisson are you proposing a way to do that without an EventLogging schema?

In T206379#4687719, @MMiller_WMF wrote:

I hadn't thought of capturing when users abandon the form by closing the tab or going to a different URL. @SBisson are you proposing a way to do that without an EventLogging schema?

@nettrom_WMF and I are saying that after an hour, we can assume a user has abandoned.

When we look at those users and try to understand what happened, the PageViews data can tell us a lot. If the survey is the last page viewed by the user, they've probably closed the page or navigated to an external site explicitly. If there's other wikipedia pages after the survey, they've probably navigated away using some of the other page links.

@SBisson @kostajh @RHo -- in a conversation today, @DannyH pointed out that the same "Tutorial" and "Help desk" links are in two places in the survey. They're on the righthand side when taking the survey, and they're on the "Thank you" page. We also noticed that both pages are called "Special:WelcomeSurvey". Since our strategy for finding out whether people clicked those links is through the EditorJourney schema, do you think we'll be able to tell whether they clicked them from the survey page or from the "Thank you" page?

Oh good catch. @SBisson can each link when clicked from the thank you page have a parameter appended to indicate this? Something like ?source=thankspg

Change 473237 had a related patch set uploaded (by Sbisson; owner: Sbisson):
[mediawiki/extensions/GrowthExperiments@master] Add parameter to distinguish source of links

https://gerrit.wikimedia.org/r/473237

Change 473237 merged by jenkins-bot:
[mediawiki/extensions/GrowthExperiments@master] Add parameter to distinguish source of links

https://gerrit.wikimedia.org/r/473237

Change 473845 had a related patch set uploaded (by Sbisson; owner: Sbisson):
[mediawiki/extensions/GrowthExperiments@wmf/1.33.0-wmf.4] Add parameter to distinguish source of links

https://gerrit.wikimedia.org/r/473845

Change 473845 merged by jenkins-bot:
[mediawiki/extensions/GrowthExperiments@wmf/1.33.0-wmf.4] Add parameter to distinguish source of links

https://gerrit.wikimedia.org/r/473845