So it seems like this is the kind of survey you want to run:

Please help make Wikipedia better by letting us know your motivations so we can better serve your needs. What is the purpose for your visit to Wikipedia today?

• This would have multiple choice answers and suggests we need to change our approach so that we can support answers other than yes/no/maybe.
• Your question also suggests that we might want to give examples (to avoid having large unclear buttons (for example we might want to show a question mark that when clicked says e.g. what is strepthroat?)
• You mention 'other' might be an answer - are you expecting a user to enter their own text for that? (this also hasn't been thought about)

Hey @JKatzWMF, sounds like a reasonable starting goal. Your goal sounds like "To learn whether user's motivations differ based on platform, country, and project when accessing Wikimedia Projects". Is this correct?

Other goal ideas:

• To learn satisfaction level across platforms with reading experience (but not content); which can be used as a baseline for future software changes
• To learn how users accessed Wikipedia/Wikimedia article (e.g. google, yahoo, etc.)

Other considerations:

• Will this just be for English Wikipedia?
• Having yes/no questions might be helpful later on. First you need to determine the right response option list using focus groups and survey testing.
• We have a ton of readers; you can use A/B testing to figure out what question structures bring in the most responses (e.g. Should we include "Please help Wikipedia by answering this question" or should we just ask the question?), and you can use testing and focus groups to help you determine the right response options.
• The examples (e.g. what is strep throat) should be provided to all respondents. The goal of providing examples is to help clarify definitions and everyone should be exposed to this equally or answers will be skewed. Typically best to avoid definitions or "e.g." altogether.
• If you want to run the same survey again in the future, be sure to gather a large enough sample to have statistical power to test changes from one survey to the next.

Let me know if you need help/guidance with question review. My role is to support survey design for other teams so I'm happy to help.

@Jdlrobson
yes, multiple choice is probably the best way to do this. another, fuzzier, way would be to ask each question separately to 1/6 of the population. So 1/6 get's "are you here to learn a definition", and another 1/6th gets "are you here to learn a specific fact"...based on the relative number of yes/no, we could potentially glean relative proportions. my guess, however, is that this would not be valid as showing the various answers at one time adds much-needed context.

for "other" we could leave it as "other" without free form text for now. If we get a large % of "other" we can go about exploring how to get details.

@egalvezwmf thanks for offering to help! To answer your specific questions, eventually this would include other projects, but it is not a blocker.

We should talk about the best approach. Asking questions such as "Are you here to look something up quickly?" Yes/No can easily be done with current architecture. Multiple choice would probably require more work, so I would prefer we run campaigns in the a manner more similar to the former! :)

@Jdlrobson because something is easier to do does not mean the data will be accurate or useful. I would consult with researchers about making sure the results you get with yes/no questions are useful. On the flip side, the question part itself needs to be well designed. As an example "quickly" could mean any period of time depending on the user.

Is anyone working on documentation for best practices in the design process for one-question surveys? Would be good to start building documentation so if people are interested in running this kind of survey, they can see what is the scope of work involved.

@Jdlrobson - as we get closer to actually putting this out, we should sit down with @egalvezwmf so he can document the process for other teams.

Should we block on dismissing the survey as in T113644? cc/@Moushira

@atgo, given that the user can scroll past (it's not an overlay) and the very low traffic, I don't see this as a blocker.