Page MenuHomePhabricator

Readers foundational research: quantitative surveys
Open, Needs TriagePublic

Description

As detailed in the Readers Research Brief, readers foundational research will incorporate multiple stages of survey research. Unless otherwise specified, @YLiou_WMF to take primary responsibility for survey drafting, administration, and analysis, with support from @MRaishWMF. This includes the following survey research components:

  • Stage 1: Quicksurvey-to-Qualtrics (or Limesurvey)-hosted survey of ~200 enwiki readers using open-ended text questions to better understand reader use cases on Wikipedia
  • Stage 2: A large-sample QS-administered survey of enwiki readers using closed-ended questions on reader use cases defined through Stage 1 Research (this stage may include demographic questions, if feasible)
  • Stage 3: A large-sample QS-to-Limesurvey survey of enwiki readers (possibly recruited through an opt-in item in Stage 2) to better understand Wikipedia readers' use cases for Wikipedia and other digital platforms used for learning and accessing knowledge, attitudes towards Wikipedia and these other platforms (eg, different dimensions of trust), pain points associated with use cases, uses for and attitudes towards AI tools both on Wikipedia and other platforms, and demographic attributes.
  • Stage 4: (Simultaneous with Stage 3) A large-sample survey of respondents sourced from Prolific to be representative of internet users (either English language or US) and identical to the Stage 3 survey.

This research may also include large-scale survey research of non-readers and/or infrequent Wikipedia readers sampled off-platform using a third-party data provider.

Event Timeline

Weekly update:

  • Survey draft work on closed-ended QS survey is underway: tentatively planned to include three use case classification questions and three demographic questions (age, education, gender)
  • Survey timeline for closed-ended QS survey tentatively established (hope to complete data collection prior to planned introduction of temp accounts on enwiki in early October)

Weekly update:

  • Internal (QS) short survey fielded Oct 2. Have been able to verify that we are recording answers in the QS response table. We anticipate undeploying on Oct 6.

Weekly update:

  • Phase II Survey was undeployed October 6- response rates *far exceeded expectation* and we recorded ~190,000 unique survey sessions with at least one response (while we had more than enough responses on October 3, we could not undeploy until October 6.
  • Analysis (both survey and web request) is underway.
  • Phase III survey script is being drafted