Page MenuHomePhabricator

Readers Survey 2024
Closed, ResolvedPublic

Description

edit (October 7, 2024): this project is likely to be rescoped to focus on a smaller number of Wikipedias (while remaining representative of global readership)

Following the completion of the 2023 Global Readers Demographic survey documented on T341890 and on here, on meta-wiki, this task tracks a follow-up survey project that builds on and expands on previous work.

This survey will be fielded across multiple language projects, representing at least 90% of current Wikipedia readership.

Consistent with the 2023 survey (T341890), this iteration will be fielded in late Q2 FY2024-2025.

Major milestones are listed below:

  • Survey instrument draft (English)
  • Sampling plan
  • Draft messaging (Quicksurveys opt-in, survey intro, research meta page, post-survey thank you page, etc.)
  • Privacy statement (submitted in English and translated)
  • Survey translation
  • Programmed
  • Tested
  • Quicksurvey deployment requested
  • Fielded
  • Analysis of global surveys posted to meta-wiki

Event Timeline

Update:

  • Initial desk research on survey revisions underway

Weekly Update:

  • no major updates this week

Weekly update:

  • no major updates this week

Weekly update:

  • scheduled meeting with Future Audiences and Audience Insights for July 31 to discuss next steps in 1) reconciling insights from the GRS and Brand Health surveys 2) alignment on future survey instruments

Weekly update:

  • Follow-up meeting with Maryana P and Nino tentatively scheduled for September 11 (after I return from vacation).

Weekly update

  • Met with newly-renamed Survey Alignment Working Group to discuss--among other things--new survey questions to be included in the 2024 GRS as well as alignment with Brand Health surveys on existing questions

Weekly update:

  • Expecting input next week from Audience Insights team based on Brand Health surveys to inform 2024 GRS update

Weekly update:

  • Due to capacity constraints from competing priorities, this project may change its scope (primarily through a reduction in the number of languages surveyed)
  • We have communicated this potential change to the Future Audiences team and have shared the market/language intersections for which we currently have (and do not have) translated lists of peer platforms. We're awaiting their input on which market/language intersections to prioritize.

Weekly update:

  • Final survey languages/markets still TBD, but Future Audiences has indicated that a fairly restrictive list will work for them
YLiou_WMF renamed this task from Global Readers Demographic Survey 2024 to Readers Survey 2024.Oct 7 2024, 3:27 PM
YLiou_WMF updated the task description. (Show Details)

Weekly update:

  • Met with survey research alignment group and provided the following update:
    • 2024 readers survey will be fielded in the following projects (alphabetical order): arwiki, dewiki, enwiki, eswiki, frwiki, hiwiki, idwiki, jawiki, kowiki, ptwiki, ruwiki, zhwiki (simplified and traditional chinese editions fielded together)
    • Survey content will be largely unchanged with exception of 1) additions of questions summarized in document here as previously agreed on with survey research alignment working group, generic Wikipedia experience satisfaction question, and possible Wikipedia awareness battery (building on one developed for Archetypes research) 2) dropping the identity section (minority ethnicity and marginalized identity items) and one of the geography questions.
    • Survey timing will be aligned with 2023 fielding schedule (late November, early December) and preliminary results will be made available in early Q3.
    • Survey administration will be unchanged from 2023 edition (Single question opt-in on QuickSurvey sampled by project leading to survey administered on Limesurvey)

Weekly update:

  • Established weekly standing meeting with @TAndic to coordinate on Readers Survey content and logistics, began drafting new survey items for 2024 iteration
  • Discussed logistics for survey translations with Bethany Gerdemann and tentatively planned to use Design Research translation vendors for this iteration.

Weekly update:

  • confirmation that Design Research translation vendors and budget can be used to support this work
  • drafting of updated survey is underway

Weekly update

  • developed logistical schedule for Readers survey with @TAndic reflecting each of our availability throughout the remainder of Q2.
  • developed draft survey script (here)

Update: Privacy statement complete (https://foundation.wikimedia.org/wiki/Legal:Global_Readers_Survey_Privacy_Statement) - it will be the same as last year and can be reused (evergreen) - NOTE: check in with privacy@ if there are any changes to the survey the following wave (ie. 2025 and beyond), specifically pointing out differences.

Miriam triaged this task as High priority.Nov 20 2024, 1:51 PM

Update:

  • Survey translations received and are being programmed and tested with assistance from @TAndic -Decision made to push forward deployment of enwiki survey to avoid overlap with English language fundraising campaign (beginning Dec 2): survey will now deploy at zero coverage (for testing) on Nov 25 and be updated to full (5%) coverage by Nov 26.
    • enwiki survey has been fully programmed and tested on limesurvey

Update:

  • enwiki survey launched on November 25 and closed on November 28 with 6318 completes

Update:

  • Translated/programmed surveys for arwiki, zhwiki-S, zhwiki-T, frwiki, dewiki, idwiki, jawiki, kowiki, ptwiki, ruwiki, eswiki have gone through QA and are ready for deployment on December 9
  • Received (preliminary) confirmation from movement comms that readers surveys are not subject to the major communications embargo

Update:

  • Remaining surveys fielded this week!
    • arwiki, idwiki, jawiki, kowiki, ptwiki, ruwiki, zhwiki-s, zhwiki-t went live on Tuesday December 10
    • dewiki, eswiki, frwiki went live on Thursday December 12: delay was necessitated by need to ensure that there was no conflict with / objection from fundraising
    • surveys appear on track to reach sample size targets by December 20 or earlier with possible exception of kowiki--however, we acknowledge that given recent events in South Korea, the results of this survey may generally be difficult to compare with other years.

Update:

  • All surveys have been undeployed
  • Response targets were reached on all surveys except for kowiki
  • Analysis will begin in Q3!

Update:

  • Data cleaning for analysis is underway
  • Preliminary analysis in support of Future Audiences' Research Insights update to be completed and shared by Jan 17

Update:

  • Following an alignment meeting with Maryana P, we have decided that Readers survey data in the Research Insights update should focus on analysis of GRS 2023 rather than current data due to the following considerations:
    1. shortened timeline (moved up to Jan 14)
    2. continuing need to socialize last year's findings and potential for confusion when "raw" data from 2024 is compared to weighted data from 2023.
  • Slides summarizing GRS 2023 data have been shared for the Research Insights update
  • Analysis of 2024 data continues