Page MenuHomePhabricator

Welcome survey data: access to response data
Open, LowPublic

Description

User story & summary:

Primary user story
As a Product Manager on the Growth team, I want access to aggregated Welcome Survey data so that I can understand new account holder interests, motivations, and trends over time and use those insights to inform product decisions.

Related user story
As a Researcher studying newcomer experiences, I want the ability to identify and contact new account holders who opt in to research so that we can recruit participants for ongoing interviews and evaluate their experiences over time.

Background & research:

Per T296661#10482592 the Welcome Survey data pipeline appears to be broken:

I noticed that the data stops in September 2024, so it seems like something has broken with the existing script.
I know how time-consuming these Airflow migrations are, but it would be a shame to see much more of the data get lost!

TL;DR: Instrument the Welcome Survey, so that the responses are produced as analytics events rather than stored in application data.

Scope

Emit Welcome Survey responses as structured analytics events.
Ensure events are compatible with existing analytics pipelines and reporting tools.
Preserve user privacy and comply with data retention and consent policies.

Acceptance Criteria

Welcome Survey responses are captured as structured analytics events.
Events are documented, including schema definitions and field descriptions.
Data is accessible in a Superset dashboard. Ideally similar to: Welcome survey dashboard/241

Privacy, consent, and data governance requirements are reviewed and approved.

NOTE: This may involve fixing the existing dashboard or adding new instrumentation creating a new dashboard with equivalent functionality and filters.

Event Timeline

KStoller-WMF moved this task from Inbox to Backlog on the Growth-Team board.
KStoller-WMF renamed this task from Welcome survey data: access to response data [Airflow migration] to Welcome survey data: access to response data.May 25 2025, 1:02 PM
KStoller-WMF updated the task description. (Show Details)

Related: T275172#7234209

Also, getting an update/status on this comment will be pertinent: T296661#9454074

KStoller-WMF lowered the priority of this task from High to Low.Feb 21 2026, 2:23 PM
KStoller-WMF added a subscriber: Urbanecm_WMF.

After discussion with @Urbanecm_WMF , it sounds like this is likely a fairly large effort, for a few reasons:

  • Ideally we can build the transfer from user properties to data lake, not just add basic instrumentation.
  • We are currently using the welcome survey user properties data in some pages: Homepage banners that are different based on Welcome Survey responses (for users who create accounts specifically to add images or create articles). These banners are dismissible, but only show on the homepage for 60 days by default.
  • https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow - is built especially for this. So this should be easier than it used to be. But no one on Growth is super familiar with Airflow.

Martin feel free to correct or expand on this reasoning.

Because this is such a large effort that doesn't block any current annual plan work, I'm moving this to lower priority.

When we are ready to work on this, we should break this into subtasks: instrumentation & airflow set-up tasks (for engineers) and superset dashboard set up (for Product Analytics)

We briefly talked about this in Estimation, but it seems that it is still not decided what is supposed to happen here, so moving it back to the product backlog.

Moving to triaged as it seems more likely we will take this approach:
T423346: Remove the Welcome Survey