Page MenuHomePhabricator

Run a survey to understand why existing logged in users might be opting out of Parsoid
Closed, ResolvedPublic

Description

Background

As we roll out Parsoid certain users are opting out of the experience. This could either be due to a bug we've since fixed, or due to a valid issue that we are not aware of (E.g. performance/broken experience on certain pages). Anecdotally at least one Wikivoyage user has opted out due to lack of thumbnail support documented described in T375981: Preferences settings for small image size are not being respected for Parsoid Read Views. Running a survey can help us understand the needs of these users and plan for them better proactively during roll out.

User story

As a hypothesis owner I want to know why users might not want to use Parsoid

Requirements

  • An external survey has been set up that asks users to give us feedback on why they are not using Parsoid. Answers would include "What's Parsoid?" as well as a free text box to provide more in depth information. [to be designed by @MSantos]
  • A quick survey is run for all users NOT using Parsoid on projects where Parsoid is the default [Jon to setup and run]

BDD

  • For QA engineer to fill out

Test Steps

  • For QA engineer to fill out

Design

  • Add mockups and design requirements

Code

if ( !$('[data-mw-parsoid]').length ) {
  mw.loader.using('ext.quicksurveys.lib').then((req)=>req('ext.quicksurveys.lib').showSurvey('parsoid-rollout-survey'))
}

Acceptance criteria

  • Add acceptance criteria

QA

  • With survey enabled on test wikipedia, check the survey only shows when I opt out of Parsoid.
  • When the survey displays, participate in the survey and ensure it appears in superset under the query`select * from event.quicksurveysresponses AMD event.surveycodename = "parsoid-migration-survey-2026"`

Communication criteria - does this need an announcement or discussion?

N/A

Rollback plan

N/A

This task was created by Version 1.2.0 of the Web team task template using phabulous

Event Timeline

Here are 4 questions that came to my mind, but might be too extensive for a quick survey. Let me know what you think.

  1. What best describes your current relationship with Parsoid? (select one)
    • What's Parsoid?
    • I've heard of it but haven't tried it
    • I tried it but stopped using it
    • I'm aware of it but chose not to adopt it
    • I use the legacy parser and have no plans to switch
  1. If you're not currently using Parsoid, what are the main reasons? (select all that apply)
    • Lack of awareness / don't know what it offers
    • Compatibility concerns with existing templates or extensions
    • Migration seems too complex
    • Haven't had time to evaluate it
    • Waiting for it to become the default
    • Other (please specify below)
  1. What would help you adopt Parsoid? (select all that apply)
    • Better documentation
    • Migration guides / tooling
    • Compatibility testing tools
    • Community support / examples
    • Nothing — I plan to wait for automatic migration
  1. Please share any additional thoughts or concerns about Parsoid:
    • [Free text box]

Change #1233846 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[mediawiki/extensions/ParserMigration@master] WIP: Show a quicksurvey to all logged in users using Parsoid

https://gerrit.wikimedia.org/r/1233846

Test wiki created on Patch demo by Jdlrobson using patch(es) linked to this task:
https://228f09fcdd.catalyst.wmcloud.org/w/

@MSantos I looked into next steps here.

  1. We need to request a privacy statement for legal (info)
  2. We reach out to design research to get a Qualtrics survey setup.
  3. We would source translations for the languages we want to run this one.
  4. We'd need to work out who to show it to.

#3 is likely to be the trickiest for an external survey so I've been rethinking this as an internal survey to make sourcing translations easier. Please see associated patch and example survey here:
https://228f09fcdd.catalyst.wmcloud.org/wiki/New_York_(magazine)
Alternatively we can setup an external survey and limit the audience to certain languages that we are easily able to get translations for.

If this looks like it will be useful let me know so I can kick off the process to request the privacy statement (which should take a week or 2 from what I understand).

@MSantos I looked into next steps here.

  1. We need to request a privacy statement for legal (info)
  2. We reach out to design research to get a Qualtrics survey setup.
  3. We would source translations for the languages we want to run this one.
  4. We'd need to work out who to show it to.

#3 is likely to be the trickiest for an external survey so I've been rethinking this as an internal survey to make sourcing translations easier. Please see associated patch and example survey here:
https://228f09fcdd.catalyst.wmcloud.org/wiki/New_York_(magazine)
Alternatively we can setup an external survey and limit the audience to certain languages that we are easily able to get translations for.

If this looks like it will be useful let me know so I can kick off the process to request the privacy statement (which should take a week or 2 from what I understand).

That works for me, let me know how I can better support you on this.

@MSantos I looked into next steps here.

  1. We need to request a privacy statement for legal (info)
  2. We reach out to design research to get a Qualtrics survey setup.
  3. We would source translations for the languages we want to run this one.
  4. We'd need to work out who to show it to.

#3 is likely to be the trickiest for an external survey so I've been rethinking this as an internal survey to make sourcing translations easier. Please see associated patch and example survey here:
https://228f09fcdd.catalyst.wmcloud.org/wiki/New_York_(magazine)
Alternatively we can setup an external survey and limit the audience to certain languages that we are easily able to get translations for.

If this looks like it will be useful let me know so I can kick off the process to request the privacy statement (which should take a week or 2 from what I understand).

That works for me, let me know how I can better support you on this.

@MSantos we are ready to run the survey when you are. I'll chat about next steps with you this week, but the sequencing would be as follows:

Change #1238787 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[operations/mediawiki-config@master] Enable parser survey for opted out users on all parsoid rendered wikis

https://gerrit.wikimedia.org/r/1238787

Change #1233846 merged by jenkins-bot:

[mediawiki/extensions/ParserMigration@master] Show a quicksurvey to all logged in users using Parsoid

https://gerrit.wikimedia.org/r/1233846

Change #1240782 had a related patch set uploaded (by C. Scott Ananian; author: Jdlrobson):

[operations/mediawiki-config@master] Enable parser survey for opted out users on some English-language wikis

https://gerrit.wikimedia.org/r/1240782

Change #1240782 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable parser survey for opted out users on some English-language wikis

https://gerrit.wikimedia.org/r/1240782

Mentioned in SAL (#wikimedia-operations) [2026-02-19T21:24:32Z] <cscott@deploy2002> Started scap sync-world: Backport for [[gerrit:1240782|Enable parser survey for opted out users on some English-language wikis (T414852)]], [[gerrit:1239270|Deploy PRV to 19 wikis (T417349)]]

Mentioned in SAL (#wikimedia-operations) [2026-02-19T21:26:29Z] <cscott@deploy2002> cscott, arlolra: Backport for [[gerrit:1240782|Enable parser survey for opted out users on some English-language wikis (T414852)]], [[gerrit:1239270|Deploy PRV to 19 wikis (T417349)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2026-02-19T21:35:01Z] <cscott@deploy2002> Finished scap sync-world: Backport for [[gerrit:1240782|Enable parser survey for opted out users on some English-language wikis (T414852)]], [[gerrit:1239270|Deploy PRV to 19 wikis (T417349)]] (duration: 10m 28s)

Change #1247119 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[operations/mediawiki-config@master] Enable parser survey for opted-out users on German & French wikis

https://gerrit.wikimedia.org/r/1247119

Change #1247119 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable parser survey for opted-out users on German/French/Polish wikis

https://gerrit.wikimedia.org/r/1247119

Mentioned in SAL (#wikimedia-operations) [2026-03-09T20:17:52Z] <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1247119|Enable parser survey for opted-out users on German/French/Polish wikis (T414852)]], [[gerrit:1249316|lift IP cap for womens month editathon (T419109)]]

Mentioned in SAL (#wikimedia-operations) [2026-03-09T20:19:46Z] <tgr@deploy2002> cscott, tgr, anzx: Backport for [[gerrit:1247119|Enable parser survey for opted-out users on German/French/Polish wikis (T414852)]], [[gerrit:1249316|lift IP cap for womens month editathon (T419109)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2026-03-09T20:31:28Z] <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1247119|Enable parser survey for opted-out users on German/French/Polish wikis (T414852)]], [[gerrit:1249316|lift IP cap for womens month editathon (T419109)]] (duration: 13m 36s)

Change #1250750 had a related patch set uploaded (by C. Scott Ananian; author: C. Scott Ananian):

[operations/mediawiki-config@master] Enable parser survey for opted-out users on ru/pt/ja/id wikis

https://gerrit.wikimedia.org/r/1250750

Change #1250750 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable parser survey for opted-out users on ru/pt/ja/id wikis

https://gerrit.wikimedia.org/r/1250750

Mentioned in SAL (#wikimedia-operations) [2026-03-12T20:52:04Z] <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1251152|Use 'alwaysShowLogin' query parameter during login (T419723)]], [[gerrit:1251150|login: Add 'alwaysShowLogin' login URL parameter (T419723)]], [[gerrit:1251168|PersonalDashboard: enable CTA for pilot wikis (T418613)]], [[gerrit:1250750|Enable parser survey for opted-out users on ru/pt/ja/id wikis (T414852)]]

Mentioned in SAL (#wikimedia-operations) [2026-03-12T20:53:58Z] <tgr@deploy2002> tgr, jsn, cscott: Backport for [[gerrit:1251152|Use 'alwaysShowLogin' query parameter during login (T419723)]], [[gerrit:1251150|login: Add 'alwaysShowLogin' login URL parameter (T419723)]], [[gerrit:1251168|PersonalDashboard: enable CTA for pilot wikis (T418613)]], [[gerrit:1250750|Enable parser survey for opted-out users on ru/pt/ja/id wikis (T414852)]] synced to the testservers (see https://wikitech

Mentioned in SAL (#wikimedia-operations) [2026-03-12T21:02:45Z] <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1251152|Use 'alwaysShowLogin' query parameter during login (T419723)]], [[gerrit:1251150|login: Add 'alwaysShowLogin' login URL parameter (T419723)]], [[gerrit:1251168|PersonalDashboard: enable CTA for pilot wikis (T418613)]], [[gerrit:1250750|Enable parser survey for opted-out users on ru/pt/ja/id wikis (T414852)]] (duration: 10m 41s)

Change #1238787 merged by jenkins-bot:

[operations/mediawiki-config@master] Enable parser survey for all wikis

https://gerrit.wikimedia.org/r/1238787

Mentioned in SAL (#wikimedia-operations) [2026-03-31T22:02:08Z] <jdlrobson@deploy1003> Started scap sync-world: Backport for [[gerrit:1238787|Enable parser survey for all wikis (T414852)]]

Mentioned in SAL (#wikimedia-operations) [2026-03-31T22:04:11Z] <jdlrobson@deploy1003> jdlrobson: Backport for [[gerrit:1238787|Enable parser survey for all wikis (T414852)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2026-03-31T22:13:34Z] <jdlrobson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1238787|Enable parser survey for all wikis (T414852)]] (duration: 11m 25s)

Jdlrobson-WMF claimed this task.
Jdlrobson-WMF updated the task description. (Show Details)

Survey is now live on all wikis. I've opened T421971: Disable the Parsoid opt out survey for making sure the survey is disabled at some point in the future.

Test wiki on Patch demo by Jdlrobson using patch(es) linked to this task was deleted:

https://228f09fcdd.catalyst.wmcloud.org/w/