Page MenuHomePhabricator

Configure ReadingLists beta QuickSurvey
Closed, ResolvedPublic2 Estimated Story Points

Description

Background

We want to add a survey to the ReadingLists page to understand user satisfaction.

Design requirements

Link to figma

Desktop

New Vector (17).png (773×1 px, 193 KB)
New Vector (16).png (773×1 px, 341 KB)

Mobile

Saved pages (3).png (773×384 px, 146 KB)
Saved pages (4).png (773×384 px, 145 KB)
Saved pages (5).png (773×384 px, 45 KB)
Configuration specification
  • The survey should appear on Special:ReadingLists/[username]
  • Criteria:
    • The survey shows only if the user has at least 1 saved page
    • If a user answers the survey, we log their answer, and they never see this question again.
    • Show the survey a max of 10 times ---

Requirements

Acceptance criteria

  • ReadingLists survey appears on Special:ReadingLists/[user] for [insert user criteria here].
  • ReadingLists survey no longer appears on the page once the user has completed it or after 10 impressions.

BDD

Scenario (1): a user sees with Quick survey on Special:ReadingLists page

  • Given a user with with at least one saved article
  • When a user visits Special:ReadingLists page
  • Then a user will see Quick Survey

Scenario (2) : a user clicks 'Yes' and 'No' on Quick survey on Special:ReadingLists page

  • Given a user sees QuickSurvey on Special:ReadingLists page
  • When a user may click 'Yes' or 'No'
  • Then if a user clicks 'Yes', a user will see a dialog "What would make this more useful for you?"
  • And if a user submits it, the confirmation dialog appears
  • And a user never sees the Quick Survey

(the same specs for when a user clicks 'No')

Scenario (3) : a user doesn't interact with QuickSurvey on Special:ReadingLists page

  • Given a user sees QuickSurvey on Special:ReadingLists page
  • When a user doesn't click 'Yes' or 'No' and visits Special:ReadingLists page ten more time
  • Then a user won't see QuickSurvey on subsequent visits

Test Steps

  • check the test Scenarios1-3
  • run Accessibility check

Rollback plan

Describe the rollback plan in production for this task if something goes wrong.

This task was created by Version 1.0.0 of the Reader Experience team task template using phabulous.

Event Timeline

AnneT set the point value for this task to 2.
AnneT added subscribers: HFan-WMF, Sneha.

We need to finalize the audience criteria cc @Sneha and @HFan-WMF

I've synced with @Sneha on the audience criteria:

  • show survey to users who have saved at least 1 article when they visit the Reading List page

Dismissal criteria:

  • if the user answers the first yes/no question, they should never see the survey again (on mobile web or desktop), even if they don't answer the free text response question.
  • if a user sees the yes/no question 10 times when visiting their reading list page (either on mobile web or desktop) without answering it, dismiss the survey forever

Do let us know if during implementation it's clear that this is difficult to track or expensive to implement. We can think of alternatives. Sneha, if this looks good, should I edit the placeholders in the ticket description?

@HFan-WMF I know we discussed this but on second thoughts may be the criteria should be at least 1 article on the saved pages to be able to see feedback form.

show users who have saved at least 1 article (even if they unsaved it later) when they visit the Reading List page

With the above criteria the form may possibly appear on an empty state and that would be confusing.

FWIW I think it would be easier for us to show it to users with at least one article currently saved, vs. users who have saved an article at some point but may not have any saved now. I'm also not 100% sure how we'll handle the criterion about seeing the survey 10 times but determining whether that's feasible can be part of this task!

Just edited the criteria to be show survey to users who have saved at least 1 article when they visit the Reading List page. Thanks both!

@AnneT for seeing the survey 10 times... could we simplify it to visiting the saved pages 10 times after the survey is triggered?

Jdrewniak changed the task status from Open to Stalled.Mar 24 2026, 5:41 PM

FYI: If you are curious, QuickSurveys store survey dismissal state in localStorage. If this QuickSurveys "token" is present in localStorage, then the user no longer sees the survey.  Beta Features on/off does not matter, but if the user clears local storage or visits the special page on a different device etc. they will see the survey again.

If cross-device / user clears local storage is enough of an issue then perhaps it is possible that we store this in user preferences since we are targeting logged in users, but this would involve more substantial changes in the QuickSurveys extension that we probably don't want to do

Change #1261441 had a related patch set uploaded (by Anne Tomasevich; author: Anne Tomasevich):

[mediawiki/extensions/ReadingLists@master] Add beta feature survey

https://gerrit.wikimedia.org/r/1261441

Test wiki created on Patch demo by ATomasevich (WMF) using patch(es) linked to this task:
https://ae000ede16.catalyst.wmcloud.org/w/

Change #1261728 had a related patch set uploaded (by Anne Tomasevich; author: Anne Tomasevich):

[mediawiki/extensions/ReadingLists@master] Show the beta survey to the right users

https://gerrit.wikimedia.org/r/1261728

AnneT changed the task status from Stalled to In Progress.Mar 27 2026, 2:06 AM
AnneT updated the task description. (Show Details)

Thanks, @aude - I did something similar to what QuickSurveys does, although I'll welcome your feedback in code review on how I designed the storage token to handle both impressions and survey completion.

@Sneha following @aude's recommendation, I was able to meet the criterion of 10 max impressions!

Change #1264693 had a related patch set uploaded (by Anne Tomasevich; author: Anne Tomasevich):

[mediawiki/extensions/ReadingLists@master] Add a feature flag for the beta survey

https://gerrit.wikimedia.org/r/1264693

AnneT removed AnneT as the assignee of this task.Mar 30 2026, 6:00 PM

Change #1261728 abandoned by Anne Tomasevich:

[mediawiki/extensions/ReadingLists@master] Show the beta survey to the right users

Reason:

Squashed into previous commit

https://gerrit.wikimedia.org/r/1261728

Change #1264693 abandoned by Anne Tomasevich:

[mediawiki/extensions/ReadingLists@master] Add a feature flag for the beta survey

Reason:

Squashed into base commit

https://gerrit.wikimedia.org/r/1264693

Change #1261441 merged by jenkins-bot:

[mediawiki/extensions/ReadingLists@master] Add beta feature survey

https://gerrit.wikimedia.org/r/1261441

@AnneT - I might be missing something but ReadingListsEnableBetaQuickSurvey worked for me only once on an article page on https://ca06638f4e.catalyst.wmcloud.org/wiki/New_York_City (for a new account):

Screenshot 2026-04-03 at 5.02.06 PM.png (563×1 px, 59 KB)

ReadingListsEnableBetaQuickSurvey is set to false in beta cluster and I could not find a way to override it, e.g. with a url parameter or something. Also, the survey is not listed in https://en.wikipedia.beta.wmcloud.org/w/load.php?debug=true&modules=ext.quicksurveys.lib - that's because it's not enabled?

Change #1268287 had a related patch set uploaded (by VolkerE; author: VolkerE):

[mediawiki/extensions/ReadingLists@master] i18n: Fix message for assistive technologies in quick survey answer

https://gerrit.wikimedia.org/r/1268287

The QuickSurvey is enabled on beta - the testing is done on enwiki beta.

  • QuickSurvey is present
desktop
Screenshot 2026-04-06 at 4.50.13 PM.png (1×2 px, 139 KB)
mobile
Screenshot 2026-04-07 at 10.04.30 AM.png (1×802 px, 120 KB)
  • the dialog for feedback
Screenshot 2026-04-07 at 11.06.52 AM.png (1×764 px, 54 KB)
the text field extends to accommodate text
Screenshot 2026-04-07 at 11.09.02 AM.png (1×760 px, 229 KB)
  • the feedback confirmation message

Screenshot 2026-04-07 at 11.09.15 AM.png (1×746 px, 159 KB)

Change #1268287 merged by jenkins-bot:

[mediawiki/extensions/ReadingLists@master] i18n: Fix message for assistive technologies in quick survey answer

https://gerrit.wikimedia.org/r/1268287

HFan-WMF claimed this task.

Looks good on desktop beta!