Page MenuHomePhabricator
Create Task
Maniphest T410696

Deploy enwiki edition of 2025 GRS
Open, Needs TriagePublic
Actions

Description

This tracks the deployment of the 2025 english wikipedia readers survey on Quicksurvey.

Audience: English Wikipedia, logged out only
Fielding Dates: November 24 - November 27, 2025
Coverage: 2% / 0.02
Survey Type: Internal, single-question Quicksurvey
Survey Name: English Wikipedia Global Readers Survey

Tasks

  • Pre-deploy survey
  • Create messages
  • Deploy survey
  • Disable survey
Tests
  • Test survey appears as expected
  • Test survey branches as designed
  • Test survey initiation and responses recorded in QS init and QS response tables
Survey

https://wikimediafoundation.limesurvey.net/881845?lang=en

Survey name: reader-demographics-2025-en

'enwiki’ => [
// T378660
	[
	'enabled' => true,
	'type' => 'external',
	'name' => 'reader-demographics-2025-en’,
	'question' => 'Reader-demographics-2-survey-question',
	'description' => 'Reader-demographics-2025-en-survey-description',
	'coverage' => 0, // Increase to deploy.
	'audience' => [
		'anons' => true
	],
	'instanceTokenParameterName' => 'QS',
	'platforms' => [
		'desktop' => [ 'stable' ],
		'mobile' => [ 'stable' ]
	],
	'link' => 'Reader-demographics-2025-en-survey-link',
	'privacyPolicy' => 'Reader-demographics-2025-en-survey-policy',
	],
],

Details

Other Assignee
TAndic
Related Changes in Gerrit:
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

YLiou_WMF created this task.Thu, Nov 20, 10:38 PM
YLiou_WMF updated the task description. (Show Details)
YLiou_WMF added a subscriber: DDeSouza.Thu, Nov 20, 10:41 PM

@DDeSouza we're looking to deploy this survey next week. Can we get this set up to be ready to go on Monday (November 24)? Thanks!

TAndic subscribed.Fri, Nov 21, 2:55 PM

@YLiou_WMF I checked the skip patterns for the survey and all looks fine on this end.
Methodological note: temp users (previously IP editors/anon) are now categorized with user/editors (see QuickSurvey documentation). If you see a drop in previous editing experience, this may be a result of the population change. (Alternatively, we could target all and then use the userInGroup setting to only display to temp for users, but having never used this and working on a short timeline, it may be risky as I believe there are still some open questions about the temp group functionality.)

gerritbot added a comment.Fri, Nov 21, 5:01 PM

Change #1208408 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Pre-deploy 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1208408

gerritbot added a project: Patch-For-Review.Fri, Nov 21, 5:01 PM
DDeSouza added a comment.Fri, Nov 21, 5:02 PM

@YLiou_WMF I'm available for deployment on Monday.

DDeSouza added a comment.Fri, Nov 21, 5:04 PM
In T410696#11396160, @TAndic wrote:

@YLiou_WMF I checked the skip patterns for the survey and all looks fine on this end.
Methodological note: temp users (previously IP editors/anon) are now categorized with user/editors (see QuickSurvey documentation). If you see a drop in previous editing experience, this may be a result of the population change. (Alternatively, we could target all and then use the userInGroup setting to only display to temp for users, but having never used this and working on a short timeline, it may be risky as I believe there are still some open questions about the temp group functionality.)

If you want to test this and/or other new features I can deploy them on the beta server.

TAndic added a comment.Fri, Nov 21, 5:18 PM

@DDeSouza might be worth trying if we can do it today or Monday? Thank you for the offer!

If I'm reading correctly, we would remove the anon true/false parameter for audience (so everyone is in the group), and then use userInGroup to select temp to remove all other registered users (I can't tell if that means that only temps will be selected and ignore reader/anon audience, or if it's only filtering if someone is a registered user).

For QA I assume we'd start at 100% coverage on beta and then make a non-logged in edit in an incognito window to see if it comes up?

DDeSouza added a comment.EditedFri, Nov 21, 5:31 PM

@TAndic I can try to deploy it on Monday afternoon backport window and otherwise on the late window. Anyway it wouldn't be useful for this survey as I'm deploying it on Monday as well.

I believe doing so will include only temporary users.

I think that is a good way to test it.

TAndic added a comment.Fri, Nov 21, 5:41 PM

Agreed @DDeSouza -- this feels risky/unfeasible to make it into this one but likely worth the beta test as a separate thing for learning what happens.

@YLiou_WMF double-checking, are we doing 0 coverage test Monday, increase coverage Tuesday?

YLiou_WMF added a comment.Sun, Nov 23, 6:02 PM

Yes, I think that's the way to go.

YLiou_WMF updated the task description. (Show Details)Mon, Nov 24, 2:32 PM
gerritbot added a comment.Mon, Nov 24, 6:17 PM

Change #1210655 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Deploy experiment for 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1210655

gerritbot added a comment.Mon, Nov 24, 9:33 PM

Change #1208408 merged by jenkins-bot:

[operations/mediawiki-config@master] Pre-deploy 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1208408

gerritbot added a comment.Mon, Nov 24, 9:33 PM

Change #1210655 merged by jenkins-bot:

[operations/mediawiki-config@master] Deploy experiment for 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1210655

Stashbot mentioned this in T401990: Chart displays NaN for entries with no data.Mon, Nov 24, 9:33 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-24T21:33:38Z] <dani@deploy2002> Started scap sync-world: Backport for [[gerrit:1208408|Pre-deploy 2025 Global Readers Survey (T410696)]], [[gerrit:1210655|Deploy experiment for 2025 Global Readers Survey (T410696)]], [[gerrit:1210669|Show "no data" message when tooltip does not contain to show (T401990)]]

DDeSouza added a comment.Mon, Nov 24, 9:55 PM

Debug URL

Stashbot added a comment.Mon, Nov 24, 10:01 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-24T22:01:07Z] <dani@deploy2002> dani, bvibber: Backport for [[gerrit:1208408|Pre-deploy 2025 Global Readers Survey (T410696)]], [[gerrit:1210655|Deploy experiment for 2025 Global Readers Survey (T410696)]], [[gerrit:1210669|Show "no data" message when tooltip does not contain to show (T401990)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

gerritbot added a comment.Mon, Nov 24, 10:19 PM

Change #1210727 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Pre-deploy 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1210727

gerritbot added a comment.Mon, Nov 24, 10:20 PM

Change #1210729 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Deploy experiment for 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1210729

gerritbot added a comment.Tue, Nov 25, 2:30 PM

Change #1210727 merged by jenkins-bot:

[operations/mediawiki-config@master] Pre-deploy 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1210727

Stashbot added a comment.Tue, Nov 25, 2:31 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-25T14:31:21Z] <dani@deploy2002> Started scap sync-world: Backport for [[gerrit:1210727|Pre-deploy 2025 Global Readers Survey (T410696)]]

Stashbot added a comment.Tue, Nov 25, 2:35 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-25T14:35:41Z] <dani@deploy2002> dani: Backport for [[gerrit:1210727|Pre-deploy 2025 Global Readers Survey (T410696)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

gerritbot added a comment.Tue, Nov 25, 2:44 PM

Change #1211141 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Pre-deploy 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1211141

gerritbot added a comment.Tue, Nov 25, 2:46 PM

Change #1211142 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Pre-deploy 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1211142

gerritbot added a comment.Tue, Nov 25, 2:50 PM

Change #1211142 abandoned by DDesouza:

[operations/mediawiki-config@master] Pre-deploy 2025 Global Readers Survey

Reason:

Duplicate

https://gerrit.wikimedia.org/r/1211142

gerritbot added a comment.Tue, Nov 25, 3:00 PM

Change #1211141 merged by jenkins-bot:

[operations/mediawiki-config@master] Pre-deploy 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1211141

Stashbot added a comment.Tue, Nov 25, 3:00 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-25T15:00:55Z] <dani@deploy2002> Started scap sync-world: Backport for [[gerrit:1211141|Pre-deploy 2025 Global Readers Survey (T410696)]]

Stashbot added a comment.Tue, Nov 25, 3:04 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-25T15:04:57Z] <dani@deploy2002> dani: Backport for [[gerrit:1211141|Pre-deploy 2025 Global Readers Survey (T410696)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Tue, Nov 25, 3:10 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-25T15:10:36Z] <dani@deploy2002> Finished scap sync-world: Backport for [[gerrit:1211141|Pre-deploy 2025 Global Readers Survey (T410696)]] (duration: 09m 41s)

gerritbot added a comment.Tue, Nov 25, 4:23 PM

Change #1211170 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Deploy 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1211170

gerritbot added a comment.Tue, Nov 25, 9:07 PM

Change #1211170 merged by jenkins-bot:

[operations/mediawiki-config@master] Deploy 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1211170

Stashbot added a comment.Tue, Nov 25, 9:08 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-25T21:08:21Z] <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1211170|Deploy 2025 Global Readers Survey (T410696)]]

Stashbot added a comment.Tue, Nov 25, 9:10 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-25T21:10:32Z] <urbanecm@deploy2002> dani, urbanecm: Backport for [[gerrit:1211170|Deploy 2025 Global Readers Survey (T410696)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Tue, Nov 25, 9:17 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-25T21:17:00Z] <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1211170|Deploy 2025 Global Readers Survey (T410696)]] (duration: 08m 39s)

gerritbot added a comment.Thu, Nov 27, 12:19 AM

Change #1211855 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Undeploy 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1211855

gerritbot added a comment.Thu, Nov 27, 5:57 PM

Change #1212204 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Deploy 2025 Global Readers Survey (non-enwiki)

https://gerrit.wikimedia.org/r/1212204

gerritbot added a comment.Thu, Nov 27, 9:04 PM

Change #1211855 merged by jenkins-bot:

[operations/mediawiki-config@master] Undeploy 2025 Global Readers Survey on enwiki

https://gerrit.wikimedia.org/r/1211855

gerritbot added a comment.Thu, Nov 27, 9:05 PM

Change #1210729 merged by jenkins-bot:

[operations/mediawiki-config@master] Deploy experiment for 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1210729

gerritbot added a comment.Thu, Nov 27, 9:05 PM

Change #1212204 merged by jenkins-bot:

[operations/mediawiki-config@master] Deploy 2025 Global Readers Survey (non-enwiki)

https://gerrit.wikimedia.org/r/1212204

Stashbot added a comment.Thu, Nov 27, 9:05 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-27T21:05:26Z] <dani@deploy2002> Started scap sync-world: Backport for [[gerrit:1211855|Undeploy 2025 Global Readers Survey on enwiki (T410696)]], [[gerrit:1210729|Deploy experiment for 2025 Global Readers Survey (T410696)]], [[gerrit:1212204|Deploy 2025 Global Readers Survey (non-enwiki) (T410696)]]

Stashbot added a comment.Thu, Nov 27, 9:07 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-27T21:07:29Z] <dani@deploy2002> dani: Backport for [[gerrit:1211855|Undeploy 2025 Global Readers Survey on enwiki (T410696)]], [[gerrit:1210729|Deploy experiment for 2025 Global Readers Survey (T410696)]], [[gerrit:1212204|Deploy 2025 Global Readers Survey (non-enwiki) (T410696)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Thu, Nov 27, 9:21 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-27T21:21:00Z] <dani@deploy2002> Finished scap sync-world: Backport for [[gerrit:1211855|Undeploy 2025 Global Readers Survey on enwiki (T410696)]], [[gerrit:1210729|Deploy experiment for 2025 Global Readers Survey (T410696)]], [[gerrit:1212204|Deploy 2025 Global Readers Survey (non-enwiki) (T410696)]] (duration: 15m 34s)

Maintenance_bot removed a project: Patch-For-Review.Thu, Nov 27, 9:30 PM
gerritbot added a comment.Thu, Nov 27, 11:12 PM

Change #1212265 had a related patch set uploaded (by Zabe; author: Zabe):

[operations/mediawiki-config@master] BETA: Fix 'Use of instanceTokenParameterName' deprecation warning

https://gerrit.wikimedia.org/r/1212265

gerritbot added a project: Patch-For-Review.Thu, Nov 27, 11:12 PM
gerritbot added a comment.Thu, Nov 27, 11:32 PM

Change #1212265 merged by jenkins-bot:

[operations/mediawiki-config@master] BETA: Fix 'Use of instanceTokenParameterName' deprecation warning

https://gerrit.wikimedia.org/r/1212265

Maintenance_bot removed a project: Patch-For-Review.Fri, Nov 28, 12:31 AM
jijiki subscribed.Fri, Nov 28, 12:59 PM

Hello! Since 1212204 was backported, it has been producing thousands of error messages https://logstash.wikimedia.org/goto/103ab3d23a65b901740f79fc62e71e9a

Ladsgroup subscribed.Fri, Nov 28, 1:07 PM
In T410696#11415793, @jijiki wrote:

Hello! Since 1212204 was backported, it has been producing thousands of error messages https://logstash.wikimedia.org/goto/103ab3d23a65b901740f79fc62e71e9a

more specifically, it's triggering ~1,000 error messages every second 😨

Lucas_Werkmeister_WMDE subscribed.Fri, Nov 28, 1:07 PM

I think this link is missing for the other languages, causing the error messages @jijiki mentioned? There are no errors about -en, but the following pages are missing if I’m not mistaken:

TAndic added a comment.Fri, Nov 28, 1:12 PM

I can add these links quickly (or a placeholder) to see if it fixes the issue.

Confirming before I do so: this survey should be displaying at 0 coverage as it's a test -- it would still be throwing errors if this is the case, right?

Lucas_Werkmeister_WMDE added a comment.EditedFri, Nov 28, 1:13 PM

No idea, that sounds like a question for someone who knows QuickSurveys better than I do ;) Please add the links (otherwise we were discussing reverting this config change on IRC).

gerritbot added a comment.Fri, Nov 28, 1:18 PM

Change #1212585 had a related patch set uploaded (by Lucas Werkmeister (WMDE); author: Ladsgroup):

[operations/mediawiki-config@master] Revert "Deploy 2025 Global Readers Survey (non-enwiki)"

https://gerrit.wikimedia.org/r/1212585

gerritbot added a project: Patch-For-Review.Fri, Nov 28, 1:18 PM
gerritbot added a comment.Fri, Nov 28, 1:22 PM

Change #1212585 merged by jenkins-bot:

[operations/mediawiki-config@master] Revert "Deploy 2025 Global Readers Survey (non-enwiki)"

https://gerrit.wikimedia.org/r/1212585

Stashbot added a comment.Fri, Nov 28, 1:23 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-28T13:23:08Z] <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1212585|Revert "Deploy 2025 Global Readers Survey (non-enwiki)" (T410696)]]

Stashbot added a comment.Fri, Nov 28, 1:25 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-28T13:25:11Z] <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:1212585|Revert "Deploy 2025 Global Readers Survey (non-enwiki)" (T410696)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

TAndic added a comment.Fri, Nov 28, 1:28 PM

Added links! Revert is also okay, we can test next week with functional links. Thank you all for the quick work.

Ladsgroup added a comment.Fri, Nov 28, 1:28 PM

Apologies, we had to revert this. It was causing 701K errors in 15 minutes. In comparison, the rest of mediawiki in that period caused only 4K errors.

Stashbot added a comment.Fri, Nov 28, 1:29 PM

Mentioned in SAL (#wikimedia-operations) [2025-11-28T13:29:38Z] <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1212585|Revert "Deploy 2025 Global Readers Survey (non-enwiki)" (T410696)]] (duration: 06m 30s)

Maintenance_bot removed a project: Patch-For-Review.Fri, Nov 28, 1:30 PM
TAndic added a comment.Fri, Nov 28, 1:33 PM

No worries at all @Ladsgroup -- I'm just grateful you were able to stop the errors! Apologies on our end for this, and lesson learned about what happens with missing messages even in 0 coverage.

DDeSouza added a comment.Fri, Nov 28, 2:32 PM

Apologies for that. At the time of deployment the canary check was fine but I can see the spike on Logstash now. I believe I should've observed it further.

DDeSouza updated the task description. (Show Details)Mon, Dec 1, 12:12 AM
gerritbot added a comment.Tue, Dec 2, 5:11 PM

Change #1214126 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Undeploy experiment for 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1214126

gerritbot added a project: Patch-For-Review.Tue, Dec 2, 5:11 PM
gerritbot added a comment.Tue, Dec 2, 9:44 PM

Change #1214126 merged by jenkins-bot:

[operations/mediawiki-config@master] [beta] Undeploy experiment for 2025 Global Readers Survey

https://gerrit.wikimedia.org/r/1214126

Stashbot mentioned this in T410918: Deploy 2025 Global Readers Surveys (non-English).Tue, Dec 2, 9:44 PM

Mentioned in SAL (#wikimedia-operations) [2025-12-02T21:44:55Z] <dani@deploy2002> Started scap sync-world: Backport for [[gerrit:1214126|[beta] Undeploy experiment for 2025 Global Readers Survey (T410696)]], [[gerrit:1213123|Deploy 2025 Global Readers Survey (non-enwiki) (T410918)]]

Stashbot added a comment.Tue, Dec 2, 9:47 PM

Mentioned in SAL (#wikimedia-operations) [2025-12-02T21:47:17Z] <dani@deploy2002> dani: Backport for [[gerrit:1214126|[beta] Undeploy experiment for 2025 Global Readers Survey (T410696)]], [[gerrit:1213123|Deploy 2025 Global Readers Survey (non-enwiki) (T410918)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Tue, Dec 2, 9:55 PM

Mentioned in SAL (#wikimedia-operations) [2025-12-02T21:55:19Z] <dani@deploy2002> Finished scap sync-world: Backport for [[gerrit:1214126|[beta] Undeploy experiment for 2025 Global Readers Survey (T410696)]], [[gerrit:1213123|Deploy 2025 Global Readers Survey (non-enwiki) (T410918)]] (duration: 10m 23s)

Maintenance_bot removed a project: Patch-For-Review.Tue, Dec 2, 10:30 PM
YLiou_WMF updated the task description. (Show Details)Fri, Dec 5, 7:23 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits