Page MenuHomePhabricator
Create Task
Maniphest T402915

Newcomer survey: first test, then launch a quicksurvey
Closed, ResolvedPublic
Actions

Description

Goal

Deploy an external QuickSurvey on English Wikipedia to logged in editors who have made a minimum of 25 edits and registered their accounts on or after 01 March 2025. We will first test at 0 coverage, then increase coverage to 50% once we have QA'd all survey flow components.

Dates
  • Test the survey at 0 coverage in the week of 1 September 2025
  • Depending on QA, aim to launch later in the week, or the following week.
Configuration
  • Project: enwiki
  • Type: External survey - linking out to a longer survey hosted on LimeSurvey
  • Survey name: newcomers-2025-survey
  • Audience: logged in editors who have made a minimum of 25 edits and registered their accounts on or after 01 March 2025
    • 'minEdits' => 25,
    • 'registrationStart' => '2025-03-01',
    • 'anons' => false,
  • Message components:
    • Question: newcomers-2025-survey-question (link)
    • Description: reader-foundational-oe-survey-description //we can reuse the recent readers survey component, as this is just a blank page
    • Privacy policy: newcomers-2025-survey-privacy-policy (link)
    • Survey link: newcomers-2025-survey-link (link)
    • Token name: QS ('instanceTokenParameterName' => 'QS',)
  • Coverage: we will start at 0 coverage to test the survey (and then aim to increase to 50% (0.5)).

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
Deploy Newcomers survey on enwikioperations/mediawiki-configmaster+0 -28
Deploy Newcomers survey on enwikioperations/mediawiki-configmaster+1 -1
Fix typo on newcomers surveyoperations/mediawiki-configmaster+1 -1
Pre-deploy Newcomers survey on enwikioperations/mediawiki-configmaster+28 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

TAndic created this task.Aug 26 2025, 11:45 AM
DDeSouza subscribed.Aug 28 2025, 3:26 PM
gerritbot added a comment.Sep 2 2025, 2:27 AM

Change #1183753 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Pre-deploy Newcomers survey on enwiki

https://gerrit.wikimedia.org/r/1183753

gerritbot added a project: Patch-For-Review.Sep 2 2025, 2:27 AM
DDeSouza added a comment.Sep 2 2025, 7:40 PM

Test URL

gerritbot added a comment.Sep 2 2025, 8:02 PM

Change #1183753 merged by jenkins-bot:

[operations/mediawiki-config@master] Pre-deploy Newcomers survey on enwiki

https://gerrit.wikimedia.org/r/1183753

Stashbot added a comment.Sep 2 2025, 8:03 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-02T20:03:08Z] <dani@deploy1003> Started scap sync-world: Backport for [[gerrit:1183753|Pre-deploy Newcomers survey on enwiki (T402915)]]

Stashbot added a comment.Sep 2 2025, 8:09 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-02T20:09:14Z] <dani@deploy1003> dani: Backport for [[gerrit:1183753|Pre-deploy Newcomers survey on enwiki (T402915)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

gerritbot added a comment.Sep 2 2025, 8:13 PM

Change #1184160 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Fix typo on newcomers survey

https://gerrit.wikimedia.org/r/1184160

Stashbot added a comment.Sep 2 2025, 8:15 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-02T20:15:01Z] <dani@deploy1003> Finished scap sync-world: Backport for [[gerrit:1183753|Pre-deploy Newcomers survey on enwiki (T402915)]] (duration: 11m 53s)

DDeSouza added a comment.Sep 2 2025, 8:19 PM

I just deployed the survey with coverage set to 0. I missed a space on the config so the survey question is not displaying. Will deploy fix.

TAndic added a comment.Sep 3 2025, 10:43 AM

Thank you so much @DDeSouza! I'll work on checking all the survey flow (linking, logs, QS token passing, etc) components in the meantime :)

I'll post on the enwiki village pump today to let them know we're working on the survey, and am planning for deployment on the 9th to give time for feedback and questions, if there are any.

gerritbot added a comment.Sep 3 2025, 8:04 PM

Change #1184160 merged by jenkins-bot:

[operations/mediawiki-config@master] Fix typo on newcomers survey

https://gerrit.wikimedia.org/r/1184160

Stashbot mentioned this in T403433: Change Tagalog Wiktionary site logo to localized version.Sep 3 2025, 8:05 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-03T20:05:13Z] <dani@deploy1003> Started scap sync-world: Backport for [[gerrit:1184160|Fix typo on newcomers survey (T402915)]], [[gerrit:1183750|tlwiktionary: add logos (T403433)]]

Stashbot added a comment.Sep 3 2025, 8:11 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-03T20:11:46Z] <dani@deploy1003> chlod, dani: Backport for [[gerrit:1184160|Fix typo on newcomers survey (T402915)]], [[gerrit:1183750|tlwiktionary: add logos (T403433)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Sep 3 2025, 8:17 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-03T20:17:56Z] <dani@deploy1003> Finished scap sync-world: Backport for [[gerrit:1184160|Fix typo on newcomers survey (T402915)]], [[gerrit:1183750|tlwiktionary: add logos (T403433)]] (duration: 12m 43s)

Maintenance_bot removed a project: Patch-For-Review.Sep 3 2025, 8:31 PM
Miriam moved this task from Backlog to In Progress on the Research board.Sep 9 2025, 2:21 PM
gerritbot added a comment.Sep 9 2025, 5:03 PM

Change #1186550 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Deploy Newcomers survey on enwiki

https://gerrit.wikimedia.org/r/1186550

gerritbot added a project: Patch-For-Review.Sep 9 2025, 5:03 PM
TAndic added a comment.Sep 9 2025, 5:05 PM

We're ready to increase the coverage and start collecting responses! (as just patched by @DDeSouza)

A note to document: one of our staff tests in forcing the QuickSurvey would pass a token to LimeSurvey, but the QuickSurvey wouldn't show up in the initiation or response eventlogging. It seems to be related to an ad blocker extension. We know ad blockers sometimes block QuickSurvey, but this was a thus-far unknown quirk (that forcing it still wouldn't log it). We should be able to find out if we have unmatched sessions in LimeSurvey whether QS is still displaying but not logging.

gerritbot added a comment.Sep 9 2025, 8:02 PM

Change #1186550 merged by jenkins-bot:

[operations/mediawiki-config@master] Deploy Newcomers survey on enwiki

https://gerrit.wikimedia.org/r/1186550

Stashbot added a comment.Sep 9 2025, 8:03 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-09T20:03:16Z] <dani@deploy1003> Started scap sync-world: Backport for [[gerrit:1186550|Deploy Newcomers survey on enwiki (T402915)]]

Stashbot added a comment.Sep 9 2025, 8:09 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-09T20:09:26Z] <dani@deploy1003> dani: Backport for [[gerrit:1186550|Deploy Newcomers survey on enwiki (T402915)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Sep 9 2025, 8:15 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-09T20:15:41Z] <dani@deploy1003> Finished scap sync-world: Backport for [[gerrit:1186550|Deploy Newcomers survey on enwiki (T402915)]] (duration: 12m 25s)

Maintenance_bot removed a project: Patch-For-Review.Sep 9 2025, 8:31 PM
TAndic added a comment.Sep 19 2025, 7:25 PM

@DDeSouza We're ready to close this survey on Monday or at your earliest convenience after, thank you so much! However, rather than fully undeploying it, we should reduce the coverage back to 0, so we can use this to test some ideas we have about missing QS initation and response events.

gerritbot added a comment.Sep 22 2025, 1:22 PM

Change #1190281 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Deploy Newcomers survey on enwiki

https://gerrit.wikimedia.org/r/1190281

gerritbot added a project: Patch-For-Review.Sep 22 2025, 1:22 PM
gerritbot added a comment.Sep 22 2025, 8:40 PM

Change #1190281 merged by jenkins-bot:

[operations/mediawiki-config@master] Deploy Newcomers survey on enwiki

https://gerrit.wikimedia.org/r/1190281

Stashbot mentioned this in T391009: Create wikipedia-pl-arbcom.wikimedia.org.Sep 22 2025, 8:41 PM
Stashbot mentioned this in T405016: Parsoid Read Views to Wikipedia deploy ~2025-09-22.

Mentioned in SAL (#wikimedia-operations) [2025-09-22T20:40:58Z] <dani@deploy1003> Started scap sync-world: Backport for [[gerrit:1190281|Deploy Newcomers survey on enwiki (T402915)]], [[gerrit:1185058|Initial configuration for arbcom_plwiki (T391009)]], [[gerrit:1189550|Deploy Parsoid Read Views to 28 Wikipedias (T405016)]]

Stashbot added a comment.Sep 22 2025, 8:47 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-22T20:47:13Z] <dani@deploy1003> arlolra, superpes, dani: Backport for [[gerrit:1190281|Deploy Newcomers survey on enwiki (T402915)]], [[gerrit:1185058|Initial configuration for arbcom_plwiki (T391009)]], [[gerrit:1189550|Deploy Parsoid Read Views to 28 Wikipedias (T405016)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Sep 22 2025, 8:54 PM

Mentioned in SAL (#wikimedia-operations) [2025-09-22T20:54:21Z] <dani@deploy1003> Finished scap sync-world: Backport for [[gerrit:1190281|Deploy Newcomers survey on enwiki (T402915)]], [[gerrit:1185058|Initial configuration for arbcom_plwiki (T391009)]], [[gerrit:1189550|Deploy Parsoid Read Views to 28 Wikipedias (T405016)]] (duration: 13m 23s)

Maintenance_bot removed a project: Patch-For-Review.Sep 22 2025, 9:30 PM
DDeSouza closed this task as Resolved.Sep 22 2025, 10:51 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits