Page MenuHomePhabricator
Create Task
Maniphest T345158

Deploy QuickSurvey for Campaigns Event Discovery project
Closed, ResolvedPublic
Actions

Description

Survey is a request of @Bethany for the Event Discovery project.

Objective: Recruit experienced editors from English, French and Spanish wikis.
Goal: 50 respondents from each wiki.
Audience: Users with more than 1000 edits.
Type: External on Qualtrics.
When: As soon as possible.
Duration: ~1 week.
Coverage: 0.03 (EN), 0.2 (FR), 0.35 (ES)

Normalizing coverage for ~50 responses/day following data provided by @TAndic from T318156.

Tasks

Messages will be created directly on the target wikis to minimize delays and because this is a one-shot survey that wouldn't benefit from message localisation.

  • Pre-deploy surveys to target wikis
  • Create messages on EN wiki
  • Create messages on FR wiki
  • Create messages on ES wiki
  • Deploy surveys to target wikis
  • Disable surveys

Tests

English Messages

  • question: Would you like to help improve Wikipedia by taking a short survey?
  • description: This survey takes about 4 minutes to complete. The results will be used to improve contributor experiences.
  • link: https://wikimedia.qualtrics.com/jfe/form/SV_e8OYiGclsBXEy1M
  • privacyPolicy: See the privacy policy for this survey [https://foundation.wikimedia.org/wiki/Legal:Event_Discovery_Survey_Privacy_Statement here].

French Messages

  • question: Voulez-vous contribuer à l'amélioration de Wikipédia en répondant à un petit sondage?
  • description: Il faut environ 4 minutes pour répondre à ce sondage. Les résultats seront utilisés pour améliorer l'expérience des contributeurs.
  • link: https://wikimedia.qualtrics.com/jfe/form/SV_e8OYiGclsBXEy1M
  • privacyPolicy: Consultez la politique de confidentialité de ce sondage [https://foundation.wikimedia.org/wiki/Legal:Event_Discovery_Survey_Privacy_Statement/fr ici].

Spanish Messages

  • question: ¿Le gustaría ayudarnos a mejorar Wikipedia con una breve encuesta?
  • description: Le tomará unos 4 minutos completar esta encuesta. Utilizaremos los resultados para mejorar la experiencia de los contribuyentes.
  • link: https://wikimedia.qualtrics.com/jfe/form/SV_e8OYiGclsBXEy1M
  • privacyPolicy: Lea la política de privacidad de la encuesta [https://foundation.wikimedia.org/wiki/Legal:Event_Discovery_Survey_Privacy_Statement/es aquí].

Surveys

Details

SubjectRepoBranchLines +/-
Undeploy Campaigns Event Discovery surveyoperations/mediawiki-configmaster+0 -64
Deploy Campaigns Event Discovery surveyoperations/mediawiki-configmaster+9 -3
Pre-deploy Campaigns Event Discovery surveyoperations/mediawiki-configmaster+58 -0
Customize query in gerrit

Related Objects

Event Timeline

DDeSouza created this task.Aug 29 2023, 1:27 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 29 2023, 1:27 PM
TAndic subscribed.Aug 29 2023, 2:29 PM

In case it's helpful, T318156 (and related surveys) can tell you a bit about the impressions by edit bucket on a single-question survey on EN, FR, and ES. 1000+ editors tend to be more responsive, at least to a single-question QS survey.

Here are the 1000+ edit bin responses and coverage for each wiki for that survey, running for 1.5 weeks:
EN: 3% coverage, ~550 responses
ES: 10% coverage, ~150 responses
FR: 10% coverage, ~250 responses

MdsShakil subscribed.Aug 29 2023, 3:07 PM
DDeSouza added a comment.Aug 29 2023, 3:10 PM

Thanks @TAndic. That is really helpful.

DDeSouza triaged this task as High priority.Aug 29 2023, 3:49 PM
DDeSouza updated the task description. (Show Details)
Restricted Application added a subscriber: Dereckson. · View Herald TranscriptAug 29 2023, 3:49 PM
Bethany added a subscriber: Gregoryangelom.Aug 29 2023, 4:24 PM
DDeSouza updated the task description. (Show Details)Aug 31 2023, 2:57 PM
DDeSouza updated the task description. (Show Details)Aug 31 2023, 3:01 PM
gerritbot added a comment.Aug 31 2023, 3:06 PM

Change 954079 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Pre-deploy Campaigns Event Discovery survey

https://gerrit.wikimedia.org/r/954079

gerritbot added a project: Patch-For-Review.Aug 31 2023, 3:06 PM
gerritbot added a comment.Aug 31 2023, 8:19 PM

Change 954079 merged by jenkins-bot:

[operations/mediawiki-config@master] Pre-deploy Campaigns Event Discovery survey

https://gerrit.wikimedia.org/r/954079

Stashbot mentioned this in T336092: Deploy Research Incentive Survey on English Wikipedia.Aug 31 2023, 8:20 PM

Mentioned in SAL (#wikimedia-operations) [2023-08-31T20:20:09Z] <jhuneidi@deploy1002> Started scap: Backport for [[gerrit:950046|Undeploy Research Incentive survey on enwiki (T336092)]], [[gerrit:954079|Pre-deploy Campaigns Event Discovery survey (T345158)]]

Stashbot added a comment.Aug 31 2023, 8:21 PM

Mentioned in SAL (#wikimedia-operations) [2023-08-31T20:21:50Z] <jhuneidi@deploy1002> jhuneidi and dani: Backport for [[gerrit:950046|Undeploy Research Incentive survey on enwiki (T336092)]], [[gerrit:954079|Pre-deploy Campaigns Event Discovery survey (T345158)]] synced to the testservers mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option)

Maintenance_bot removed a project: Patch-For-Review.Aug 31 2023, 8:30 PM
Stashbot added a comment.Aug 31 2023, 8:34 PM

Mentioned in SAL (#wikimedia-operations) [2023-08-31T20:34:29Z] <jhuneidi@deploy1002> Finished scap: Backport for [[gerrit:950046|Undeploy Research Incentive survey on enwiki (T336092)]], [[gerrit:954079|Pre-deploy Campaigns Event Discovery survey (T345158)]] (duration: 14m 19s)

DDeSouza updated the task description. (Show Details)Aug 31 2023, 8:45 PM
DDeSouza changed the task status from Open to In Progress.Sep 4 2023, 4:05 AM
DDeSouza updated the task description. (Show Details)Sep 4 2023, 3:48 PM
DDeSouza added a comment.Sep 4 2023, 4:02 PM

Notes for debugging future deployments:

  • Survey doesn't load if the messages don't exist.
  • After messages creation there is a delay (up to 10 minutes) before the survey is able to load.
DDeSouza updated the task description. (Show Details)Sep 4 2023, 4:02 PM
DDeSouza moved this task from Backlog to In Progress on the Design-Research board.
gerritbot added a comment.Sep 4 2023, 4:10 PM

Change 954720 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Deploy Campaigns Event Discovery survey

https://gerrit.wikimedia.org/r/954720

gerritbot added a project: Patch-For-Review.Sep 4 2023, 4:10 PM
gerritbot added a comment.Sep 5 2023, 8:06 PM

Change 954720 merged by jenkins-bot:

[operations/mediawiki-config@master] Deploy Campaigns Event Discovery survey

https://gerrit.wikimedia.org/r/954720

Stashbot added a comment.Sep 5 2023, 8:07 PM

Mentioned in SAL (#wikimedia-operations) [2023-09-05T20:07:11Z] <cjming@deploy1002> Started scap: Backport for [[gerrit:954720|Deploy Campaigns Event Discovery survey (T345158)]]

Stashbot added a comment.Sep 5 2023, 8:08 PM

Mentioned in SAL (#wikimedia-operations) [2023-09-05T20:08:57Z] <cjming@deploy1002> cjming and dani: Backport for [[gerrit:954720|Deploy Campaigns Event Discovery survey (T345158)]] synced to the testservers mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option)

Maintenance_bot removed a project: Patch-For-Review.Sep 5 2023, 8:10 PM
Stashbot added a comment.Sep 5 2023, 8:17 PM

Mentioned in SAL (#wikimedia-operations) [2023-09-05T20:17:39Z] <cjming@deploy1002> Finished scap: Backport for [[gerrit:954720|Deploy Campaigns Event Discovery survey (T345158)]] (duration: 10m 27s)

DDeSouza updated the task description. (Show Details)Sep 5 2023, 9:01 PM
gerritbot added a comment.Sep 6 2023, 7:30 PM

Change 955388 had a related patch set uploaded (by DDesouza; author: DDesouza):

[operations/mediawiki-config@master] Undeploy Campaigns Event Discovery survey

https://gerrit.wikimedia.org/r/955388

gerritbot added a project: Patch-For-Review.Sep 6 2023, 7:30 PM
MdsShakil unsubscribed.Sep 7 2023, 4:40 PM
gerritbot added a comment.Sep 7 2023, 8:05 PM

Change 955388 merged by jenkins-bot:

[operations/mediawiki-config@master] Undeploy Campaigns Event Discovery survey

https://gerrit.wikimedia.org/r/955388

Stashbot added a comment.Sep 7 2023, 8:05 PM

Mentioned in SAL (#wikimedia-operations) [2023-09-07T20:05:53Z] <thcipriani@deploy1002> Started scap: Backport for [[gerrit:955388|Undeploy Campaigns Event Discovery survey (T345158)]]

Stashbot added a comment.Sep 7 2023, 8:07 PM

Mentioned in SAL (#wikimedia-operations) [2023-09-07T20:07:22Z] <thcipriani@deploy1002> thcipriani and dani: Backport for [[gerrit:955388|Undeploy Campaigns Event Discovery survey (T345158)]] synced to the testservers mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option)

Maintenance_bot removed a project: Patch-For-Review.Sep 7 2023, 8:10 PM
Stashbot added a comment.Sep 7 2023, 8:23 PM

Mentioned in SAL (#wikimedia-operations) [2023-09-07T20:23:51Z] <thcipriani@deploy1002> Finished scap: Backport for [[gerrit:955388|Undeploy Campaigns Event Discovery survey (T345158)]] (duration: 17m 58s)

DDeSouza closed this task as Resolved.Sep 7 2023, 8:31 PM
DDeSouza updated the task description. (Show Details)
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL