Page MenuHomePhabricator

Deploy GDI Safety Survey Wave 2 on EN, ES, FA, FR, and PT wikis - BETA
Closed, ResolvedPublic

Assigned To
Authored By
TAndic
Jun 21 2022, 4:32 PM
Referenced Files
F35265584: image.png
Jun 23 2022, 4:33 PM
F35265582: image.png
Jun 23 2022, 4:33 PM
F35265579: image.png
Jun 23 2022, 4:33 PM
F35265577: image.png
Jun 23 2022, 4:33 PM
F35265575: image.png
Jun 23 2022, 4:33 PM
F35265573: image.png
Jun 23 2022, 4:33 PM
F35265566: image.png
Jun 23 2022, 4:33 PM
F35265564: image.png
Jun 23 2022, 4:33 PM

Description

User Story

Deploy the Community Safety Survey (Wave 2) to EN, ES, FA, FR, and PT wikis - estimated June 24th, 2022.

Notes

  • beta can be tested at higher coverage rates to ease QA (even at 1.0 coverage) - past experience shows that the coverage setting works well on the wikis.
  • This iteration of the survey will be testing whether T303740 works (pick up edit bucket count on impression - if we manage to get the edit bucket then we can resolve T303740 :))

Design specs

  • T294363 - this ticket made the Quick Surveys end of survey message more tailored (nice!); however, I would err on the side of caution and use the default message (as we’d have to input the translations and test which could cause delays [but if someone really really wants to work on it, then I’m happy to provide the translations I have]).

Technical information

  • The survey should run on each wiki for a minimum of 1 week (7 days). After 1 week, each wiki's survey can safely be undeployed if the amount of responses has surpassed 450.

EN.WIKI

'enwiki' =>[
	// T311079
	'name' => 'internal-gdi-safety-survey-wave2',
	'type' => 'internal',
	'layout' => 'single-answer',
	'question' => 'ext-quicksurveys-internal-gdi-safety-survey-question',
	'privacyPolicy' => 'ext-quicksurveys-internal-gdi-safety-survey-privacy-policy',
	'answers' => [
		'ext-quicksurveys-internal-gdi-safety-survey-answer-positive',
		'ext-quicksurveys-internal-gdi-safety-survey-answer-negative',
		'ext-quicksurveys-internal-gdi-safety-survey-answer-neutral',
	],
	'audience' => [
		// T311079
		'minEdits' => 5
	],
	'enabled' => true,
	'coverage' => 0.03, // T311079
	'platforms' => [
		'desktop' => [ 'stable' ],
		'mobile' => [ 'stable', 'beta' ],
	],
],


ES.WIKI

'eswiki' =>[
	// T311079
	'name' => 'internal-gdi-safety-survey-wave2',
	'type' => 'internal',
	'layout' => 'single-answer',
	'question' => 'ext-quicksurveys-internal-gdi-safety-survey-question',
	'privacyPolicy' => 'ext-quicksurveys-internal-gdi-safety-survey-privacy-policy',
	'answers' => [
		'ext-quicksurveys-internal-gdi-safety-survey-answer-positive',
		'ext-quicksurveys-internal-gdi-safety-survey-answer-negative',
		'ext-quicksurveys-internal-gdi-safety-survey-answer-neutral',
	],
	'audience' => [
		// T311079
		'minEdits' => 5
	],
	'enabled' => true,
	'coverage' => 0.1, // T311079
	'platforms' => [
		'desktop' => [ 'stable' ],
		'mobile' => [ 'stable', 'beta' ],
	],
],

FR.WIKI

'frwiki' =>[
	// T311079
	'name' => 'internal-gdi-safety-survey-wave2',
	'type' => 'internal',
	'layout' => 'single-answer',
	'question' => 'ext-quicksurveys-internal-gdi-safety-survey-question',
	'privacyPolicy' => 'ext-quicksurveys-internal-gdi-safety-survey-privacy-policy',
	'answers' => [
		'ext-quicksurveys-internal-gdi-safety-survey-answer-positive',
		'ext-quicksurveys-internal-gdi-safety-survey-answer-negative',
		'ext-quicksurveys-internal-gdi-safety-survey-answer-neutral',
	],
	'audience' => [
		// T311079
		'minEdits' => 5
	],
	'enabled' => true,
	'coverage' => 0.1, // T311079
	'platforms' => [
		'desktop' => [ 'stable' ],
		'mobile' => [ 'stable', 'beta' ],
	],
],


PT.WIKI

'ptwiki' =>[
	// T311079
	'name' => 'internal-gdi-safety-survey-wave2',
	'type' => 'internal',
	'layout' => 'single-answer',
	'question' => 'ext-quicksurveys-internal-gdi-safety-survey-question',
	'privacyPolicy' => 'ext-quicksurveys-internal-gdi-safety-survey-privacy-policy',
	'answers' => [
		'ext-quicksurveys-internal-gdi-safety-survey-answer-positive',
		'ext-quicksurveys-internal-gdi-safety-survey-answer-negative',
		'ext-quicksurveys-internal-gdi-safety-survey-answer-neutral',
	],
	'audience' => [
		// T311079
		'minEdits' => 5
	],
	'enabled' => true,
	'coverage' => 0.2, // T311079
	'platforms' => [
		'desktop' => [ 'stable' ],
		'mobile' => [ 'stable', 'beta' ],
	],
],


FA.WIKI

'fawiki' =>[
	// T311079
	'name' => 'internal-gdi-safety-survey-wave2',
	'type' => 'internal',
	'layout' => 'single-answer',
	'question' => 'ext-quicksurveys-internal-gdi-safety-survey-question',
	'privacyPolicy' => 'ext-quicksurveys-internal-gdi-safety-survey-privacy-policy',
	'answers' => [
		'ext-quicksurveys-internal-gdi-safety-survey-answer-positive',
		'ext-quicksurveys-internal-gdi-safety-survey-answer-negative',
		'ext-quicksurveys-internal-gdi-safety-survey-answer-neutral',
	],
	'audience' => [
		// T311079
		'minEdits' => 5
	],
	'enabled' => true,
	'coverage' => 0.2, // T311079
	'platforms' => [
		'desktop' => [ 'stable' ],
		'mobile' => [ 'stable', 'beta' ],
	],
],

Confirming coverage
EN: 0.03 (3%)
ES: 0.1 (10%)
FR: 0.1 (10%)
PT: 0.2 (20%)
FA: 0.2 (20%)
All wikis should target logged in editors with a minimum of 5 edits.

Testing and QA steps

  • Open to TST for QA input (likely confirm on beta first, as well as confirming edit count bucket upon impression is working?)

Acceptance Criteria

  • Survey is deployed on enwiki, eswiki, fawiki, frwiki and ptwiki, estimated June 24th, to run for a minimum of 7 days.

Event Timeline

Change 807211 had a related patch set uploaded (by Eigyan; author: Eigyan):

[operations/mediawiki-config@master] [wmf-config]: Deploy GDI Survey Wave 2 - BETA

https://gerrit.wikimedia.org/r/807211

Change 807211 merged by jenkins-bot:

[operations/mediawiki-config@master] [wmf-config]: Deploy GDI Survey Wave 2 - BETA

https://gerrit.wikimedia.org/r/807211

Mentioned in SAL (#wikimedia-operations) [2022-06-22T13:09:10Z] <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings-labs.php: Config: [[gerrit:807211|[wmf-config]: Deploy GDI Survey Wave 2 - BETA (T311079)]] (duration: 03m 29s)

eigyan renamed this task from Deploy GDI Safety Survey Wave 2 on EN, ES, FA, FR, and PT wikis to Deploy GDI Safety Survey Wave 2 on EN, ES, FA, FR, and PT wikis - BETA.Jun 22 2022, 4:04 PM

I was able to confirm the Safety Survey was displaying and functioning at the Beta sites for EN, and FA wikis using the following urls: (https://en.wikipedia.beta.wmflabs.org), (https://fa.wikipedia.beta.wmflabs.org)...

I was also able to see the eventlogging of those surveys at the https://stream-beta.wmflabs.org/v2/ui/#/?streams=eventlogging_QuickSurveyInitiation, and https://stream-beta.wmflabs.org/v2/ui/#/?streams=eventlogging_QuickSurveysResponses...

I was not able to test the ES, FR, and PT surveys in Beta due to some issues with the Beta site...

After discussion of the ES wiki issue with @eigyan whom spoke with @TAndic, it was decided that we will forgo the remaining Beta testing for the ES, FR, PT surveys.


Compatibility Testing was performed on the following:
Desktop – Firefox version 99 Windows 10 & 11 / Chrome version 101 Windows 10 & 11 / Microsoft Edge version 101 Windows 10 & 11 / Safari version 15.3 Mac OS Monterey / Opera version 88 Windows 10.
Mobile Devices – iOS version 15.5 iPad Pro 9th generation / iOS version 15.5 iPhone 13 / Android version 12 Samsung Galaxy S22 Ultra / Android version 12 Galaxy Tab S8 tablet.


Below are some screenshots on various browsers and mobile devices:

(NOTE: please disregard blurriness of screenshots, this is due to device simulation):

image.png (879×455 px, 181 KB)
image.png (891×459 px, 178 KB)

image.png (737×1 px, 535 KB)
image.png (729×1 px, 607 KB)

image.png (604×903 px, 148 KB)
image.png (879×584 px, 262 KB)

image.png (892×635 px, 162 KB)

image.png (450×886 px, 100 KB)
image.png (913×1 px, 197 KB)

image.png (940×1 px, 165 KB)
image.png (923×1 px, 141 KB)

image.png (915×529 px, 148 KB)
image.png (892×1 px, 614 KB)

@Djackson-ctr currently we are unable to view the screenshots and I think that is based on the new security permissions enabled in phab.

In the meantime, view permissions can be changed by going to the file url (eg phabricator.wikimedia,com/F###). then selecting “Edit file” and changing the dropdown “Visible To: Public (No Login Required)”

as mentioned in https://wikimedia.slack.com/archives/C027DTMLTLG/p1655491450189059

Thank you @eigyan for the info regarding the screenshots... Screenshots are now viewable to the Public.

This is good to go from perf perspective, we did an analysis just last week (ref T311015). Please let us know if there are major differences (e.g. custom UI, or no sampling) but otherwise good to go.