Page MenuHomePhabricator

Test new QuickSurveys features on testwiki
Closed, ResolvedPublic

Description

Context

With new features implemented for the QuickSurveys tool (T362640: [Epic] Improve the capabilities of QuickSurveys to enhance our ability to collect valuable insights.), we should test whether the features are functional on testwiki. We will do this by asking a 2-question example safety survey.

Configuration

Questions

mediawiki links in parentheses for each question and option

Question 1: In the last 30 days, have you felt unsafe or uncomfortable contributing to Wikipedia (test.wikipedia.org)? (https://test.wikipedia.org/wiki/MediaWiki:Safety-survey-testQ1 - Note: question will say that this is a test survey, that is intentional)

  • Q1Response: use defaults Yes/No/Unsure

Question 2: Can you tell us why you felt unsafe or uncomfortable? Select all that apply. (https://test.wikipedia.org/wiki/MediaWiki:Safety-survey-testQ2)

Acknowledging that this list is quite long: Feel welcome to cut as many response options as needed, as long as Q2A9 and Q2Aother-open are kept (so we can test the write-in)

Other settings:
  • Wiki to display on: testwiki
  • Display percent: 80% (0.8)
    • QUESTION HERE: Should we just display on one page? If we feel comfortable that random selection is still functional, we can deploy the survey on one page to test the backend
  • Logged in status: Logged in users only
  • No editing criteria (as most people testing (WMF staff) will not have edited testwiki)
Open questions from my side:
  • I am unsure where default messaging, such as the end survey message which is now configurable, might "live" - does it need to likewise go through MediaWiki messages for each wiki or is there some other space that stable messaging occupies? (I haven't used these in the past as they weren't configurable)

Event Timeline

Change #1050441 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[operations/mediawiki-config@master] QuickSurveys: Add testing survey configuration

https://gerrit.wikimedia.org/r/1050441

Change #1050441 merged by jenkins-bot:

[operations/mediawiki-config@master] QuickSurveys: Add testing survey configuration

https://gerrit.wikimedia.org/r/1050441

Mentioned in SAL (#wikimedia-operations) [2024-06-27T20:20:00Z] <jhuneidi@deploy1002> Started scap: Backport for [[gerrit:1050441|QuickSurveys: Add testing survey configuration (T368459)]]

Mentioned in SAL (#wikimedia-operations) [2024-06-27T20:22:21Z] <jhuneidi@deploy1002> kharlan, jhuneidi: Backport for [[gerrit:1050441|QuickSurveys: Add testing survey configuration (T368459)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Change #1050460 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[operations/mediawiki-config@master] testwiki: Enable QuickSurveys

https://gerrit.wikimedia.org/r/1050460

Change #1050460 merged by jenkins-bot:

[operations/mediawiki-config@master] testwiki: Enable QuickSurveys

https://gerrit.wikimedia.org/r/1050460

Mentioned in SAL (#wikimedia-operations) [2024-06-27T20:34:46Z] <jhuneidi@deploy1002> Finished scap: Backport for [[gerrit:1050441|QuickSurveys: Add testing survey configuration (T368459)]] (duration: 14m 45s)

Mentioned in SAL (#wikimedia-operations) [2024-06-27T20:35:32Z] <jhuneidi@deploy1002> Started scap: Backport for [[gerrit:1050460|testwiki: Enable QuickSurveys (T368459)]]

Mentioned in SAL (#wikimedia-operations) [2024-06-27T20:37:54Z] <jhuneidi@deploy1002> kharlan, jhuneidi: Backport for [[gerrit:1050460|testwiki: Enable QuickSurveys (T368459)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Mentioned in SAL (#wikimedia-operations) [2024-06-27T20:50:05Z] <jhuneidi@deploy1002> Finished scap: Backport for [[gerrit:1050460|testwiki: Enable QuickSurveys (T368459)]] (duration: 14m 33s)

This is now enabled on testwiki, for logged-in users, at 80% coverage.

survey.gif (690×1 px, 405 KB)

This is now enabled on testwiki, for logged-in users, at 80% coverage.

survey.gif (690×1 px, 405 KB)

@TAndic could you or someone from your team please review this and let us know if it looks as expected? Thank you. cc @TAdeleye_WMF

Thanks @kostajh, I've asked my team to test out the survey we can get some random data and check that everything is connecting correctly on the back end (they'll need a bit of time to see my message); if it's okay to leave it up over the weekend, we can undeploy on Monday?

Thanks @kostajh, I've asked my team to test out the survey we can get some random data and check that everything is connecting correctly on the back end (they'll need a bit of time to see my message); if it's okay to leave it up over the weekend, we can undeploy on Monday?

Yes of course! We can leave for longer next week as well.

Hi @kostajh and @TAdeleye_WMF -- I've successfully pulled the data and it's looking as expected (hooray!). I think the survey can be undeployed :) Let me know if I should make a separate ticket or if this one is sufficient.

Note for future users:

  • All questions will be grouped in one dataset (at least from the query I'm working with); questions can be distinguished by the surveyQuestionLabel, and answers can be combined using the survey session token (I imagine at a larger scale there may be some fuzz here, we'll see when we get a larger dataset)
  • Clicks that use the back button are recorded (if someone proceeds to a 2nd question and then clicks back and responds in another manner for their final answer, both first question responses are recorded); you will need to use some time-based deduction to decide which answer to keep as a final answer

Change #1051246 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[operations/mediawiki-config@master] Revert "QuickSurveys: Add testing survey configuration"

https://gerrit.wikimedia.org/r/1051246

Change #1051246 merged by jenkins-bot:

[operations/mediawiki-config@master] Revert "QuickSurveys: Add testing survey configuration"

https://gerrit.wikimedia.org/r/1051246

Mentioned in SAL (#wikimedia-operations) [2024-07-02T07:06:10Z] <kharlan@deploy1002> Started scap sync-world: Backport for [[gerrit:1051246|Revert "QuickSurveys: Add testing survey configuration" (T368459)]]

Mentioned in SAL (#wikimedia-operations) [2024-07-02T07:16:42Z] <kharlan@deploy1002> Started scap sync-world: Backport for [[gerrit:1051246|Revert "QuickSurveys: Add testing survey configuration" (T368459)]]

Mentioned in SAL (#wikimedia-operations) [2024-07-02T07:51:54Z] <kharlan@deploy1002> kharlan: Backport for [[gerrit:1051246|Revert "QuickSurveys: Add testing survey configuration" (T368459)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Mentioned in SAL (#wikimedia-operations) [2024-07-02T07:58:27Z] <kharlan@deploy1002> Finished scap: Backport for [[gerrit:1051246|Revert "QuickSurveys: Add testing survey configuration" (T368459)]] (duration: 41m 45s)

Test survey was deployed, reviewed, and undeployed. Marking this as resolved.