Page MenuHomePhabricator

Flaky Selenium test: Special:WelcomeSurvey.stores responses for users with NONE group when survey is submitted
Closed, ResolvedPublic

Description

00:05:32.582 [0-2] RUNNING in chrome - /tests/selenium/specs/welcomesurvey.js
00:05:33.720 [0-2] AssertionError in "Special:WelcomeSurvey.stores responses for users with NONE group when survey is submitted"
00:05:42.085 AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
00:05:42.085 + actual - expected
00:05:42.085 
00:05:42.085 + undefined
00:05:42.085 - 'placeholder'
00:05:42.085     at Context.<anonymous> (/workspace/src/extensions/GrowthExperiments/tests/selenium/specs/welcomesurvey.js:24:10)
00:05:42.085     at runMicrotasks (<anonymous>)
00:05:42.085     at processTicksAndRejections (internal/process/task_queues.js:95:5)
00:05:42.085 [0-2] RETRYING after 3s in chrome - /tests/selenium/specs/welcomesurvey.js
00:05:42.229 [0-2] RUNNING in chrome - /tests/selenium/specs/welcomesurvey.js
00:05:46.399 [0-2] AssertionError in "Special:WelcomeSurvey.stores responses for users with NONE group when survey is submitted"
00:05:54.282 AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
00:05:54.282 + actual - expected
00:05:54.282 
00:05:54.282 + undefined
00:05:54.282 - 'placeholder'
00:05:54.282     at Context.<anonymous> (/workspace/src/extensions/GrowthExperiments/tests/selenium/specs/welcomesurvey.js:24:10)
00:05:54.282     at runMicrotasks (<anonymous>)
00:05:54.282     at processTicksAndRejections (internal/process/task_queues.js:95:5)
00:05:54.282 [0-2] RETRYING after 3s in chrome - /tests/selenium/specs/welcomesurvey.js (1 retries)
00:05:54.428 [0-2] RUNNING in chrome - /tests/selenium/specs/welcomesurvey.js
00:05:58.561 [0-2] AssertionError in "Special:WelcomeSurvey.stores responses for users with NONE group when survey is submitted"
00:06:06.854 AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
00:06:06.854 + actual - expected
00:06:06.854 
00:06:06.854 + undefined
00:06:06.854 - 'placeholder'
00:06:06.855     at Context.<anonymous> (/workspace/src/extensions/GrowthExperiments/tests/selenium/specs/welcomesurvey.js:24:10)
00:06:06.855     at runMicrotasks (<anonymous>)
00:06:06.855     at processTicksAndRejections (internal/process/task_queues.js:95:5)
00:06:06.855 [0-2] FAILED in chrome - /tests/selenium/specs/welcomesurvey.js (2 retries)
00:06:07.001

https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php72-docker/135684/console

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Change 761882 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/GrowthExperiments@master] [WIP] Replace welcomesurvey Selenium test with PHPUnit integration test

https://gerrit.wikimedia.org/r/761882

kostajh triaged this task as Medium priority.Feb 11 2022, 12:24 PM
kostajh moved this task from Incoming to Code Review on the Growth-Team (Current Sprint) board.

Change 761882 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] Replace welcomesurvey Selenium test with PHPUnit integration test

https://gerrit.wikimedia.org/r/761882