Change Details

Failure on https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php74-docker/30554/console The failure was for a patch set of the Translate extension, the test definition is in GrowthExperiments extension. ``` » /tests/selenium/specs/addimage.js add image ✓ desktop: user can view image info and image details ✖ mobile: user can close the image suggestion UI 1 passing (1m 16.6s) 1 failing 1) add image mobile: user can close the image suggestion UI Timeout of 60000ms exceeded. The execution in the test "add image mobile: user can close the image suggestion UI" took too long. Try to reduce the run time or increase your timeout for test specs (https://webdriver.io/docs/timeouts). (/workspace/src/extensions/GrowthExperiments/tests/selenium/specs/addimage.js) Error: Timeout of 60000ms exceeded. The execution in the test "add image mobile: user can close the image suggestion UI" took too long. Try to reduce the run time or increase your timeout for test specs (https://webdriver.io/docs/timeouts). (/workspace/src/extensions/GrowthExperiments/tests/selenium/specs/addimage.js) at createTimeoutError (/workspace/src/extensions/GrowthExperiments/node_modules/mocha/lib/errors.js:498:15) at Test.Runnable._timeoutError (/workspace/src/extensions/GrowthExperiments/node_modules/mocha/lib/runnable.js:431:10) at Timeout.<anonymous> (/workspace/src/extensions/GrowthExperiments/node_modules/mocha/lib/runnable.js:246:24) at listOnTimeout (internal/timers.js:557:17) at processTimers (internal/timers.js:500:7) ``` Video of the timeout https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php74-docker/30554/artifact/log/add-image-mobile%253A-user-can-close-the-image-suggestion-UI-2023-04-12T19-58-40-751Z.mp4

Some of the Selenium tests seem to be flaky. I ran into similar issues regularly lately. See https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php74/49261/console or https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php74/48774/console ```counterexample 10:31:37 [0-0] Error in "add image.desktop: user can view image info and image details" 10:31:37 Evaluation failed: notloggedin 10:31:37 Error: Evaluation failed: notloggedin 10:31:37 at ExecutionContext._evaluateInternal (/workspace/src/extensions/GrowthExperiments/node_modules/puppeteer-core/lib/cjs/puppeteer/common/ExecutionContext.js:221:19) 10:31:37 at process.processTicksAndRejections (node:internal/process/task_queues:95:5) 10:31:37 at async ExecutionContext.evaluate (/workspace/src/extensions/GrowthExperiments/node_modules/puppeteer-core/lib/cjs/puppeteer/common/ExecutionContext.js:110:16) 10:31:37 at async ElementHandle.evaluate (/workspace/src/extensions/GrowthExperiments/node_modules/puppeteer-core/lib/cjs/puppeteer/common/JSHandle.js:107:16) 10:31:37 at async ElementHandle.$eval (/workspace/src/extensions/GrowthExperiments/node_modules/puppeteer-core/lib/cjs/puppeteer/common/JSHandle.js:810:24) 10:31:37 at async DevToolsDriver.executeScript (/workspace/src/extensions/GrowthExperiments/node_modules/devtools/build/commands/executeScript.js:39:20) 10:31:37 at async Browser.wrappedCommand (/workspace/src/extensions/GrowthExperiments/node_modules/devtools/build/devtoolsdriver.js:102:26) 10:31:37 at async AddImageArticlePage.setup (/workspace/src/extensions/GrowthExperiments/tests/selenium/pageobjects/addimage.article.page.js:84:3) 10:31:37 at async Context.<anonymous> (/workspace/src/extensions/GrowthExperiments/tests/selenium/specs/addimage.js:19:3) ``` and ```counterexample 11:32:29 [0-1] Error in "add link.link inspector can be used to accept/reject links and save an article." 11:32:29 Error: element (".mw-ge-recommendedLinkToolbarDialog") still not clickable after 30000ms 11:32:29 at process.processTicksAndRejections (node:internal/process/task_queues:95:5) 11:32:29 at async AddLinkArticlePage.waitForDisplayedAndClickable (/workspace/src/extensions/GrowthExperiments/tests/selenium/pageobjects/addlink.article.page.js:113:3) 11:32:29 at async AddLinkArticlePage.waitForLinkInspector (/workspace/src/extensions/GrowthExperiments/tests/selenium/pageobjects/addlink.article.page.js:64:3) 11:32:29 at async Context.<anonymous> (/workspace/src/extensions/GrowthExperiments/tests/selenium/specs/addlink.js:32:3) ``` and ```counterexample 11:32:46 [0-1] Error in "add link.link inspector can be used to accept/reject links and save an article." 11:32:46 Error: Can't call getText on element with selector ".se-card-title" because element wasn't found 11:32:46 at async Context.<anonymous> (/workspace/src/extensions/GrowthExperiments/tests/selenium/specs/addlink.js:20:23) ```

Failure onSome of the Selenium tests seem to be flaky. I ran into similar issues regularly lately. See https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php74-docker/30554/49261/console The failure was for a patch set of the Translate extension, the test definition is in GrowthExperiments extension.or https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php74/48774/console ```counterexample » /tests/selenium/specs/add10:31:37 [0-0] Error in "add image.desktop: user can view image info and image.jse details" add image10:31:37 Evaluation failed: notloggedin ✓ desktop: user can view image info and image details10:31:37 Error: Evaluation failed: notloggedin ✖ mobile: user can close the image suggestion UI 1 passing (1m 16.6s10:31:37 at ExecutionContext._evaluateInternal (/workspace/src/extensions/GrowthExperiments/node_modules/puppeteer-core/lib/cjs/puppeteer/common/ExecutionContext.js:221:19) 1 failing 1) add image mobile: user can close the image suggestion UI10:31:37 at process.processTicksAndRejections (node:internal/process/task_queues:95:5) 10:31:37 at async ExecutionContext.evaluate (/workspace/src/extensions/GrowthExperiments/node_modules/puppeteer-core/lib/cjs/puppeteer/common/ExecutionContext.js:110:16) 10:31:37 at async ElementHandle.evaluate (/workspace/src/extensions/GrowthExperiments/node_modules/puppeteer-core/lib/cjs/puppeteer/common/JSHandle.js:107:16) 10:31:37 at async ElementHandle.$eval (/workspace/src/extensions/GrowthExperiments/node_modules/puppeteer-core/lib/cjs/puppeteer/common/JSHandle.js:810:24) 10:31:37 at async DevToolsDriver.executeScript (/workspace/src/extensions/GrowthExperiments/node_modules/devtools/build/commands/executeScript.js:39:20) 10:31:37 at async Browser.wrappedCommand (/workspace/src/extensions/GrowthExperiments/node_modules/devtools/build/devtoolsdriver.js:102:26) 10:31:37 at async AddImageArticlePage.setup (/workspace/src/extensions/GrowthExperiments/tests/selenium/pageobjects/addimage.article.page.js:84:3) Timeout of 60000ms exceeded. The execution in the test "add image mobile: user can close the image suggestion UI" took too long. Try to reduce the run time or increase your timeout for test specs (https://webdriver.io/docs/timeouts). (/workspace/src/extensions/GrowthExperiments/tests/selenium/specs/addimage.js10:31:37 at async Context.<anonymous> (/workspace/src/extensions/GrowthExperiments/tests/selenium/specs/addimage.js:19:3) Error: Timeout of 60000ms exceeded. The execution in the test "add image mobile: user can close the image suggestion UI" took too long. Try to reduce the run time or increase your timeout for test specs (https://webdriver.io/docs/timeouts). (/workspace/src/extensions/GrowthExperiments/tests/selenium/specs/addimage.js)``` and ```counterexample at createTimeout11:32:29 [0-1] Error (/workspace/src/extensions/GrowthExperiments/node_modules/mocha/lib/errors.js:498:15)in "add link.link inspector can be used to accept/reject links and save an article." at Test.Runnable._timeoutError (/workspace/src/extensions/GrowthExperiments/node_modules/mocha/lib/runn11:32:29 Error: element (".mw-ge-recommendedLinkToolbarDialog") still not clickable.js:431:10) after 30000ms at Timeout.<anonymous> (/workspace/src/extens11:32:29 at process.processTicksAndRejections/GrowthExperiments/node_modules/mocha/lib/runnable.js:246:24 (node:internal/process/task_queues:95:5) at listOnTimeout (internal/timers.js:557:1711:32:29 at async AddLinkArticlePage.waitForDisplayedAndClickable (/workspace/src/extensions/GrowthExperiments/tests/selenium/pageobjects/addlink.article.page.js:113:3) at processTimers (internal/timers.js:500:711:32:29 at async AddLinkArticlePage.waitForLinkInspector (/workspace/src/extensions/GrowthExperiments/tests/selenium/pageobjects/addlink.article.page.js:64:3) 11:32:29 at async Context.<anonymous> (/workspace/src/extensions/GrowthExperiments/tests/selenium/specs/addlink.js:32:3) ``` and ```counterexample 11:32:46 [0-1] Error in "add link.link inspector can be used to accept/reject links and save an article." Video of the timeout11:32:46 Error: Can't call getText on element with selector ".se-card-title" because element wasn't found https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php74-docker/30554/artifact/log/add-image-mobile%253A-user-can-close-the-image-suggestion-UI-2023-04-12T19-58-40-751Z.mp411:32:46 at async Context.<anonymous> (/workspace/src/extensions/GrowthExperiments/tests/selenium/specs/addlink.js:20:23) ```