Page MenuHomePhabricator
Create Task
Maniphest T299339

"Echo.checks for welcome message after signup" Selenium test randomly fails
Open, Needs TriagePublic
Actions

Description

Two Selenium gate-and-submit builds (#96757 for change 731277, and #96764 for change 748299) have failed with the same errors:

[0-0] Error in "Echo.checks for welcome message after signup"
Error: element (".mw-echo-ui-notificationItemWidget-content-message-header") still not displayed after 5000ms
    at /workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/webdriverio/build/commands/browser/waitUntil.js:66:23
    at async Element.wrapCommandFn (/workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/@wdio/utils/build/shim.js:131:29)
    at async Element.elementErrorHandlerCallbackFn (/workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/webdriverio/build/middlewares.js:24:32)
    at async Element.wrapCommandFn (/workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/@wdio/utils/build/shim.js:131:29)
    at async Element.wrapCommandFn (/workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/@wdio/utils/build/shim.js:131:29)
    at async Element.elementErrorHandlerCallbackFn (/workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/webdriverio/build/middlewares.js:24:32)
    at async Element.wrapCommandFn (/workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/@wdio/utils/build/shim.js:131:29)
    at async Context.<anonymous> (/workspace/src/extensions/Echo/tests/selenium/specs/echo.js:56:3)
[0-0] RETRYING in chrome - /tests/selenium/specs/echo.js
[0-0] RUNNING in chrome - /tests/selenium/specs/echo.js
[0-0] Error in "Echo.checks for welcome message after signup"
Error: element (".mw-echo-ui-notificationItemWidget-content-message-header") still not displayed after 5000ms
    at /workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/webdriverio/build/commands/browser/waitUntil.js:66:23
    at async Element.wrapCommandFn (/workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/@wdio/utils/build/shim.js:131:29)
    at async Element.elementErrorHandlerCallbackFn (/workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/webdriverio/build/middlewares.js:24:32)
    at async Element.wrapCommandFn (/workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/@wdio/utils/build/shim.js:131:29)
    at async Element.wrapCommandFn (/workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/@wdio/utils/build/shim.js:131:29)
    at async Element.elementErrorHandlerCallbackFn (/workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/webdriverio/build/middlewares.js:24:32)
    at async Element.wrapCommandFn (/workspace/src/extensions/Echo/node_modules/@wdio/runner/node_modules/@wdio/utils/build/shim.js:131:29)
    at async Context.<anonymous> (/workspace/src/extensions/Echo/tests/selenium/specs/echo.js:56:3)
[0-0] FAILED in chrome - /tests/selenium/specs/echo.js (1 retries)

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
selenium: reenable skipping of flaky testZabemediawiki/extensions/Echomaster+1 -1
selenium: Skip flaky testKosta Harlanmediawiki/extensions/Echomaster+1 -1
Customize query in gerrit

Related Objects
Search...

Event Timeline

Lucas_Werkmeister_WMDE created this task.Jan 17 2022, 12:03 PM
Restricted Application added a project: Growth-Team. · View Herald TranscriptJan 17 2022, 12:03 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Lucas_Werkmeister_WMDE triaged this task as Unbreak Now! priority.Jan 17 2022, 12:06 PM
Lucas_Werkmeister_WMDE edited projects, added: ci-test-error (WMF-deployed Build Failure); removed: ci-test-error.

Also happened at #96770 for change 743951. Since it affects at least three extensions, and seems to happen fairly regularly (though I’m not sure if it always happens), I think it can count as UBN.

Lucas_Werkmeister_WMDE added subscribers: Osamaahmed17, kostajh, • zeljkofilipin.Jan 17 2022, 12:07 PM

Timing is suspiciously close to T293073: Refactor Echo WebdriverIO tests from sync to async mode so CCing some people there.

kostajh added a comment.Jan 17 2022, 12:20 PM
In T299339#7625710, @Lucas_Werkmeister_WMDE wrote:

Timing is suspiciously close to T293073: Refactor Echo WebdriverIO tests from sync to async mode so CCing some people there.

Right, I was about to say that is probably the cause. Having a look.

gerritbot added a comment.Jan 17 2022, 12:21 PM

Change 754491 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[mediawiki/extensions/Echo@master] selenium: Skip flaky test

https://gerrit.wikimedia.org/r/754491

gerritbot added a project: Patch-For-Review.Jan 17 2022, 12:21 PM
Zabe subscribed.Jan 17 2022, 12:46 PM
gerritbot added a comment.Jan 17 2022, 12:49 PM

Change 754491 merged by jenkins-bot:

[mediawiki/extensions/Echo@master] selenium: Skip flaky test

https://gerrit.wikimedia.org/r/754491

Nikerabbit subscribed.Jan 17 2022, 1:00 PM
ReleaseTaggerBot added a project: MW-1.38-notes (1.38.0-wmf.18; 2022-01-17).Jan 17 2022, 1:00 PM
Maintenance_bot removed a project: Patch-For-Review.Jan 17 2022, 1:10 PM
kostajh added a comment.Jan 17 2022, 1:34 PM

@Lucas_Werkmeister_WMDE are you still seeing instances of this?

Ammarpad subscribed.EditedJan 17 2022, 2:48 PM

I think it's still happening. This https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php72-docker/130838/console is new (from r754477)

Lucas_Werkmeister_WMDE added a comment.Jan 17 2022, 3:13 PM

Also happened again in #96819 just now.

Lucas_Werkmeister_WMDE added a comment.Jan 17 2022, 3:27 PM

And now it happened in two jobs for the same gate-and-submit build: quibble-vendor-mysql-php72-selenium-docker #96819 and wmf-quibble-selenium-php72-docker #130845.

gerritbot added a comment.Jan 17 2022, 3:27 PM

Change 754527 had a related patch set uploaded (by Zabe; author: Zabe):

[mediawiki/extensions/Echo@master] selenium: reenable skipping of flaky test

https://gerrit.wikimedia.org/r/754527

gerritbot added a project: Patch-For-Review.Jan 17 2022, 3:27 PM
Zabe added a comment.Jan 17 2022, 3:28 PM

https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Echo/+/754492 seems to not have fixed the issue.

gerritbot added a comment.Jan 17 2022, 4:25 PM

Change 754527 merged by jenkins-bot:

[mediawiki/extensions/Echo@master] selenium: reenable skipping of flaky test

https://gerrit.wikimedia.org/r/754527

Maintenance_bot removed a project: Patch-For-Review.Jan 17 2022, 5:10 PM
• zeljkofilipin added a project: User-zeljkofilipin.Jan 17 2022, 6:32 PM

Is this still unbreak now?

• zeljkofilipin moved this task from Backlog 🪒 to Deep work 🌊 on the User-zeljkofilipin board.Jan 17 2022, 6:32 PM
Zabe lowered the priority of this task from Unbreak Now! to High.Jan 17 2022, 6:33 PM
In T299339#7626728, @zeljkofilipin wrote:

Is this still unbreak now?

Imo no since we are skipping the flaky test for now.

Tgr moved this task from Inbox to Needs Discussion on the Growth-Team board.Jan 21 2022, 9:49 AM
Ammarpad unsubscribed.Feb 5 2022, 8:26 AM
• zeljkofilipin moved this task from Deep work 🌊 to Quarter 👔 on the User-zeljkofilipin board.Feb 8 2022, 4:45 PM
• zeljkofilipin moved this task from Quarter 👔 to Backlog 🪒 on the User-zeljkofilipin board.Apr 29 2022, 12:23 PM
MShilova_WMF moved this task from Needs Discussion to Triaged on the Growth-Team board.Aug 9 2022, 4:57 PM
• zeljkofilipin raised the priority of this task from High to Needs Triage.Oct 31 2023, 4:15 PM
• zeljkofilipin edited projects, added: Browser-Tests; removed: User-zeljkofilipin.Jan 13 2025, 11:22 AM
• zeljkofilipin added a parent task: T291254: Find flaky Selenium tests.Mar 20 2025, 10:44 AM
Urbanecm_WMF removed a project: Growth-Team.Aug 19 2026, 3:20 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits