Page MenuHomePhabricator
Create Task
Maniphest T385449

Selenium test "Client Hints stores client hints data on logout" is flaky
Closed, ResolvedPublic
Actions

Description

Seen in this gate-and-submit (for this change):

[0-2] Error in "Client Hints.stores client hints data on logout"
Error: Expect $(`.mw-checkuser-get-actions-results`).$(`li*=Successfully logged out`) to exist

Expected: "exist"
Received: "not exist"
    at Context.<anonymous> (/workspace/src/extensions/CheckUser/tests/selenium/specs/clienthints.js:161:38)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[0-2] RETRYING in chrome - /tests/selenium/specs/clienthints.js
[0-2] RUNNING in chrome - /tests/selenium/specs/clienthints.js
[0-2] Error in "Client Hints.stores client hints data on logout"
Error: Expect $(`.mw-checkuser-get-actions-results`).$(`li*=Successfully logged out`) to exist

Expected: "exist"
Received: "not exist"
    at Context.<anonymous> (/workspace/src/extensions/CheckUser/tests/selenium/specs/clienthints.js:161:38)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
[0-2] FAILED in chrome - /tests/selenium/specs/clienthints.js (1 retries)

…

[Chrome 90.0.4430.212 linux #0-2] Running: Chrome (v90.0.4430.212) on linux
[Chrome 90.0.4430.212 linux #0-2] Session ID: c414e9fb-e406-4559-b6e6-ba1ccc741a4b
[Chrome 90.0.4430.212 linux #0-2]
[Chrome 90.0.4430.212 linux #0-2] » /tests/selenium/specs/clienthints.js
[Chrome 90.0.4430.212 linux #0-2] Client Hints
[Chrome 90.0.4430.212 linux #0-2]    ✓ Verify edit sends Client Hints data
[Chrome 90.0.4430.212 linux #0-2]    ✓ stores client hints data on successful logins
[Chrome 90.0.4430.212 linux #0-2]    ✓ stores client hints data on account creation
[Chrome 90.0.4430.212 linux #0-2]    ✖ stores client hints data on logout
[Chrome 90.0.4430.212 linux #0-2]    ✓ stores client hints data on temporary account auto-creation
[Chrome 90.0.4430.212 linux #0-2]
[Chrome 90.0.4430.212 linux #0-2] 4 passing (35.6s)
[Chrome 90.0.4430.212 linux #0-2] 1 failing
[Chrome 90.0.4430.212 linux #0-2]
[Chrome 90.0.4430.212 linux #0-2] 1) Client Hints stores client hints data on logout
[Chrome 90.0.4430.212 linux #0-2] Expect $(`.mw-checkuser-get-actions-results`).$(`li*=Successfully logged out`) to exist

Expected: "exist"
Received: "not exist"
[Chrome 90.0.4430.212 linux #0-2] Error: Expect $(`.mw-checkuser-get-actions-results`).$(`li*=Successfully logged out`) to exist
[Chrome 90.0.4430.212 linux #0-2]
[Chrome 90.0.4430.212 linux #0-2] Expected: "exist"
[Chrome 90.0.4430.212 linux #0-2] Received: "not exist"
[Chrome 90.0.4430.212 linux #0-2]     at Context.<anonymous> (/workspace/src/extensions/CheckUser/tests/selenium/specs/clienthints.js:161:38)
[Chrome 90.0.4430.212 linux #0-2]     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
------------------------------------------------------------------
[Chrome 90.0.4430.212 linux #0-2] Running: Chrome (v90.0.4430.212) on linux
[Chrome 90.0.4430.212 linux #0-2] Session ID: 3d871bdc-f193-459a-be66-16b929b39819
[Chrome 90.0.4430.212 linux #0-2]
[Chrome 90.0.4430.212 linux #0-2] » /tests/selenium/specs/clienthints.js
[Chrome 90.0.4430.212 linux #0-2] Client Hints
[Chrome 90.0.4430.212 linux #0-2]    ✓ Verify edit sends Client Hints data
[Chrome 90.0.4430.212 linux #0-2]    ✓ stores client hints data on successful logins
[Chrome 90.0.4430.212 linux #0-2]    ✓ stores client hints data on account creation
[Chrome 90.0.4430.212 linux #0-2]    ✖ stores client hints data on logout
[Chrome 90.0.4430.212 linux #0-2]    ✓ stores client hints data on temporary account auto-creation
[Chrome 90.0.4430.212 linux #0-2]
[Chrome 90.0.4430.212 linux #0-2] 4 passing (32.3s)
[Chrome 90.0.4430.212 linux #0-2] 1 failing
[Chrome 90.0.4430.212 linux #0-2]
[Chrome 90.0.4430.212 linux #0-2] 1) Client Hints stores client hints data on logout
[Chrome 90.0.4430.212 linux #0-2] Expect $(`.mw-checkuser-get-actions-results`).$(`li*=Successfully logged out`) to exist

Expected: "exist"
Received: "not exist"
[Chrome 90.0.4430.212 linux #0-2] Error: Expect $(`.mw-checkuser-get-actions-results`).$(`li*=Successfully logged out`) to exist
[Chrome 90.0.4430.212 linux #0-2]
[Chrome 90.0.4430.212 linux #0-2] Expected: "exist"
[Chrome 90.0.4430.212 linux #0-2] Received: "not exist"
[Chrome 90.0.4430.212 linux #0-2]     at Context.<anonymous> (/workspace/src/extensions/CheckUser/tests/selenium/specs/clienthints.js:161:38)
[Chrome 90.0.4430.212 linux #0-2]     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)


Spec Files:	 3 passed, 1 retries, 1 failed, 4 total (100% completed) in 00:01:11

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
selenium: Remove redundant navigation from logout stepMáté Szabómediawiki/extensions/CheckUsermaster+1 -11
Remove selenium dependencies from package.jsonDreamy Jazzmediawiki/extensions/CheckUsermaster+2 -4 K
Drop all selenium testsDreamy Jazzmediawiki/extensions/CheckUsermaster+1 -483
selenium: Skip flaky testDaimona Eaytoymediawiki/extensions/CheckUsermaster+2 -1
selenium: Document when, how and why the test is skippedZfilipinmediawiki/extensions/CheckUsermaster+1 -1
WIP selenium: Find flaky testsZfilipinmediawiki/extensions/CheckUsermaster+2 -1
selenium: use createAndPromote.php to create test accountMáté Szabómediawiki/extensions/CheckUsermaster+31 -82
WiPHarroyo-wmfmediawiki/extensions/CheckUsermaster+16 -8
Skip "Client Hints stores client hints data on logout" selenium testDreamy Jazzmediawiki/extensions/CheckUsermaster+2 -1
Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Dreamy_Jazz added a comment.Feb 20 2025, 5:54 PM

I've not got the time to find a fix as of yet, so I'm going to skip the flaky test until there is time to take a look at this further.

Dreamy_Jazz moved this task from Priority Backlog to In Progress on the Trust and Safety Product Sprint (Sprint Hurdy-Gurdy (Feb 10 - Feb 28)) board.Feb 20 2025, 5:55 PM
gerritbot added a comment.Feb 20 2025, 5:58 PM

Change #1121412 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/CheckUser@master] Skip "Client Hints stores client hints data on logout" selenium test

https://gerrit.wikimedia.org/r/1121412

gerritbot added a project: Patch-For-Review.Feb 20 2025, 5:58 PM
Dreamy_Jazz moved this task from In Progress to Needs Review on the Trust and Safety Product Sprint (Sprint Hurdy-Gurdy (Feb 10 - Feb 28)) board.Feb 20 2025, 6:04 PM
Dreamy_Jazz moved this task from Needs Review to Priority Backlog on the Trust and Safety Product Sprint (Sprint Hurdy-Gurdy (Feb 10 - Feb 28)) board.Feb 20 2025, 6:06 PM

Moving back to backlog for looking into a fix for the test at a later date.

gerritbot added a comment.Feb 20 2025, 6:26 PM

Change #1121412 merged by jenkins-bot:

[mediawiki/extensions/CheckUser@master] Skip "Client Hints stores client hints data on logout" selenium test

https://gerrit.wikimedia.org/r/1121412

Maintenance_bot removed a project: Patch-For-Review.Feb 20 2025, 6:30 PM
ReleaseTaggerBot added a project: MW-1.44-notes (1.44.0-wmf.18; 2025-02-25).Feb 20 2025, 7:00 PM
kostajh subscribed.Feb 26 2025, 2:31 PM

If we think it's related to running the tests in parallel, should we do the easy thing and un-parallelize the test runs?

Dreamy_Jazz added a comment.Feb 26 2025, 2:55 PM
In T385449#10583108, @kostajh wrote:

If we think it's related to running the tests in parallel, should we do the easy thing and un-parallelize the test runs?

My thinking is that it could be the parallel test runs, but I'm not 100% sure as it still fails on a re-try (which should not have issues of parallelisation AFIAK).

• hector.arroyo changed the task status from Open to In Progress.Feb 27 2025, 12:53 PM
• hector.arroyo claimed this task.
• hector.arroyo moved this task from Priority Backlog to In Progress on the Trust and Safety Product Sprint (Sprint Hurdy-Gurdy (Feb 10 - Feb 28)) board.
gerritbot added a comment.Feb 27 2025, 1:00 PM

Change #1123358 had a related patch set uploaded (by Harroyo-wmf; author: Harroyo-wmf):

[mediawiki/extensions/CheckUser@master] WiP

https://gerrit.wikimedia.org/r/1123358

gerritbot added a project: Patch-For-Review.Feb 27 2025, 1:00 PM
zeljkofilipin added projects: Test Platform (The First One 1), User-zeljkofilipin.Feb 27 2025, 6:07 PM
zeljkofilipin moved this task from Backlog to Ready on the Test Platform (The First One 1) board.
zeljkofilipin moved this task from Backlog 🪒 to Deep work 🌊 on the User-zeljkofilipin board.
gerritbot added a comment.Feb 28 2025, 1:49 PM

Change #1123651 had a related patch set uploaded (by Zfilipin; author: Zfilipin):

[mediawiki/extensions/CheckUser@master] WIP selenium: Find flaky tests

https://gerrit.wikimedia.org/r/1123651

Dreamy_Jazz moved this task from Sprint Hurdy-Gurdy (Feb 10 - Feb 28) to Sprint Lemon Meringue (March 3 - 21) on the Trust and Safety Product Sprint board.Mar 3 2025, 3:53 PM
Dreamy_Jazz edited projects, added: Trust and Safety Product Sprint (Sprint Lemon Meringue (March 3 - 21)); removed: Trust and Safety Product Sprint (Sprint Hurdy-Gurdy (Feb 10 - Feb 28)).
Dreamy_Jazz moved this task from Priority Backlog to In Progress on the Trust and Safety Product Sprint (Sprint Lemon Meringue (March 3 - 21)) board.
• hector.arroyo moved this task from In Progress to Ready on the Trust and Safety Product Sprint (Sprint Lemon Meringue (March 3 - 21)) board.Mar 4 2025, 9:26 AM
• hector.arroyo added a comment.Mar 4 2025, 11:59 AM

Unassigning myself since I was not able to reproduce it locally.

• hector.arroyo removed • hector.arroyo as the assignee of this task.Mar 4 2025, 12:00 PM
• hector.arroyo subscribed.
gerritbot added a comment.Mar 11 2025, 11:19 AM

Change #1123358 abandoned by Harroyo-wmf:

[mediawiki/extensions/CheckUser@master] WiP

https://gerrit.wikimedia.org/r/1123358

zeljkofilipin changed the task status from In Progress to Open.Mar 11 2025, 12:57 PM
zeljkofilipin edited projects, added: Test Platform (The Next One 2); removed: Test Platform (The First One 1).
zeljkofilipin moved this task from Deep work 🌊 to Quarter 👔 on the User-zeljkofilipin board.
zeljkofilipin added a project: Testing Support.Mar 11 2025, 1:38 PM
SDunlap assigned this task to zeljkofilipin.Mar 11 2025, 5:00 PM
SDunlap moved this task from Backlog to Ready on the Test Platform (The Next One 2) board.
gerritbot added a comment.Mar 14 2025, 1:50 PM

Change #1127899 had a related patch set uploaded (by Máté Szabó; author: Máté Szabó):

[mediawiki/extensions/CheckUser@master] selenium: Remove redundant navigation from logout step

https://gerrit.wikimedia.org/r/1127899

gerritbot added a comment.Mar 14 2025, 3:05 PM

Change #1127914 had a related patch set uploaded (by Máté Szabó; author: Máté Szabó):

[mediawiki/extensions/CheckUser@master] selenium: use createAndPromote.php to create test account

https://gerrit.wikimedia.org/r/1127914

gerritbot added a comment.Mar 18 2025, 11:21 AM

Change #1127914 merged by jenkins-bot:

[mediawiki/extensions/CheckUser@master] selenium: use createAndPromote.php to create test account

https://gerrit.wikimedia.org/r/1127914

ReleaseTaggerBot edited projects, added: MW-1.44-notes (1.44.0-wmf.22; 2025-03-25); removed: MW-1.44-notes (1.44.0-wmf.18; 2025-02-25).Mar 18 2025, 3:14 PM
Umherirrender added a project: Browser-Tests.Mar 22 2025, 9:49 AM
SDunlap edited projects, added: Test Platform (Tria 3); removed: Test Platform (The Next One 2).Mar 24 2025, 1:41 PM
Tchanders edited projects, added: Trust and Safety Product Sprint (Sprint Chocolate Cake (March 24 - April 11)); removed: Trust and Safety Product Sprint (Sprint Lemon Meringue (March 3 - 21)).Mar 24 2025, 2:20 PM
Tchanders moved this task from Priority Backlog to Ready on the Trust and Safety Product Sprint (Sprint Chocolate Cake (March 24 - April 11)) board.
zeljkofilipin added a parent task: T291254: Find flaky Selenium tests.Mar 24 2025, 5:57 PM
zeljkofilipin removed a project: Browser-Tests.Mar 24 2025, 6:46 PM
SDunlap moved this task from Backlog to Ready on the Test Platform (Tria 3) board.Mar 25 2025, 4:46 PM
zeljkofilipin moved this task from Quarter 👔 to Sprint 🏃‍➡️ on the User-zeljkofilipin board.Mar 26 2025, 10:10 AM
gerritbot added a comment.Mar 27 2025, 11:48 AM

Change #1123651 abandoned by Zfilipin:

[mediawiki/extensions/CheckUser@master] WIP selenium: Find flaky tests

https://gerrit.wikimedia.org/r/1123651

gerritbot added a comment.Apr 2 2025, 1:58 PM

Change #1133412 had a related patch set uploaded (by Zfilipin; author: Zfilipin):

[mediawiki/extensions/CheckUser@master] selenium: Document when, how and why the test is skipped

https://gerrit.wikimedia.org/r/1133412

gerritbot added a comment.Apr 2 2025, 2:18 PM

Change #1133412 merged by jenkins-bot:

[mediawiki/extensions/CheckUser@master] selenium: Document when, how and why the test is skipped

https://gerrit.wikimedia.org/r/1133412

ReleaseTaggerBot edited projects, added: MW-1.44-notes (1.44.0-wmf.24; 2025-04-08); removed: MW-1.44-notes (1.44.0-wmf.22; 2025-03-25).Apr 2 2025, 3:00 PM
zeljkofilipin edited projects, added: Test Platform (kvara 4); removed: Test Platform (Tria 3).Apr 4 2025, 2:25 PM
zeljkofilipin moved this task from Backlog to Ready on the Test Platform (kvara 4) board.Apr 8 2025, 4:21 PM
kostajh edited projects, added: Trust and Safety Product Sprint (Sprint Cozonac (April 14 - May 2)); removed: Trust and Safety Product Sprint (Sprint Chocolate Cake (March 24 - April 11)).Apr 14 2025, 2:53 PM
kostajh moved this task from Priority Backlog to Ready on the Trust and Safety Product Sprint (Sprint Cozonac (April 14 - May 2)) board.
Lens0021 subscribed.Apr 20 2025, 11:12 PM
zeljkofilipin removed zeljkofilipin as the assignee of this task.Apr 29 2025, 11:02 AM
zeljkofilipin removed projects: Test Platform (kvara 4), Testing Support, User-zeljkofilipin.
zeljkofilipin subscribed.

Unassigned from myself. I thought I'll have time to take a look at this, but I'm busy with other tasks.

kostajh removed a project: Trust and Safety Product Sprint (Sprint Cozonac (April 14 - May 2)).Apr 30 2025, 1:42 PM
Krinkle added a comment.Jun 20 2025, 2:12 AM

Similar/related.

https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php81/23040/console (Build kept forever)
https://gerrit.wikimedia.org/r/c/mediawiki/extensions/MobileFrontend/+/1161154

[Chrome 120.0.0.0 linux #0-2] » /tests/selenium/specs/clienthints.js
[Chrome 120.0.0.0 linux #0-2] Client Hints
[Chrome 120.0.0.0 linux #0-2]    ✓ Verify edit sends Client Hints data
[Chrome 120.0.0.0 linux #0-2]    ✖ stores client hints data on successful logins
[Chrome 120.0.0.0 linux #0-2]    ✓ stores client hints data on account creation
[Chrome 120.0.0.0 linux #0-2]    - stores client hints data on logout
[Chrome 120.0.0.0 linux #0-2]    ✓ stores client hints data on temporary account auto-creation
[Chrome 120.0.0.0 linux #0-2]
[Chrome 120.0.0.0 linux #0-2] 3 passing (28.9s)
[Chrome 120.0.0.0 linux #0-2] 1 failing
[Chrome 120.0.0.0 linux #0-2] 1 skipped
[Chrome 120.0.0.0 linux #0-2]
[Chrome 120.0.0.0 linux #0-2] 1) Client Hints stores client hints data on successful logins
[Chrome 120.0.0.0 linux #0-2] expect(received).not.toBeFalsy()

Received: ""
[Chrome 120.0.0.0 linux #0-2] Error: expect(received).not.toBeFalsy()
[Chrome 120.0.0.0 linux #0-2]
[Chrome 120.0.0.0 linux #0-2] Received: ""
[Chrome 120.0.0.0 linux #0-2]     at Context.<anonymous> (/workspace/src/extensions/CheckUser/tests/selenium/specs/clienthints.js:127:35)
[Chrome 120.0.0.0 linux #0-2]     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
------------------------------------------------------------------
[Chrome 120.0.0.0 linux #0-4] Running: Chrome (v120.0.0.0) on linux
[Chrome 120.0.0.0 linux #0-4] Session ID: a54538cc-69b0-424a-90c4-0bf0bb9fa21d
[Chrome 120.0.0.0 linux #0-4]
[Chrome 120.0.0.0 linux #0-4] » /tests/selenium/specs/tempAccountsOnboarding.js
[Chrome 120.0.0.0 linux #0-4] Temporary Accounts Onboarding Dialog
[Chrome 120.0.0.0 linux #0-4]    ✖ Verify onboarding dialog displays correctly and IPInfo preference works
[Chrome 120.0.0.0 linux #0-4]
[Chrome 120.0.0.0 linux #0-4] 1 failing (12.6s)
[Chrome 120.0.0.0 linux #0-4]
[Chrome 120.0.0.0 linux #0-4] 1) Temporary Accounts Onboarding Dialog Verify onboarding dialog displays correctly and IPInfo preference works
[Chrome 120.0.0.0 linux #0-4] Expect $(`.ext-checkuser-temp-account-onboarding-dialog-ip-info-preference input[type="checkbox"]`) to exist

Expected: "exist"
Received: "not exist"
[Chrome 120.0.0.0 linux #0-4] Error: Expect $(`.ext-checkuser-temp-account-onboarding-dialog-ip-info-preference input[type="checkbox"]`) to exist
[Chrome 120.0.0.0 linux #0-4]
[Chrome 120.0.0.0 linux #0-4] Expected: "exist"
[Chrome 120.0.0.0 linux #0-4] Received: "not exist"
[Chrome 120.0.0.0 linux #0-4]     at Context.<anonymous> (/workspace/src/extensions/CheckUser/tests/selenium/specs/tempAccountsOnboarding.js:57:5)
Umherirrender subscribed.Aug 5 2025, 8:45 PM

https://gerrit.wikimedia.org/r/c/mediawiki/extensions/TimedMediaHandler/+/1175525
https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php81/31912/console

22:40:24 [0-2] Error in "Client Hints."before all" hook for "Verify edit sends Client Hints data""
22:40:24 Node is either not clickable or not an HTMLElement
22:40:24 Error: Node is either not clickable or not an HTMLElement
22:40:24     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
22:40:24 [0-2] RETRYING in chrome - /tests/selenium/specs/clienthints.js
22:40:25 [0-2] RUNNING in chrome - /tests/selenium/specs/clienthints.js
22:40:33 [0-0] PASSED in chrome - /tests/selenium/specs/checkuser.js
22:40:34 [0-2] Error in "Client Hints."before all" hook for "Verify edit sends Client Hints data""
22:40:34 Node is either not clickable or not an HTMLElement
22:40:34 Error: Node is either not clickable or not an HTMLElement
22:40:34     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
22:40:34 [0-2] FAILED in chrome - /tests/selenium/specs/clienthints.js (1 retries)
22:40:34 Restoring original /workspace/src/LocalSettings.php
[...]
22:40:35 [Chrome 120.0.0.0 linux #0-2] » /tests/selenium/specs/clienthints.js
22:40:35 [Chrome 120.0.0.0 linux #0-2] Client Hints
22:40:35 [Chrome 120.0.0.0 linux #0-2]    ✖ "before all" hook for Client Hints
22:40:35 [Chrome 120.0.0.0 linux #0-2]
22:40:35 [Chrome 120.0.0.0 linux #0-2] 1 failing (16.4s)
22:40:35 [Chrome 120.0.0.0 linux #0-2]
22:40:35 [Chrome 120.0.0.0 linux #0-2] 1) Client Hints "before all" hook for Client Hints
22:40:35 [Chrome 120.0.0.0 linux #0-2] Node is either not clickable or not an HTMLElement
22:40:35 [Chrome 120.0.0.0 linux #0-2] Node is either not clickable or not an HTMLElement
22:40:35 [Chrome 120.0.0.0 linux #0-2] Error: Node is either not clickable or not an HTMLElement
22:40:35 [Chrome 120.0.0.0 linux #0-2]     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Umherirrender added a comment.Aug 5 2025, 9:19 PM

https://gerrit.wikimedia.org/r/c/mediawiki/skins/MinervaNeue/+/1175636
https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php81/31915/console

22:50:36 [0-2] Error in "Client Hints."before all" hook for "Verify edit sends Client Hints data""
22:50:36 Error: Timeout of 60000ms exceeded. The execution in the test "Client Hints "before all" hook for "Verify edit sends Client Hints data"" took too long. Try to reduce the run time or increase your timeout for test specs (https://webdriver.io/docs/timeouts). (/workspace/src/extensions/CheckUser/tests/selenium/specs/clienthints.js)
22:50:36     at createTimeoutError (/workspace/src/extensions/CheckUser/node_modules/mocha/lib/errors.js:498:15)
22:50:36     at Runnable._timeoutError (/workspace/src/extensions/CheckUser/node_modules/mocha/lib/runnable.js:429:10)
22:50:36     at Timeout.<anonymous> (/workspace/src/extensions/CheckUser/node_modules/mocha/lib/runnable.js:244:24)
22:50:36     at listOnTimeout (node:internal/timers:581:17)
22:50:36     at process.processTimers (node:internal/timers:519:7)
22:50:37 [0-2] RETRYING in chrome - /tests/selenium/specs/clienthints.js
22:50:38 [0-2] RUNNING in chrome - /tests/selenium/specs/clienthints.js
22:50:43 [0-0] PASSED in chrome - /tests/selenium/specs/checkuser.js
22:50:51 [0-2] Error in "Client Hints."before all" hook for "Verify edit sends Client Hints data""
22:50:51 Node is either not clickable or not an HTMLElement
22:50:51 Error: Node is either not clickable or not an HTMLElement
22:50:51     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
22:50:51 [0-2] FAILED in chrome - /tests/selenium/specs/clienthints.js (1 retries)
[...]
22:50:51 [Chrome 120.0.0.0 linux #0-2] » /tests/selenium/specs/clienthints.js
22:50:51 [Chrome 120.0.0.0 linux #0-2] Client Hints
22:50:51 [Chrome 120.0.0.0 linux #0-2]    ✖ "before all" hook for Client Hints
22:50:51 [Chrome 120.0.0.0 linux #0-2]
22:50:51 [Chrome 120.0.0.0 linux #0-2] 1 failing (1m)
22:50:51 [Chrome 120.0.0.0 linux #0-2]
22:50:51 [Chrome 120.0.0.0 linux #0-2] 1) Client Hints "before all" hook for Client Hints
22:50:51 [Chrome 120.0.0.0 linux #0-2] Timeout of 60000ms exceeded. The execution in the test "Client Hints "before all" hook for "Verify edit sends Client Hints data"" took too long. Try to reduce the run time or increase your timeout for test specs (https://webdriver.io/docs/timeouts). (/workspace/src/extensions/CheckUser/tests/selenium/specs/clienthints.js)
22:50:51 [Chrome 120.0.0.0 linux #0-2] Error: Timeout of 60000ms exceeded. The execution in the test "Client Hints "before all" hook for "Verify edit sends Client Hints data"" took too long. Try to reduce the run time or increase your timeout for test specs (https://webdriver.io/docs/timeouts). (/workspace/src/extensions/CheckUser/tests/selenium/specs/clienthints.js)
22:50:51 [Chrome 120.0.0.0 linux #0-2]     at createTimeoutError (/workspace/src/extensions/CheckUser/node_modules/mocha/lib/errors.js:498:15)
22:50:51 [Chrome 120.0.0.0 linux #0-2]     at Runnable._timeoutError (/workspace/src/extensions/CheckUser/node_modules/mocha/lib/runnable.js:429:10)
22:50:51 [Chrome 120.0.0.0 linux #0-2]     at Timeout.<anonymous> (/workspace/src/extensions/CheckUser/node_modules/mocha/lib/runnable.js:244:24)
22:50:51 [Chrome 120.0.0.0 linux #0-2]     at listOnTimeout (node:internal/timers:581:17)
22:50:51 [Chrome 120.0.0.0 linux #0-2]     at process.processTimers (node:internal/timers:519:7)
Umherirrender added a comment.Aug 5 2025, 11:09 PM

https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1172137
https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php81/31940/console

00:51:13 [0-2] Error in "Client Hints."before all" hook for "Verify edit sends Client Hints data""
00:51:13 Node is either not clickable or not an HTMLElement
00:51:13 Error: Node is either not clickable or not an HTMLElement
00:51:13     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
00:51:13 [0-2] RETRYING in chrome - /tests/selenium/specs/clienthints.js
00:51:15 [0-2] RUNNING in chrome - /tests/selenium/specs/clienthints.js
00:51:19 [0-4] Error in "Temporary Accounts Onboarding Dialog.Verify onboarding dialog displays correctly and IPInfo preference works"
00:51:19 Error: Dialog did not open in time
00:51:19     at async Context.<anonymous> (/workspace/src/extensions/CheckUser/tests/selenium/specs/tempAccountsOnboarding.js:46:3)
00:51:20 [0-4] RETRYING in chrome - /tests/selenium/specs/tempAccountsOnboarding.js
00:51:21 [0-4] RUNNING in chrome - /tests/selenium/specs/tempAccountsOnboarding.js
00:51:23 [0-0] PASSED in chrome - /tests/selenium/specs/checkuser.js
00:51:33 [0-4] PASSED in chrome - /tests/selenium/specs/tempAccountsOnboarding.js (1 retries)
00:51:38 [0-2] Error in "Client Hints.stores client hints data on successful logins"
00:51:38 Error: expect(received).not.toBeFalsy()
00:51:38 
00:51:38 Received: ""
00:51:38     at Context.<anonymous> (/workspace/src/extensions/CheckUser/tests/selenium/specs/clienthints.js:127:35)
00:51:38     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
00:51:43 [0-2] FAILED in chrome - /tests/selenium/specs/clienthints.js (1 retries)
Krinkle moved this task from Inbox to Needs Triage on the Trust and Safety Product Team board.Aug 6 2025, 12:09 AM
Krinkle added a comment.EditedAug 6 2025, 12:12 AM

Apologies in advance if there's a different in-take or escalation process. I'm bolding moving to "Needs Triage" which looks like a smaller more appropiate and regularly triaged column, compared to the Trust & Safety's default "Inbox" column whichi has 600+ tasks and this task has not been triaged in the two months that it was there.

Dreamy_Jazz added a project: Trust and Safety Product Sprint.Aug 6 2025, 7:19 AM
Dreamy_Jazz moved this task from Backlog to Maintenance to triage on the Trust and Safety Product Sprint board.
Func subscribed.Aug 6 2025, 3:16 PM

I saw this twice today.

https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php81/32097/console:

23:04:20 [0-2] Error in "Client Hints.Verify edit sends Client Hints data"
23:04:20 Node is either not clickable or not an HTMLElement
23:04:20 Error: Node is either not clickable or not an HTMLElement
23:04:20     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
23:04:23 [0-0] PASSED in chrome - /tests/selenium/specs/checkuser.js
23:04:32 [0-2] RETRYING in chrome - /tests/selenium/specs/clienthints.js
23:04:33 [0-2] RUNNING in chrome - /tests/selenium/specs/clienthints.js
23:04:43 [0-2] Error in "Client Hints."before all" hook for "Verify edit sends Client Hints data""
23:04:43 Node is either not clickable or not an HTMLElement
23:04:43 Error: Node is either not clickable or not an HTMLElement
23:04:43     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
23:04:43 [0-2] FAILED in chrome - /tests/selenium/specs/clienthints.js (1 retries)

https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php81/32097/console:

19:07:11 [0-2] Error in "Client Hints."before all" hook for "Verify edit sends Client Hints data""
19:07:11 Node is either not clickable or not an HTMLElement
19:07:11 Error: Node is either not clickable or not an HTMLElement
19:07:11     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
19:07:11 [0-2] RETRYING in chrome - /tests/selenium/specs/clienthints.js
19:07:12 [0-2] RUNNING in chrome - /tests/selenium/specs/clienthints.js
19:07:14 [0-4] Error in "Temporary Accounts Onboarding Dialog.Verify onboarding dialog displays correctly and IPInfo preference works"
19:07:14 Error: Dialog did not open in time
19:07:14     at async Context.<anonymous> (/workspace/src/extensions/CheckUser/tests/selenium/specs/tempAccountsOnboarding.js:46:3)
19:07:15 [0-4] RETRYING in chrome - /tests/selenium/specs/tempAccountsOnboarding.js
19:07:16 [0-4] RUNNING in chrome - /tests/selenium/specs/tempAccountsOnboarding.js
19:07:19 [0-0] PASSED in chrome - /tests/selenium/specs/checkuser.js
19:07:22 [0-2] Error in "Client Hints."before all" hook for "Verify edit sends Client Hints data""
19:07:22 Node is either not clickable or not an HTMLElement
19:07:22 Error: Node is either not clickable or not an HTMLElement
19:07:22     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
19:07:23 [0-2] FAILED in chrome - /tests/selenium/specs/clienthints.js (1 retries)
Daimona triaged this task as Unbreak Now! priority.Aug 6 2025, 5:48 PM

Just seen in https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php81/32157/console for a patch in CampaignEvents.

17:33:32 [Chrome 120.0.0.0 linux #0-2] » /tests/selenium/specs/clienthints.js
17:33:32 [Chrome 120.0.0.0 linux #0-2] Client Hints
17:33:32 [Chrome 120.0.0.0 linux #0-2]    ✖ "before all" hook for Client Hints
17:33:32 [Chrome 120.0.0.0 linux #0-2]
17:33:32 [Chrome 120.0.0.0 linux #0-2] 1 failing (7.9s)
17:33:32 [Chrome 120.0.0.0 linux #0-2]
17:33:32 [Chrome 120.0.0.0 linux #0-2] 1) Client Hints "before all" hook for Client Hints
17:33:32 [Chrome 120.0.0.0 linux #0-2] Node is either not clickable or not an HTMLElement
17:33:32 [Chrome 120.0.0.0 linux #0-2] Node is either not clickable or not an HTMLElement
17:33:32 [Chrome 120.0.0.0 linux #0-2] Error: Node is either not clickable or not an HTMLElement
17:33:32 [Chrome 120.0.0.0 linux #0-2]     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

I don't know if something happened recently that triggers this more often, maybe it's to do with the CI infra. But what I do know is that this should be treated as an UBN because it keeps breaking tests in multiple repos. For starters, I'm going to make a patch to disable the test.

gerritbot added a comment.Aug 6 2025, 5:52 PM

Change #1176292 had a related patch set uploaded (by Daimona Eaytoy; author: Daimona Eaytoy):

[mediawiki/extensions/CheckUser@master] selenium: Skip flaky test

https://gerrit.wikimedia.org/r/1176292

gerritbot added a comment.Aug 6 2025, 6:43 PM

Change #1176292 merged by jenkins-bot:

[mediawiki/extensions/CheckUser@master] selenium: Skip flaky test

https://gerrit.wikimedia.org/r/1176292

ReleaseTaggerBot added a project: MW-1.45-notes (1.45.0-wmf.14; 2025-08-12).Aug 6 2025, 7:00 PM
Umherirrender unsubscribed.Aug 6 2025, 8:08 PM
Func lowered the priority of this task from Unbreak Now! to Needs Triage.Aug 8 2025, 12:47 AM

Since marked as skipped

zeljkofilipin unsubscribed.Aug 13 2025, 8:56 AM
OKryva-WMF added a project: Essential-Work.Aug 13 2025, 3:28 PM
Dreamy_Jazz moved this task from Maintenance to triage to Sprint Princess Tarta (August 18 - September 5) on the Trust and Safety Product Sprint board.Aug 19 2025, 9:53 AM
Dreamy_Jazz edited projects, added: Trust and Safety Product Sprint (Sprint Princess Tarta (August 18 - September 5)); removed: Trust and Safety Product Sprint.
OKryva-WMF triaged this task as Medium priority.Aug 19 2025, 10:07 AM
OKryva-WMF moved this task from Priority Backlog to Ready on the Trust and Safety Product Sprint (Sprint Princess Tarta (August 18 - September 5)) board.
OKryva-WMF moved this task from Ready to Maintenance Ready on the Trust and Safety Product Sprint (Sprint Princess Tarta (August 18 - September 5)) board.Aug 19 2025, 10:28 AM
gerritbot added a comment.Sep 4 2025, 2:03 PM

Change #1184798 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/CheckUser@master] Drop all selenium tests

https://gerrit.wikimedia.org/r/1184798

gerritbot added a comment.Sep 4 2025, 2:10 PM

Change #1184800 had a related patch set uploaded (by Dreamy Jazz; author: Dreamy Jazz):

[mediawiki/extensions/CheckUser@master] Remove selenium dependencies from package.json

https://gerrit.wikimedia.org/r/1184800

Dreamy_Jazz claimed this task.Sep 4 2025, 2:15 PM
Dreamy_Jazz moved this task from Maintenance Ready to Needs Review on the Trust and Safety Product Sprint (Sprint Princess Tarta (August 18 - September 5)) board.
Dreamy_Jazz closed this task as Resolved.Sep 5 2025, 12:28 PM
Dreamy_Jazz moved this task from Needs Review to Done on the Trust and Safety Product Sprint (Sprint Princess Tarta (August 18 - September 5)) board.

Resolved by dropping all of the tests

gerritbot added a comment.Sep 5 2025, 1:05 PM

Change #1184798 merged by jenkins-bot:

[mediawiki/extensions/CheckUser@master] Drop all selenium tests

https://gerrit.wikimedia.org/r/1184798

ReleaseTaggerBot edited projects, added: MW-1.45-notes (1.45.0-wmf.18; 2025-09-09); removed: MW-1.45-notes (1.45.0-wmf.14; 2025-08-12).Sep 5 2025, 2:00 PM
gerritbot added a comment.Sep 5 2025, 2:20 PM

Change #1184800 merged by jenkins-bot:

[mediawiki/extensions/CheckUser@master] Remove selenium dependencies from package.json

https://gerrit.wikimedia.org/r/1184800

gerritbot added a comment.Jan 15 2026, 8:09 AM

Change #1127899 abandoned by Dreamy Jazz:

[mediawiki/extensions/CheckUser@master] selenium: Remove redundant navigation from logout step

Reason:

No more selenium tests in CheckUser, so should be safe to abandon this

https://gerrit.wikimedia.org/r/1127899

Maintenance_bot removed a project: Patch-For-Review.Jan 15 2026, 8:31 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits