Page MenuHomePhabricator

Flaky browser tests in MW 1.43
Closed, ResolvedPublic

Description

https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1304939
https://integration.wikimedia.org/ci/job/quibble-for-mediawiki-core-browser-tests-only-composer-mysql-php81/1442/console

Saw this on T429826: CVE-2026-55568, CVE-2026-55767, CVE-2026-55766: guzzlehttp security advisors that impacts upgrading parsoid version in vendor/ earlier too..

02:26:39 Execution of 11 workers started at 2026-06-23T01:26:39.566Z
02:26:39 
02:26:40 [0-2] RUNNING in chrome - /tests/selenium/docs/Stack/specs/expect.js
02:26:40 [0-3] RUNNING in chrome - /tests/selenium/docs/Stack/specs/mocha.js
02:26:40 [0-0] RUNNING in chrome - /tests/selenium/docs/Create_a_simple_test/specs/specialpages.js
02:26:40 [0-1] RUNNING in chrome - /tests/selenium/docs/Page_object_pattern/specs/login.js
02:26:42 [0-3] Log in link visible
02:26:42 [0-2] PASSED in chrome - /tests/selenium/docs/Stack/specs/expect.js
02:26:42 [0-3] PASSED in chrome - /tests/selenium/docs/Stack/specs/mocha.js
02:26:43 [0-0] PASSED in chrome - /tests/selenium/docs/Create_a_simple_test/specs/specialpages.js
02:26:43 [0-4] RUNNING in chrome - /tests/selenium/docs/Stack/specs/pageobject.js
02:26:43 [0-5] RUNNING in chrome - /tests/selenium/docs/Use_MediaWiki_API/specs/api.js
02:26:43 [0-6] RUNNING in chrome - /tests/selenium/specs/page.js
02:26:44 [0-1] PASSED in chrome - /tests/selenium/docs/Page_object_pattern/specs/login.js
02:26:45 [0-7] RUNNING in chrome - /tests/selenium/specs/recentchanges.js
02:26:45 [0-5] PASSED in chrome - /tests/selenium/docs/Use_MediaWiki_API/specs/api.js
02:26:45 [0-4] PASSED in chrome - /tests/selenium/docs/Stack/specs/pageobject.js
02:26:46 [0-8] RUNNING in chrome - /tests/selenium/specs/user.js
02:26:46 [0-9] RUNNING in chrome - /tests/selenium/specs/watchlist.js
02:26:48 [0-9] PASSED in chrome - /tests/selenium/specs/watchlist.js
02:26:48 [0-10] RUNNING in chrome - /tests/selenium/wdio-mediawiki/specs/BlankPage.js
02:26:49 [0-7] PASSED in chrome - /tests/selenium/specs/recentchanges.js
02:26:51 [0-10] PASSED in chrome - /tests/selenium/wdio-mediawiki/specs/BlankPage.js
02:26:52 [0-8] Error in "User.should be able to log in"
02:26:52 Error: expect(received).toBe(expected) // Object.is equality
02:26:52 
02:26:52 Expected: "User-0.8881078637779111-Iñtërnâtiônàlizætiøn"
02:26:52 Received: null
02:26:52     at Context.<anonymous> (/workspace/src/tests/selenium/specs/user.js:42:28)
02:26:52     at process.processTicksAndRejections (node:internal/process/task_queues:104:5)
02:27:01 [0-8] RETRYING in chrome - /tests/selenium/specs/user.js
02:27:02 [0-8] RUNNING in chrome - /tests/selenium/specs/user.js
02:27:12 [0-6] PASSED in chrome - /tests/selenium/specs/page.js
02:27:13 [0-8] Error in "User.named user should see extra signup form fields when creating an account"
02:27:13 Error: Expect $(`#wpName2`) to exist
02:27:13 
02:27:13 Expected: "exist"
02:27:13 Received: "not exist"
02:27:13     at Context.<anonymous> (/workspace/src/tests/selenium/specs/user.js:51:52)
02:27:13     at process.processTicksAndRejections (node:internal/process/task_queues:104:5)
02:27:19 [0-8] FAILED in chrome - /tests/selenium/specs/user.js (1 retries)
02:27:19 
02:27:19  "spec" Reporter:
02:27:19 ------------------------------------------------------------------
02:27:19 [Chrome 149.0.0.0 linux #0-2] Running: Chrome (v149.0.0.0) on linux
02:27:19 [Chrome 149.0.0.0 linux #0-2] Session ID: 7f26b49e-d3ea-46a4-b1e8-36eaa82890a4
02:27:19 [Chrome 149.0.0.0 linux #0-2]
02:27:19 [Chrome 149.0.0.0 linux #0-2] » /tests/selenium/docs/Stack/specs/expect.js
02:27:19 [Chrome 149.0.0.0 linux #0-2] Main page
02:27:19 [Chrome 149.0.0.0 linux #0-2]    ✓ should have "Log in" link when using expect
02:27:19 [Chrome 149.0.0.0 linux #0-2]
02:27:19 [Chrome 149.0.0.0 linux #0-2] 1 passing (1.7s)
02:27:19 ------------------------------------------------------------------
02:27:19 [Chrome 149.0.0.0 linux #0-3] Running: Chrome (v149.0.0.0) on linux
02:27:19 [Chrome 149.0.0.0 linux #0-3] Session ID: 125cb5aa-80d7-4b76-a4b9-bf8ec7595648
02:27:19 [Chrome 149.0.0.0 linux #0-3]
02:27:19 [Chrome 149.0.0.0 linux #0-3] » /tests/selenium/docs/Stack/specs/mocha.js
02:27:19 [Chrome 149.0.0.0 linux #0-3] Main page
02:27:19 [Chrome 149.0.0.0 linux #0-3]    ✓ should have "Log in" link when using mocha
02:27:19 [Chrome 149.0.0.0 linux #0-3]
02:27:19 [Chrome 149.0.0.0 linux #0-3] 1 passing (1.8s)
02:27:19 ------------------------------------------------------------------
02:27:19 [Chrome 149.0.0.0 linux #0-0] Running: Chrome (v149.0.0.0) on linux
02:27:19 [Chrome 149.0.0.0 linux #0-0] Session ID: 5d98598c-7433-44db-9fac-c96ce738e1e4
02:27:19 [Chrome 149.0.0.0 linux #0-0]
02:27:19 [Chrome 149.0.0.0 linux #0-0] » /tests/selenium/docs/Create_a_simple_test/specs/specialpages.js
02:27:19 [Chrome 149.0.0.0 linux #0-0] Special:SpecialPages
02:27:19 [Chrome 149.0.0.0 linux #0-0]    ✓ should not have Edit link
02:27:19 [Chrome 149.0.0.0 linux #0-0]
02:27:19 [Chrome 149.0.0.0 linux #0-0] 1 passing (1.9s)
02:27:19 ------------------------------------------------------------------
02:27:19 [Chrome 149.0.0.0 linux #0-1] Running: Chrome (v149.0.0.0) on linux
02:27:19 [Chrome 149.0.0.0 linux #0-1] Session ID: 9a5aac96-a7d6-4443-ae55-ff84d29890cc
02:27:19 [Chrome 149.0.0.0 linux #0-1]
02:27:19 [Chrome 149.0.0.0 linux #0-1] » /tests/selenium/docs/Page_object_pattern/specs/login.js
02:27:19 [Chrome 149.0.0.0 linux #0-1] User
02:27:19 [Chrome 149.0.0.0 linux #0-1]    ✓ should be able to log in without page object
02:27:19 [Chrome 149.0.0.0 linux #0-1]
02:27:19 [Chrome 149.0.0.0 linux #0-1] 1 passing (3.4s)
02:27:19 ------------------------------------------------------------------
02:27:19 [Chrome 149.0.0.0 linux #0-5] Running: Chrome (v149.0.0.0) on linux
02:27:19 [Chrome 149.0.0.0 linux #0-5] Session ID: c6edb6c3-4c11-4285-95e7-fe4fbdbcf8eb
02:27:19 [Chrome 149.0.0.0 linux #0-5]
02:27:19 [Chrome 149.0.0.0 linux #0-5] » /tests/selenium/docs/Use_MediaWiki_API/specs/api.js
02:27:19 [Chrome 149.0.0.0 linux #0-5] API
02:27:19 [Chrome 149.0.0.0 linux #0-5]    ✓ Main Page should exist
02:27:19 [Chrome 149.0.0.0 linux #0-5]    ✓ Missing Page should not exist
02:27:19 [Chrome 149.0.0.0 linux #0-5]
02:27:19 [Chrome 149.0.0.0 linux #0-5] 2 passing (314ms)
02:27:19 ------------------------------------------------------------------
02:27:19 [Chrome 149.0.0.0 linux #0-4] Running: Chrome (v149.0.0.0) on linux
02:27:19 [Chrome 149.0.0.0 linux #0-4] Session ID: 55bd3c94-5fa7-46e7-b826-2e2aea421289
02:27:19 [Chrome 149.0.0.0 linux #0-4]
02:27:19 [Chrome 149.0.0.0 linux #0-4] » /tests/selenium/docs/Stack/specs/pageobject.js
02:27:19 [Chrome 149.0.0.0 linux #0-4] Main Page
02:27:19 [Chrome 149.0.0.0 linux #0-4]    ✓ should have "Log in" link when using page object
02:27:19 [Chrome 149.0.0.0 linux #0-4]
02:27:19 [Chrome 149.0.0.0 linux #0-4] 1 passing (746ms)
02:27:19 ------------------------------------------------------------------
02:27:19 [Chrome 149.0.0.0 linux #0-9] Running: Chrome (v149.0.0.0) on linux
02:27:19 [Chrome 149.0.0.0 linux #0-9] Session ID: 77cd0944-b0cf-4d44-b10e-396c06868ba5
02:27:19 [Chrome 149.0.0.0 linux #0-9]
02:27:19 [Chrome 149.0.0.0 linux #0-9] » /tests/selenium/specs/watchlist.js
02:27:19 [Chrome 149.0.0.0 linux #0-9] Special:Watchlist
02:27:19 [Chrome 149.0.0.0 linux #0-9]    - should show page with new edit @daily
02:27:19 [Chrome 149.0.0.0 linux #0-9]
02:27:19 [Chrome 149.0.0.0 linux #0-9] 1 skipped (323ms)
02:27:19 ------------------------------------------------------------------
02:27:19 [Chrome 149.0.0.0 linux #0-7] Running: Chrome (v149.0.0.0) on linux
02:27:19 [Chrome 149.0.0.0 linux #0-7] Session ID: a806d9bc-f1d2-46cb-ad34-8d37c9074897
02:27:19 [Chrome 149.0.0.0 linux #0-7]
02:27:19 [Chrome 149.0.0.0 linux #0-7] » /tests/selenium/specs/recentchanges.js
02:27:19 [Chrome 149.0.0.0 linux #0-7] Special:RecentChanges
02:27:19 [Chrome 149.0.0.0 linux #0-7]    ✓ shows page creation
02:27:19 [Chrome 149.0.0.0 linux #0-7]
02:27:19 [Chrome 149.0.0.0 linux #0-7] 1 passing (3.4s)
02:27:19 ------------------------------------------------------------------
02:27:19 [Chrome 149.0.0.0 linux #0-10] Running: Chrome (v149.0.0.0) on linux
02:27:19 [Chrome 149.0.0.0 linux #0-10] Session ID: 2cb18b86-ff94-4c3a-8299-6cebeb241d86
02:27:19 [Chrome 149.0.0.0 linux #0-10]
02:27:19 [Chrome 149.0.0.0 linux #0-10] » /tests/selenium/wdio-mediawiki/specs/BlankPage.js
02:27:19 [Chrome 149.0.0.0 linux #0-10] BlankPage
02:27:19 [Chrome 149.0.0.0 linux #0-10]    ✓ should have its title @daily
02:27:19 [Chrome 149.0.0.0 linux #0-10]
02:27:19 [Chrome 149.0.0.0 linux #0-10] 1 passing (1.2s)
02:27:19 ------------------------------------------------------------------
02:27:19 [Chrome 149.0.0.0 linux #0-8] Running: Chrome (v149.0.0.0) on linux
02:27:19 [Chrome 149.0.0.0 linux #0-8] Session ID: 505b0da1-d6b7-4990-b807-953efafb1174
02:27:19 [Chrome 149.0.0.0 linux #0-8]
02:27:19 [Chrome 149.0.0.0 linux #0-8] » /tests/selenium/specs/user.js
02:27:19 [Chrome 149.0.0.0 linux #0-8] User
02:27:19 [Chrome 149.0.0.0 linux #0-8]    ✓ should be able to create account
02:27:19 [Chrome 149.0.0.0 linux #0-8]    ✖ should be able to log in
02:27:19 [Chrome 149.0.0.0 linux #0-8]    ✓ named user should see extra signup form fields when creating an account
02:27:19 [Chrome 149.0.0.0 linux #0-8]    ✓ temporary user should not see signup form fields relevant to named users
02:27:19 [Chrome 149.0.0.0 linux #0-8]    ✓ temporary user should be able to create account
02:27:19 [Chrome 149.0.0.0 linux #0-8]
02:27:19 [Chrome 149.0.0.0 linux #0-8] 4 passing (13.5s)
02:27:19 [Chrome 149.0.0.0 linux #0-8] 1 failing
02:27:19 [Chrome 149.0.0.0 linux #0-8]
02:27:19 [Chrome 149.0.0.0 linux #0-8] 1) User should be able to log in
02:27:19 [Chrome 149.0.0.0 linux #0-8] expect(received).toBe(expected) // Object.is equality
02:27:19 
02:27:19 Expected: "User-0.8881078637779111-Iñtërnâtiônàlizætiøn"
02:27:19 Received: null
02:27:19 [Chrome 149.0.0.0 linux #0-8] Error: expect(received).toBe(expected) // Object.is equality
02:27:19 [Chrome 149.0.0.0 linux #0-8]
02:27:19 [Chrome 149.0.0.0 linux #0-8] Expected: "User-0.8881078637779111-Iñtërnâtiônàlizætiøn"
02:27:19 [Chrome 149.0.0.0 linux #0-8] Received: null
02:27:19 [Chrome 149.0.0.0 linux #0-8]     at Context.<anonymous> (/workspace/src/tests/selenium/specs/user.js:42:28)
02:27:19 [Chrome 149.0.0.0 linux #0-8]     at process.processTicksAndRejections (node:internal/process/task_queues:104:5)
02:27:19 ------------------------------------------------------------------
02:27:19 [Chrome 149.0.0.0 linux #0-6] Running: Chrome (v149.0.0.0) on linux
02:27:19 [Chrome 149.0.0.0 linux #0-6] Session ID: 909e4f87-2edb-46be-a143-aa7f767967bc
02:27:19 [Chrome 149.0.0.0 linux #0-6]
02:27:19 [Chrome 149.0.0.0 linux #0-6] » /tests/selenium/specs/page.js
02:27:19 [Chrome 149.0.0.0 linux #0-6] Page
02:27:19 [Chrome 149.0.0.0 linux #0-6]    ✓ should be previewable @daily
02:27:19 [Chrome 149.0.0.0 linux #0-6]    ✓ should be creatable
02:27:19 [Chrome 149.0.0.0 linux #0-6]    ✓ should be re-creatable
02:27:19 [Chrome 149.0.0.0 linux #0-6]    ✓ should be editable @daily
02:27:19 [Chrome 149.0.0.0 linux #0-6]    ✓ should have history @daily
02:27:19 [Chrome 149.0.0.0 linux #0-6]    ✓ should be deletable
02:27:19 [Chrome 149.0.0.0 linux #0-6]    ✓ should be restorable
02:27:19 [Chrome 149.0.0.0 linux #0-6]    ✓ should be protectable
02:27:19 [Chrome 149.0.0.0 linux #0-6]    ✓ should be undoable @daily
02:27:19 [Chrome 149.0.0.0 linux #0-6]
02:27:19 [Chrome 149.0.0.0 linux #0-6] 9 passing (26.8s)
02:27:19 ------------------------------------------------------------------
02:27:19 [Chrome 149.0.0.0 linux #0-8] Running: Chrome (v149.0.0.0) on linux
02:27:19 [Chrome 149.0.0.0 linux #0-8] Session ID: 5d8af451-cd77-4e9e-89ea-b7228dc005ee
02:27:19 [Chrome 149.0.0.0 linux #0-8]
02:27:19 [Chrome 149.0.0.0 linux #0-8] » /tests/selenium/specs/user.js
02:27:19 [Chrome 149.0.0.0 linux #0-8] User
02:27:19 [Chrome 149.0.0.0 linux #0-8]    ✓ should be able to create account
02:27:19 [Chrome 149.0.0.0 linux #0-8]    ✓ should be able to log in
02:27:19 [Chrome 149.0.0.0 linux #0-8]    ✖ named user should see extra signup form fields when creating an account
02:27:19 [Chrome 149.0.0.0 linux #0-8]    ✓ temporary user should not see signup form fields relevant to named users
02:27:19 [Chrome 149.0.0.0 linux #0-8]    ✓ temporary user should be able to create account
02:27:19 [Chrome 149.0.0.0 linux #0-8]
02:27:19 [Chrome 149.0.0.0 linux #0-8] 4 passing (16s)
02:27:19 [Chrome 149.0.0.0 linux #0-8] 1 failing
02:27:19 [Chrome 149.0.0.0 linux #0-8]
02:27:19 [Chrome 149.0.0.0 linux #0-8] 1) User named user should see extra signup form fields when creating an account
02:27:19 [Chrome 149.0.0.0 linux #0-8] Expect $(`#wpName2`) to exist
02:27:19 
02:27:19 Expected: "exist"
02:27:19 Received: "not exist"
02:27:19 [Chrome 149.0.0.0 linux #0-8] Error: Expect $(`#wpName2`) to exist
02:27:19 [Chrome 149.0.0.0 linux #0-8]
02:27:19 [Chrome 149.0.0.0 linux #0-8] Expected: "exist"
02:27:19 [Chrome 149.0.0.0 linux #0-8] Received: "not exist"
02:27:19 [Chrome 149.0.0.0 linux #0-8]     at Context.<anonymous> (/workspace/src/tests/selenium/specs/user.js:51:52)
02:27:19 [Chrome 149.0.0.0 linux #0-8]     at process.processTicksAndRejections (node:internal/process/task_queues:104:5)
02:27:19 
02:27:19 
02:27:19 Spec Files:	 10 passed, 1 retries, 1 failed, 11 total (100% completed) in 00:00:39

Event Timeline

Reedy triaged this task as High priority.Jun 24 2026, 2:26 PM
Reedy renamed this task from Flaky browser tests to Flaky browser tests (on initial tests, not seemingly on gate).Jun 24 2026, 2:30 PM
Reedy renamed this task from Flaky browser tests (on initial tests, not seemingly on gate) to Flaky browser tests in MW 1.43.Jun 25 2026, 5:22 PM

User-named-user-should-see-extra-signup-form-fields-when-creating-an-account-2026-06-25T16-33-27-298Z.png (1,185×1,026 px, 101 KB)

User-named-user-should-see-extra-signup-form-fields-when-creating-an-account-2026-06-25T16-33-06-302Z.png (1,185×1,026 px, 100 KB)

Reedy claimed this task.

I think these are fixed. But there's different ones now. Another task for those...