"Page should be undoable" selenium test is flaky
Open, Needs TriagePublic
Actions

Assigned To

None

Authored By

	Tgr
	Mar 8 2021, 12:45 PM

Project Tags

Referenced Files

	F72632360: Screenshot 2026-03-06 at 08.34.39.png
	Mar 6 2026, 7:35 AM

	F34151236: image.png
	Mar 11 2021, 10:56 AM

	F34150294: image.png
	Mar 10 2021, 10:23 PM

	F34145376: Page-should-be-undoable.png
	Mar 8 2021, 12:51 PM

Subscribers

Lucas_Werkmeister_WMDE

Nikerabbit

View All 13 Subscribers

Description

Seen this fail twice today, out of maybe a dozen merge attempts:

13:20:56 [0-1] Error in "Page should be undoable"
13:20:56 Can't call getText on element with selector "#mw-content-text .mw-parser-output" because element wasn't found
13:20:56 [0-1] FAILED in chrome - /tests/selenium/specs/page.js

The screenshot suggests this is a timing issue, checking the page content before the page finished saving:

Page-should-be-undoable.png (1,020×1,361 px, 154 KB)

The test was added in rMW32c36f0e7303: selenium: undo page which was quite a while ago, not sure what changed.

Details

Related Changes in Gerrit:

Subject	Repo	Branch	Lines +/-
selenium: Wait for the browser to navigate away	mediawiki/core	master	+2 -0
selenium: Disable flaky undoable page test	mediawiki/core	master	+1 -1
Suppress VisualEditor welcome dialog in undo Selenium test	mediawiki/core	master	+7 -1

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T291254 Find flaky Selenium tests
		Open		None	T276783 "Page should be undoable" selenium test is flaky

Event Timeline

Tgr created this task.Mar 8 2021, 12:45 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 8 2021, 12:45 PM

Tgr updated the task description. (Show Details)Mar 8 2021, 12:51 PM

It seems to me that for some reason welcome to testwiki popup wasn't disabled, and that caused the failure.

zeljkofilipin claimed this task.Mar 8 2021, 4:24 PM

zeljkofilipin triaged this task as Medium priority.

zeljkofilipin added projects: User-zeljkofilipin, Quality-and-Test-Engineering-Team.

zeljkofilipin moved this task from Inbox to Selenium on the MediaWiki-Core-Tests board.

zeljkofilipin moved this task from Backlog 🪒 to Deep work 🌊 on the User-zeljkofilipin board.

zeljkofilipin moved this task from Inbox to Test engineering on the Quality-and-Test-Engineering-Team board.

This has caused r669091 for AbuseFilter to fail gate-and-submit twice today.

Breaking other repos -> UBN

I'm unlikely to have the time to take a look today, de-assigning for now.

zeljkofilipin moved this task from Deep work 🌊 to Quarter 👔 on the User-zeljkofilipin board.Mar 8 2021, 5:23 PM

RhinosF1 subscribed.Mar 8 2021, 6:08 PM

Nikerabbit awarded a token.Mar 9 2021, 12:20 PM

Nikerabbit subscribed.

Change 670173 had a related patch set uploaded (by Gergő Tisza; owner: Gergő Tisza):
[mediawiki/core@master] Suppress VisualEditor welcome dialog in undo Selenium test

https://gerrit.wikimedia.org/r/670173

gerritbot added a project: Patch-For-Review.Mar 9 2021, 1:51 PM

Daimona merged a task: T276965: Frequent MediaWiki core browser test failures: "Page should be undoable" .Mar 9 2021, 5:14 PM

Daimona added a subscriber: Lucas_Werkmeister_WMDE.

Change 670173 merged by jenkins-bot:
[mediawiki/core@master] Suppress VisualEditor welcome dialog in undo Selenium test

https://gerrit.wikimedia.org/r/670173

Hopefully fixed?

ReleaseTaggerBot added a project: MW-1.36-notes (1.36.0-wmf.35; 2021-03-16).Mar 9 2021, 8:00 PM

Maintenance_bot removed a project: Patch-For-Review.Mar 9 2021, 8:10 PM

Seen again just now in https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php72-selenium-docker/36269/console https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/670225

This time the error is:

23:14:18 Node is either not visible or not an HTMLElement

matmarex unsubscribed.Mar 10 2021, 10:46 PM

Change 670787 had a related patch set uploaded (by Kosta Harlan; owner: Kosta Harlan):
[mediawiki/core@master] selenium: Disable flaky undoable page test

https://gerrit.wikimedia.org/r/670787

gerritbot added a project: Patch-For-Review.Mar 11 2021, 10:55 AM

Another error screenshot:

This keeps breaking in GrowthExperiments repo patches, I'm not sure if it's seen elsewhere. I've pushed a patch to disable the test.

Change 670787 merged by jenkins-bot:
[mediawiki/core@master] selenium: Disable flaky undoable page test

https://gerrit.wikimedia.org/r/670787

Maintenance_bot removed a project: Patch-For-Review.Mar 11 2021, 12:10 PM

DannyS712 merged a task: T277614: Flaky selenium test: Error in "Page should be undoable": Can't call getText on element ....Mar 17 2021, 12:56 AM

DannyS712 added a subscriber: ori.

Test is disabled, so no longer UBN.

zeljkofilipin raised the priority of this task from High to Needs Triage.Sep 17 2021, 9:35 AM

zeljkofilipin removed a project: Quality-and-Test-Engineering-Team.

zeljkofilipin added a parent task: T291254: Find flaky Selenium tests.Oct 7 2021, 11:40 AM

zeljkofilipin moved this task from Quarter 👔 to Backlog 🪒 on the User-zeljkofilipin board.

zeljkofilipin removed a project: User-zeljkofilipin.Oct 7 2021, 6:03 PM

TheresNoTime removed a subscriber: RhinosF1.Dec 15 2022, 11:36 PM

Universal_Omega subscribed.Jan 17 2023, 10:26 PM

zeljkofilipin added a project: Testing Support.Mar 24 2025, 6:14 PM

zeljkofilipin removed a project: MediaWiki-Core-Tests.Mar 24 2025, 6:31 PM

zeljkofilipin removed a project: Browser-Tests.Mar 24 2025, 6:48 PM

SDunlap added a project: Browser Test Platform.Nov 17 2025, 9:38 PM

zeljkofilipin removed a project: Testing Support.Nov 20 2025, 4:39 PM

Umherirrender mentioned this in T417973: Page should be undoable is flakey.Feb 20 2026, 8:24 PM

Change #1246920 had a related patch set uploaded (by Phedenskog; author: Phedenskog):

[mediawiki/core@master] selenium: Wait for the browser to navigate away

https://gerrit.wikimedia.org/r/1246920

gerritbot added a project: Patch-For-Review.Mar 2 2026, 8:35 AM

Change #1247024 had a related patch set uploaded (by Phedenskog; author: Phedenskog):

[mediawiki/core@master] selenium: Make sure our change is in the list (not first)

https://gerrit.wikimedia.org/r/1247024

@Peter you're working on this, right?

Looking at the stats there hasn't been a flake issue since the 14 of Feb so not sure if this is an issue anymore

Screenshot 2026-03-06 at 08.34.39.png (3,200×128 px, 52 KB)

Peter removed a project: Test Platform (Wernigerode 23).Mar 6 2026, 2:43 PM

Seen on VisualEditor some days ago
https://gerrit.wikimedia.org/r/c/mediawiki/extensions/VisualEditor/+/1247583
https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php83-selenium/25900/console

16:30:09 [0-0] Error in "Page.should be undoable"
16:30:09 Error: Expect  to have text
16:30:09 
16:30:09 Expected: StringContaining "beforeEach-content-0.8235105885007201-Iñtërnâtiônàlizætiøn"
16:30:09 Received: "editContent-0.526408608742597-Iñtërnâtiônàlizætiøn"
16:30:09     at Context.<anonymous> (file:///workspace/src/tests/selenium/specs/page.js:101:45)
16:30:09 [0-0] RETRYING in chrome - file:///tests/selenium/specs/page.js
16:30:11 [0-0] RUNNING in chrome - file:///tests/selenium/specs/page.js
16:30:12 [0-0] [Browser information] chrome-headless-shell 120.0.6099.224 viewPort 1280x1024
16:30:53 [0-0] Error in "Page.should be undoable"
16:30:53 Error: Expect  to have text
16:30:53 
16:30:53 Expected: StringContaining "beforeEach-content-0.7375455557873987-Iñtërnâtiônàlizætiøn"
16:30:53 Received: "editContent-0.5917848481715517-Iñtërnâtiônàlizætiøn"
16:30:53     at Context.<anonymous> (file:///workspace/src/tests/selenium/specs/page.js:101:45)
16:30:53 [0-0] FAILED in chrome - file:///tests/selenium/specs/page.js (1 retries)

Umherirrender merged a task: T335653: Selenium test "Page.should be undoable @daily" is flaky.Mar 7 2026, 9:53 PM

Umherirrender added a subscriber: Reedy.

Change #1246920 abandoned by Phedenskog:

[mediawiki/core@master] selenium: Wait for the browser to navigate away

https://gerrit.wikimedia.org/r/1246920

Umherirrender unsubscribed.Apr 11 2026, 9:03 AM

• hector.arroyo mentioned this in T426059: hCaptcha risk scores: Hook handler for capturing when a block notice is presented in the Desktop editor.Fri, May 15, 5:37 PM

• hector.arroyo subscribed.