Page MenuHomePhabricator

"For a page with eis enabled -> next to last page" test is flaky
Closed, ResolvedPublic

Description

The referenced test is flaky, having been unreliable 18 times in the last 30 days.

It thus appears in the flaky test report.

Test reference: https://integration.wikimedia.org/ci/job/quibble-with-gated-extensions-selenium-php81/9901/

Purpose of this ticket:

  • Review the test to see if it is still flaky. Attempt to duplicate the flakiness locally against the specified environment.
  • Determine the cause of the flakiness

Based on what's determined, implement a resolution.

Event Timeline

Change #1240822 had a related patch set uploaded (by Vaughn Walters; author: Vaughn Walters):

[mediawiki/extensions/ProofreadPage@master] [DNM] selenium: Testing "For a page with eis enabled, last page" in CI

https://gerrit.wikimedia.org/r/1240822

passing 100/100 in isolation in CI
https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php83-selenium/22858/console

passing 100/100 in CI while running that test file:
https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php83-selenium/23186/console
Alternatively, see paste of results here P89016

Passing 100/100 in CI while running the entire test suite. It did need retries four times though, so going to try to tighten that up:
https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php83-selenium/23268/console

Change #1240822 merged by jenkins-bot:

[mediawiki/extensions/ProofreadPage@master] selenium: Testing "For a page with eis enabled, last page" in CI

https://gerrit.wikimedia.org/r/1240822