While working on T289853: Wikibase Selenium tests fail when targeting wiki created by MediaWiki-Docker I've decided to try my luck with WikibaseLexeme too. To my big surprise, most of the tests are passing! Only 1 test is failing.

For setup, I've followed MediaWiki-Docker/Extension/WikibaseLexeme.

nobody@docker-desktop:/WikibaseLexeme$ npm run selenium-test
(...)
[0-14] RUNNING in chrome - /tests/selenium/specs/special/recentchanges.js
[0-14] AssertionError [ERR_ASSERTION] in "Special:RecentChanges shows lemmas in title links to lexemes on Special:RecentChanges"
AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
  assert( title.includes( 'entrôpi' ) )
    at Context.it (/WikibaseLexeme/tests/selenium/specs/special/recentchanges.js:33:3)
[0-14] FAILED in chrome - /tests/selenium/specs/special/recentchanges.js
(...)
...............................................F.
Spec Files:	 15 passed, 1 failed, 16 total (100% completed) in 00:15:21 
(...)

As far as I can tell, the assertion looking for entrôpi failed. I'm not sure what went wrong, but I can see the text on the page.

Terminal output:

Tests pass in CI (for example, build #76993) The only thing that I can see different is that entrôpi is at the top of the list in CI.

After some debugging, looks like that's causing the test to fail.

const title = RecentChangesPage.titles[ 0 ].getText(); returns text for the first item on the page, and entrôpi/entropy/ентропы is very frequently (but not always) the second element on the page.

I ran the failing tests 10 times, and it failed 1 time, passed 9 times. I'm not sure how this tests is not more unstable in CI or the daily job.

Terminal output: