They are failing (randomly?) when run on Saucelabs from Jenkins.
See e.g.:
https://integration.wikimedia.org/ci/job/browsertests-Wikidata-WikidataTests-linux-firefox-sauce/181/testReport/
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Invalid | None | T108946 [Epic] Improve the development infrastructure | |||
| Resolved | zeljkofilipin | T94150 Fix scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily | |||
| Duplicate | None | T105985 Run Wikidata browser tests on testwikidata via Jenkins | |||
| Resolved | • Jonas | T88541 [DO NOT USE] Wikidata Browsertests (tracking) [superseded by #Browser-Tests] | |||
| Resolved | Tobi_WMDE_SW | T101497 [Story] Run browsertests regularly on test.wikidata.org via Jenkins | |||
| Resolved | JanZerebecki | T101498 [Task] Create a user with necessary privileges for browsertests on test.wikidata.org | |||
| Resolved | Tobi_WMDE_SW | T101499 [Task] Setup a Jenkins job to run Wikidata browsertests on test.wikidata.org | |||
| Resolved | Tobi_WMDE_SW | T92619 make Wikidata browsertests non-flaky (tracking) | |||
| Resolved | WMDE-Fisch | T95291 Fix browsertests for rank-, snaktype- and badge-selectors on SauceLabs |
Event Timeline
Comment Actions
The rank-, snaktype- and badge-selectors tests seem to run well again and only fail randomly. For Chrome the problem of resizing windows was fixed by SauceLabs
see the tests here
for Firefox the tests also run well again although the resizing issue was not fixed see
The issues might be resolved now ;-)
Comment Actions
Just as a small follow up:
Dylan from SauceLabs contacted me if the issue with resizing windows and Firefox is still occurring. I checked a random Firefox screencast from a recent test and it seems to be fixed.