The problem
quibble-with-gated-extensions-selenium-php83 Jenkins job is by far the slowest job in mediawiki/core test pipeline.
Acceptance criteria
- quibble-with-gated-extensions-selenium-php83 is no longer the the slowest job in mediawiki/core test pipeline
The solution
Improvements have to be made in three places
- core
- gated extensions/skins
- CI
Data
This is not a new problem. Unfortunately, it seems to be (slowly) becoming worse (source).
| job_id | month | jobs_per_month | total_time_hours | median_time_minutes |
|---|---|---|---|---|
| 221 | 2025-10 | 3553 | 1020.22 | 20.1 |
| 221 | 2025-11 | 3537 | 1069.64 | 21.9 |
| 751 | 2025-12 | 1574 | 434.89 | 20.9 |
| 751 | 2026-01 | 1254 | 380.13 | 22.0 |
| 751 | 2026-02 | 1700 | 549.86 | 23.3 |
Slowest jobs in mediawiki/core test pipeline, sorted by median.
| Job | Median (mm:ss) |
|---|---|
| quibble-with-gated-extensions-selenium-php83 | 21:28 |
| quibble-for-mediawiki-core-vendor-mysql-php83 | 11:31 |
| quibble-with-gated-extensions-vendor-mysql-php83 | 10:54 |
Related tasks
selenium/webdriverio
- In T408361: Speed up quibble-with-gated-extensions-selenium-php83 - selenium/webdriverio (and subtasks) we are working on speeding up selenium/webdriverio tests.
- In T415574: Fix running selenium/cypress tests for gated extensions and skins (mediawiki-quickstart) (and subtasks) we are working on being able to run selenium/webdriverio and cypress tests locally, so we could debug them and speed them up.
CI
- In T417416: Speed up quibble-with-gated-extensions-selenium-php83 - CI (and subtasks) we are working on speeding up CI.
gated extensions
cypress
Timeline
2019
- T225730: Reduce runtime of MW shared gate Jenkins jobs to 5 min
- T226869: Run browser tests in parallel
2024
2026
- T415553: Document how much time selenium/cypress tests take for every gated extension/skin
- Data on how long each step of quibble-with-gated-extensions-selenium-php83 takes. Two slow steps are GrowthExperiments and Wikibase tests.