In T414818: Collect and document core browser test performance data we gathered data from CI on how much time end-to-end tests take for gated extensions/skins.
In T415290: Document gated extensions and skins we gathered gated extensions/skins with selenium/cypress tests.
We need more granular data/metrics to know where we should spend the time and focus to make the developer feedback loop faster.
The data is from a job running the 21th of January 2026 for a patch in core.
| Type | Install (seconds) | webdriverIO (in seconds) | Cypress (in seconds) |
|---|---|---|---|
| Installing Mediawiki | 73 | ||
| Core (webdriverIO) | 14 | 104 | |
| extensions/AbuseFilter | 7 | 31 | |
| extensions/CampaignEvents | 10 | 81 | |
| extensions/Cite | 14 | 40 | |
| extensions/CommunityConfiguration | 19 | 21 | |
| extensions/Echo | 9 | 8 | |
| extensions/GrowthExperiments | 19 | 168 | |
| extensions/Math | 8 | 6 | |
| extensions/PageTriage | 10 | 26 | |
| extensions/ProofreadPage | 8 | 30 | |
| extensions/TemplateData | 7 | 16 | |
| extensions/VisualEditor | 9 | 36 | |
| extensions/Wikibase | 49 | 114 | 198 |
| skins/MinervaNeue | 10 | 12 | |
And total times:
| Installing MediaWiki (s) | Total installation time excluding Mediawiki (s) | Total webdriverIO (s) | Total Cypress (s) | Job total time (s) | Job total time in minutes | Job time reported in Jenkins |
|---|---|---|---|---|---|---|
| 73 | 193 | 464 | 427 | 1157 | 19 minutes 17 seconds | 20 minutes 43s |
Let me compare the data with https://integration.wikimedia.org/ci/job/quibble-with-gated-extensions-selenium-php83/9026/consoleFull there the total is 25 minutes.