In our goal to get the gated extension browser test job run time under 10 minutes, we are starting to get really close. Almost all extensions been optimised and looking at the data we have, the cite browser tests takes almost 25% of the total runtime for the gated extensions browser tests (the time include npm install + running the tests).
Here's one example:
https://integration.wikimedia.org/ci/job/quibble-with-gated-extensions-selenium-php83/29662/console
And looking in the log displaying total time per extension:
00:09:27.747 │ 65.604s │ Browser tests in 'mediawiki/core' │ 00:09:27.747 │ 30.644s │ Browser tests in 'mediawiki/extensions/AbuseFilter' │ 00:09:27.747 │ 37.883s │ Browser tests in 'mediawiki/extensions/CampaignEvents' │ 00:09:27.747 │ 122.453s │ Browser tests in 'mediawiki/extensions/Cite' │ 00:09:27.747 │ 43.147s │ Browser tests in 'mediawiki/extensions/CommunityConfiguration' │ 00:09:27.747 │ 13.001s │ Browser tests in 'mediawiki/extensions/ConfirmEdit' │ 00:09:27.747 │ 16.303s │ Browser tests in 'mediawiki/extensions/Echo' │ 00:09:27.747 │ 33.934s │ Browser tests in 'mediawiki/extensions/GuidedTour' │ 00:09:27.747 │ 14.776s │ Browser tests in 'mediawiki/extensions/Math' │ 00:09:27.747 │ 26.972s │ Browser tests in 'mediawiki/extensions/PageTriage' │ 00:09:27.747 │ 21.751s │ Browser tests in 'mediawiki/extensions/ProofreadPage' │ 00:09:27.747 │ 23.505s │ Browser tests in 'mediawiki/extensions/TemplateData' │ 00:09:27.747 │ 33.822s │ Browser tests in 'mediawiki/extensions/VisualEditor' │ 00:09:27.747 │ 19.107s │ Browser tests in 'mediawiki/skins/MinervaNeue' │ 00:09:27.747 │ 502.955s │ Run all browser tests │
Acceptance Criteria:
- Investigate if there are any performance wins that can be done. The goal should be to be faster than core test (core run many more tests than cite). Document your findings.
