| AMarkossyan-WMF | |
| Mar 10 2026, 4:03 PM |
| F75419493: quibble-with-gated-extensions.png | |
| Apr 9 2026, 2:51 PM |
In order to speed up the gated extensions job for core, we're splitting the GrowthExperiments (the second slowest set of tests in the job) into a separate job that can run in parallel with the rest of the tests.
This epic contains all tasks related to this initiatve.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T420590 Decrease feedback loop for core tests to less than 10 minutes | |||
| Resolved | Peter | T421476 Speed up quibble-with-gated-extensions-selenium-php83 | |||
| Resolved | Peter | T419567 Splitting GrowthExperiments from gated extensions | |||
| Resolved | zeljkofilipin | T417412 Configure the CI so the new GrowthExperiments standalone job runs in all appropriate pipelines | |||
| Resolved | BUG REPORT | • hashar | T418369 GrowthExperiments cypress tests fail when running quibble locally | ||
| Resolved | BUG REPORT | zeljkofilipin | T421038 Fix running selenium tests for PageTriage | ||
| Resolved | BUG REPORT | zeljkofilipin | T420584 Fix running selenium tests for ProofreadPage | ||
| Resolved | zeljkofilipin | T419574 Create a separate CI job for GrowthExperiments cypress tests | |||
| Resolved | zeljkofilipin | T419575 Optimize the dependencies of the GrowthExperiments job | |||
| Resolved | zeljkofilipin | T421249 Add devcontainer to integration/config | |||
| Open | None | T422786 Run @selenium-test npm script in *future* release branches |
I appreciate the goal of reducing the runtime of our CI, but I don't think this is a good idea. The point of GrowthExperiments being a gated extension is that it integrates with a lot of other extensions in core parts of the Wikimedia stack. Moving GrowthExperiments to its own job defeats the point of that.
Also, it would be great if such drastic changes would be run by our team well in advance and happen only in close coordination. The #talk-to-growth Slack channel is an ideal place to reach out.
The implementation got split in two subtasks:
We have deployed both this morning and confirmed they are working.
Looking at the Grafana dashboard for Suceeding quibble-with-gated-extensions-selenium-php83 durations:
One of the build took less than 7 minutes when before the change it was around 11 minutes. That is a 33% speed increase. It used to take more than 20 minutes not so long ago. With Wikibase and now GrowthExperiments split to their own jobs, the job is now THREE times faster 🚀
There are follows up action:
@zeljkofilipin in short I think we can claim this task to be resolved after we have resolved the two tasks tracking the implementation in JJB and Zuul. 🎉