With the work that the Test Platform do in T420590 we are decreasing the feedback loop time for developers. The changes we do will also affect the gate pipeline (the tests that happens before the actual merge).
Here are some jobs before our changes (some jobs are cached, that why some metrics are really fast):
This patch 2th of Feb:
This patch 9th of January:
Here are the statistics for the slowest jobs in January:
| job | Count | min | max | average | stddev | median | p75 | p90 | p95 | p99 |
| quibble-for-mediawiki-core-vendor-postgres-php83 | 139 | 09:42 | 19:38 | 16:29 | 01:30 | 16:35 | 17:26 | 18:29 | 18:48 | 19:35 |
| quibble-with-gated-extensions-selenium-php83 | 205 | 17:58 | 29:06 | 22:55 | 01:21 | 22:58 | 23:58 | 25:25 | 26:03 | 27:40 |
| quibble-for-mediawiki-core-vendor-mysql-php82 | 145 | 09:10 | 17:42 | 13:42 | 01:49 | 14:02 | 15:00 | 15:38 | 15:54 | 16:37 |
| quibble-for-mediawiki-core-vendor-mysql-php83 | 270 | 08:00 | 14:50 | 11:27 | 01:44 | 11:36 | 12:29 | 13:14 | 13:34 | 14:19 |
| quibble-for-mediawiki-core-vendor-mysql-php84 | 94 | 08:31 | 15:47 | 12:03 | 01:31 | 12:07 | 13:01 | 13:35 | 13:49 | 14:22 |
| quibble-for-mediawiki-core-vendor-mysql-php85 | 13 | 07:27 | 12:33 | 10:01 | 01:17 | 10:01 | 10:53 | 11:09 | 11:44 | 12:24 |
Developer gate pipeline feedback time (using this query):
| month | Gate pipeline median feedback time | Slowest job |
| 2026-01 | 22:58 | quibble-with-gated-extensions-selenium-php83 |
| 2026-02 | 24:11 | quibble-with-gated-extensions-selenium-php83 |
| 2026-03 | 17:22 | quibble-for-mediawiki-core-vendor-postgres-php83 |
| 2026-04 | 14:50 | quibble-for-mediawiki-core-vendor-postgres-php83 |
Since we are doing a lot of work to make sure test jobs are fast, we should also keep an eye on the gates pre merge job. Let's see if there's any easy wins we can implement/fix.
When we end the work for speeding up the jobs we should also report our wins on the gated jobs.