Page MenuHomePhabricator

Speed up quibble-with-gated-extensions-selenium-php83
Closed, ResolvedPublic

Description

The goal with this epic is to make the quibble-with-gated-extensions-selenium-php83 job finish faster than 10 minutes in median time.

Here are monthly numbers in runtime where you can see the effect of our work (we exclude cache hits and failing jobs):

Monthcountminmaxaveragestddevmedianp75p90p95p99
January20517:5829:0622:5501:2122:5823:5825:2526:0327:40
February107812:4936:1023:3403:5423:5425:3427:1328:1830:22
March163210:1220:1814:0301:2413:5915:0016:1016:4718:26
April139307:4920:0710:3701:0910:1311:4513:1313:5715:23
May144707:2625:5710:1602:0409:4010:5612:4814:1319:11

Some of the work that has already been done:

  • Move wikibase to own job T287582 (made by @hashar )
  • We update the wdio-mediawiki package in T417130 and then pushed it all gated extensions that uses wdio:
  • We did some work to better run more tests in parallel:
    • Speed up PageTriage webdriver.io tests T419241
    • Speed up VisualEditor webdriver.io tests T419947
    • Speed up AbuseFilter webdriver.io tests T419665

Related Objects

StatusSubtypeAssignedTask
OpenNone
Resolved Peter
OpenNone
Resolvedzeljkofilipin
ResolvedBUG REPORThashar
ResolvedBUG REPORTzeljkofilipin
ResolvedBUG REPORTzeljkofilipin
OpenNone
ResolvedBUG REPORTzeljkofilipin
ResolvedBUG REPORTzeljkofilipin
Resolvedzeljkofilipin
Resolvedzeljkofilipin
Resolvedzeljkofilipin
Resolvedzeljkofilipin
OpenNone
Resolved Peter
Resolved Peter
Resolved Peter
Resolved Peter

Event Timeline

Peter updated the task description. (Show Details)
Peter added a subscriber: hashar.
Peter updated the task description. (Show Details)
Peter updated the task description. (Show Details)

We have deployed T419567: Splitting GrowthExperiments from gated extensions this morning

Looking at the Grafana dashboard for Suceeding quibble-with-gated-extensions-selenium-php83 durations:

quibble-with-gated-extensions.png (934×524 px, 55 KB)

One of the build took less than 7 minutes when before the change it was around 11 minutes. That is a 33% speed increase 🚀

Change #1271931 had a related patch set uploaded (by Phedenskog; author: Phedenskog):

[mediawiki/extensions/Cite@master] cypress: Exclude specs for missing extensions before browser launch

https://gerrit.wikimedia.org/r/1271931

Change #1271931 merged by jenkins-bot:

[mediawiki/extensions/Cite@master] cypress: Exclude specs for missing extensions before browser launch

https://gerrit.wikimedia.org/r/1271931

Peter claimed this task.
Peter updated the task description. (Show Details)

Closing this as resolved since we have one month of data where we are under 10 minutes.