Page MenuHomePhabricator

Create "High Priority" gate-and-submit pipeline
Closed, ResolvedPublic

Description

Currently the gate-and-submit pipeline has a higher priority than the test pipeline. This is a good thing; however, within the gate-and-submit pipeline there are subqueues, but no defined priorities. Certain tests require a faster turn around than others, so we should create a means by which zuul can prioritize the gate-and-submit queue.

The way Zuul work and how we have it configured is:

There is a pipeline gate-and-submit that supports multiple queues and reacts to Code-Review +2 events.

Most projects are registered with that pipeline and projects share the same queue whenever they share the same job. For example mediawiki/core and mediawiki/vendor share the same job mediawiki-extensions-qunit-jessie. Patches are then enqueued in the order they received the CR+2, regardless of the target branch. Doc https://docs.openstack.org/infra/zuul/gating.html

This task is about decoupling MediaWiki patches targeting the wmf/* branches. To work around Zuul not supporting branch we would need a new gate pipeline that would only react to wmf branches. Probably by making the Gerrit trigger to filter events by branch: ^wmf/.

Event Timeline

hashar triaged this task as Medium priority.Mar 21 2017, 9:12 AM

Gave it a quick try by duplicating gate-and-submit on all MediaWiki repositories but that does not work quite well. We have Zuul templates used on both mediawiki and non mediawiki projects :(

Change 351131 had a related patch set uploaded (by Hashar; owner: Thcipriani):
[integration/config@master] Create SWAT gate and submit pipeline

https://gerrit.wikimedia.org/r/351131

Change 351131 merged by jenkins-bot:
[integration/config@master] Create SWAT gate and submit pipeline

https://gerrit.wikimedia.org/r/351131

Saw this in action during European mid-day SWAT. Seems to be working to me. I will continue to monitor over time. Calling this done for now, will open a new ticket if there are problems.

Yup looks good to me after the European SWAT. Kudos on the config :-}