Page MenuHomePhabricator

CI is unavailable since around 10:00 UTC
Closed, ResolvedPublic

Description

Submitted patches are not verified, or verified after an endless amount of time, see
https://grafana.wikimedia.org/d/000000321/zuul?from=1556887620964&to=1557143258078&orgId=1

Event Timeline

Joe triaged this task as Unbreak Now! priority.May 6 2019, 11:52 AM

My patches are also stuck in the queue, and I'm seeing teammates manually V+2 their Puppet changes.

My patches are also stuck in the queue, and I'm seeing teammates manually V+2 their Puppet changes.

Same here with my patches.

Change 508323 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Revert "zuul: skip test/test-prio for CR+2 changes"

https://gerrit.wikimedia.org/r/508323

Change 508323 merged by jenkins-bot:
[integration/config@master] Revert "zuul: skip test/test-prio for CR+2 changes"

https://gerrit.wikimedia.org/r/508323

hashar claimed this task.

I broke Zuul workflow earlier this morning when deploying a change for T105474 despite tests :-( I have reverted the config change and it should be all fine now.

I guess I should have more carefully monitored that deployment or I had too much confidence in it :-\ I apologize for the delay, I was not really paying attention to phabricator or IRC notifications :-\

Thank you very much @hashar \o/, I can confirm that the pipeline is back up & running.

hashar added subscribers: herron, Volans.

Sorry for the mess today, I was really not paying attention to any IRC notifications and was otherwise busy with other duties :-(

Thanks @CDanis @Joe @Volans @herron and others I have forgot!

The incident report with some actionables: https://wikitech.wikimedia.org/wiki/Incident_documentation/20190506-zuul