Page MenuHomePhabricator

Config changes to deployment prep are not deployed
Closed, DuplicatePublic

Description

At https://integration.wikimedia.org/zuul/ the postmerge jobs for operations/mediawiki-config have been stuck for over 12 hours.

Event Timeline

Nikerabbit raised the priority of this task from to Needs Triage.
Nikerabbit updated the task description. (Show Details)
Nikerabbit changed Security from none to None.
Nikerabbit added subscribers: Nikerabbit, Language-Team.

The Jenkins executors ends up in a deadlock from time to time which is T72597.

I will restart Jenkins

What do I need to do get https://gerrit.wikimedia.org/r/#/c/175979/ deployed? It claims it is deployed but it seems not to be the case.

On post merge we run the job https://integration.wikimedia.org/ci/job/beta-mediawiki-config-update-eqiad/ which reset /srv/mediawiki-staging to the commit that has been merged, then the job triggers scap https://integration.wikimedia.org/ci/job/beta-scap-eqiad/

To make sure a change is properly applied, one can rerun the last build which should apply the latest merged change (assuming the build history is properly ordered).

To verify, one can head to deployment-bastion.eqiad.wmflabs and look at the git log in /srv/mediawiki-staging and/or /srv/mediawiki