Page MenuHomePhabricator

Failing puppet runs on labtestpuppetmaster2001
Open, MediumPublic


puppet runs are failing labtestpuppetmaster2001 since Oct 3: It's failing to retrieve the class openstack::clientpackages::newton::jessie

The server can probably simply be reclaimed to spares? After all the puppet masters for Cloud VPS are now in Cloud VPS, so what's the remaining use case of that server?

I's also the last remaining puppet4/jessie server, so blocking removal of the old backwards compat code which was added for the puppet 5 transition


Related Gerrit Patches:
operations/puppet : productionMove labtestpuppetmaster2001 to Stretch

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 18 2019, 7:48 AM
crusnov triaged this task as Medium priority.Oct 19 2019, 1:39 AM
Dzahn added a subscriber: Dzahn.Nov 5 2019, 11:34 PM

This is kind of a duplicate of T222061 it seems.

Dzahn added a subscriber: Andrew.Nov 5 2019, 11:41 PM

@Andrew Can we remove labtestpuppetmaster / turn it into a spare::system ?

@Andrew Can we remove labtestpuppetmaster / turn it into a spare::system ?

Nope, it's still doing useful work. I'll replace it eventually but not immediately.

Change 549641 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Move labtestpuppetmaster2001 to Stretch

Change 549641 merged by Andrew Bogott:
[operations/puppet@production] Move labtestpuppetmaster2001 to Stretch

jcrespo added a subscriber: jcrespo.EditedNov 11 2019, 10:07 AM

labtestpuppetmaster2001 is failing to validate backups on bacula because it doesn't have any full backup with > 0 bytes. I assume var-lib-puppet-volatile was empty at some point and then it got populated, right? I will rerun a full backup now just to check.

Mentioned in SAL (#wikimedia-operations) [2019-11-11T10:12:14Z] <jynus> manually run full backup of labtestpuppetmaster2001 T235819