Some patch in puppet caused labs/private to be set as absent:
Luckily deployment-puppetmaster04.deployment-prep.eqiad.wmflabs and integration-puppetmaster-02.integration.eqiad.wmflabs had merge conflicts preventing them from automagically applying the faulty puppet.git patch
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • aborrero | T254491 Puppet labs/private.git data loss incident affecting some projects | |||
| Resolved | hashar | T254473 Prevents labs/private to disappear from integration and deployment-prep puppet master |
I have:
Confirmed the faulty commit got reverted ;)
Enabled puppet again and ran it again.
The one on beta fails because of a missing etcd::autogen_pwd_seed. I have made a dummy
puppet patch in hieradata/cloud/eqiad1/deployment-prep/common.yaml
Looks good to me now. We have been lucky to have both puppet master blocked on a merge conflict!