There is still three instances running on puppet 3.8.5. Should be 4.8:
===== NODE GROUP ===== (3) deployment-mx.deployment-prep.eqiad.wmflabs,deployment-redis[01-02].deployment-prep.eqiad.wmflabs ----- OUTPUT of 'puppet --version' ----- 3.8.5
[ ] deployment-redis01.deployment-prep.eqiad.wmflabs
[ ] deployment-redis02.deployment-prep.eqiad.wmflabs
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | aborrero | T178717 Upgrade wmcs instances and masters to puppet 4.8 | |||
| Resolved | None | T177254 Upgrade to puppet 4 (4.8 or newer) | |||
| Resolved | Andrew | T178508 Update VPS puppetmasters to 4.8 or newer | |||
| Resolved | hashar | T184114 Upgrade puppet 4.8 on all deployment-prep instance |
deployment-mx fails due to mtail requiring systemd:
Error: Could not retrieve catalog from remote server: Error 500 on SERVER: {"message":"Server Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Function Call, You can only use systemd resources on systems with systemd, got upstart at /etc/puppet/modules/systemd/manifests/init.pp:8:9 at /etc/puppet/modules/mtail/manifests/init.pp:37 on node deployment-mx.deployment-prep.eqiad.wmflabs","issue_kind":"RUNTIME_ERROR","stacktrace":["Warning: The 'stacktrace' property is deprecated and will be removed in a future version of Puppet. For security reasons, stacktraces are not returned with Puppet HTTP Error responses."]}
And the redis ones fails due to prometheus redis exporter requiring systemd:
Error: Could not retrieve catalog from remote server: Error 500 on SERVER: {"message":"Server Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Function Call, You can only use systemd resources on systems with systemd, got upstart at /etc/puppet/modules/systemd/manifests/init.pp:8:9 at /etc/puppet/modules/prometheus/manifests/redis_exporter.pp:49 on node deployment-redis01.deployment-prep.eqiad.wmflabs","issue_kind":"RUNTIME_ERROR","stacktrace":["Warning: The 'stacktrace' property is deprecated and will be removed in a future version of Puppet. For security reasons, stacktraces are not returned with Puppet HTTP Error responses."]}
That would be fixed by upgrading the instance to stretch T179371
Mentioned in SAL (#wikimedia-releng) [2018-01-03T19:52:20Z] <hashar> purging old kernels on deployment-mx / deployment-redis01 / deployment-redis02 | T184114
Mentioned in SAL (#wikimedia-releng) [2018-01-03T19:55:03Z] <hashar> manually upgrading puppet to 4.8 on deployment-mx / deployment-redis01 / deployment-redis02 | T184114
hashar@deployment-cumin:~$ sudo cumin --force '*' 'puppet --version' 77 hosts will be targeted: ----- OUTPUT of 'puppet --version' ----- 4.8.2
deployment-phab is broken but that is another issue I guess.