Upgrade puppet 4.8 on all deployment-prep instance
Closed, ResolvedPublic

Description

There is still three instances running on puppet 3.8.5. Should be 4.8:

===== NODE GROUP =====                                                                                                                               
(3) deployment-mx.deployment-prep.eqiad.wmflabs,deployment-redis[01-02].deployment-prep.eqiad.wmflabs                                                
----- OUTPUT of 'puppet --version' -----                                                                                                             
3.8.5
  • deployment-mx.deployment-prep.eqiad.wmflabs

[ ] deployment-redis01.deployment-prep.eqiad.wmflabs
[ ] deployment-redis02.deployment-prep.eqiad.wmflabs

hashar created this task.Jan 3 2018, 7:45 PM
hashar triaged this task as Normal priority.
hashar updated the task description. (Show Details)
hashar added a comment.Jan 3 2018, 7:49 PM

deployment-mx fails due to mtail requiring systemd:

Error: Could not retrieve catalog from remote server: Error 500 on SERVER: {"message":"Server Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Function Call, You can only use systemd resources on systems with systemd, got upstart at /etc/puppet/modules/systemd/manifests/init.pp:8:9 at /etc/puppet/modules/mtail/manifests/init.pp:37 on node deployment-mx.deployment-prep.eqiad.wmflabs","issue_kind":"RUNTIME_ERROR","stacktrace":["Warning: The 'stacktrace' property is deprecated and will be removed in a future version of Puppet. For security reasons, stacktraces are not returned with Puppet HTTP Error responses."]}

And the redis ones fails due to prometheus redis exporter requiring systemd:

Error: Could not retrieve catalog from remote server: Error 500 on SERVER: {"message":"Server Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Function Call, You can only use systemd resources on systems with systemd, got upstart at /etc/puppet/modules/systemd/manifests/init.pp:8:9 at /etc/puppet/modules/prometheus/manifests/redis_exporter.pp:49 on node deployment-redis01.deployment-prep.eqiad.wmflabs","issue_kind":"RUNTIME_ERROR","stacktrace":["Warning: The 'stacktrace' property is deprecated and will be removed in a future version of Puppet. For security reasons, stacktraces are not returned with Puppet HTTP Error responses."]}

That would be fixed by upgrading the instance to stretch T179371

Mentioned in SAL (#wikimedia-releng) [2018-01-03T19:52:20Z] <hashar> purging old kernels on deployment-mx / deployment-redis01 / deployment-redis02 | T184114

Mentioned in SAL (#wikimedia-releng) [2018-01-03T19:55:03Z] <hashar> manually upgrading puppet to 4.8 on deployment-mx / deployment-redis01 / deployment-redis02 | T184114

hashar closed this task as Resolved.Jan 3 2018, 7:57 PM
hashar claimed this task.
hashar@deployment-cumin:~$ sudo cumin --force '*' 'puppet --version'
77 hosts will be targeted:
----- OUTPUT of 'puppet --version' -----                                                                                                             
4.8.2

deployment-phab is broken but that is another issue I guess.