Page MenuHomePhabricator

puppet failed on deployment-logstash2.deployment-prep
Closed, ResolvedPublic

Description

Alert: puppet failed on deployment-logstash2.deployment-prep.eqiad.wmflabs

email is being sent out to all project admins:

"Puppet is failing to run on the "deployment-logstash2" instance in the Wikimedia Labs
project "deployment-prep" "Please take steps to repair this instance or contact a Labs admin for assistance."


08:48 < Krenair> mutante, yeah when you log into that one you get The last Puppet run was at Mon Jun 27 22:12:30 UTC 2016 (11129 minutes ago). Puppet is disabled. Testing kibana4 module on puppetmaster

Event Timeline

bd808 triaged this task as Medium priority.Jul 5 2016, 3:51 PM
bd808 added subscribers: EBernhardson, bd808.

Puppet has been disabled there by @EBernhardson so that the host keeps working while T138328: Upgrade kibana to 4.5.0+ is being tested via cherry-pick on the beta cluster. If we let Puppet run on deployment-logstash2 then our Kibana3 install would be wiped out. This can be fixed once the upgrade patches are merged in ops/puppet and rolled out to production.

and that upgrade should be happening this week, i have to schedule an exact time with @Gehel, but most likely wednesday or thursday in SF morning.

EBernhardson claimed this task.

server upgraded, puppet re-enabled.