Page MenuHomePhabricator

quarry-nfs-1 - alertname: PuppetAgentStaleLastRun project: quarry
Closed, DuplicatePublic

Description

From https://prometheus-alerts.wmcloud.org/?q=%40state%3Dactive:

alertname: PuppetAgentStaleLastRun
project: quarry
summary: Last Puppet run was over 24 hours ago on instance quarry-nfs-1 in project quarry
20 hours ago
instance: quarry-nfs-1
job: node
severity: warn
@receiver: cloud-admin-feed

Event Timeline

dcaro triaged this task as High priority.

For the record, disable reason is

The last Puppet run was at Sun Feb 20 19:29:27 UTC 2022 (3490 minutes ago). Puppet is disabled. migrating nfs service from quarry-nfs-1.quarry.eqiad1.wikimedia.cloud to quarry-nfs-2.quarry.eqiad1.wikimedia.cloud - andrew@buster - andrew

ack, I'll add the file to avoid the alerts from triggering again (at least the emails)

This will stop the emails:

root@quarry-nfs-1:~# touch /.no-puppet-checks