Page MenuHomePhabricator

deployment-webperf11 stale due to puppet failing
Closed, ResolvedPublic

Description

motd
deployment-webperf11 is a performance team data processor and performance.wikimedia.org server (webperf::processors_and_site)
The last Puppet run was at Thu Aug 20 02:06:33 UTC 2020 (8152 minutes ago).
syslog
puppet-agent-cronjob: Sleeping 17 for random splay
puppet-agent[29627]: Unable to fetch my node definition, but the agent run will continue:
puppet-agent[29627]: Error 500 on SERVER: Server Error: Could not retrieve facts for deployment-webperf11.deployment-prep.eqiad.wmflabs: Failed to find facts from PuppetDB at puppet:8140: Failed to execute '/pdb/query/v4/nodes/deployment-webperf11.deployment-prep.eqiad.wmflabs/facts' on at least 1 of the following 'server_urls': https://deployment-puppetdb03.deployment-prep.eqiad.wmflabs
puppet-agent[29627]: Retrieving pluginfacts
puppet-agent[29627]: Retrieving plugin
puppet-agent[29627]: Retrieving locales
puppet-agent[29627]: Loading facts
puppet-agent[29627]: Could not retrieve catalog from remote server: Error 500 on SERVER: Server Error: Failed to execute '/pdb/cmd/v1?checksum=efce95bd12f8a91d8d5e4d875eb72be50d5d0ca8&version=5&certname=deployment-webperf11.deployment-prep.eqiad.wmflabs&command=replace_facts&producer-timestamp=2020-08-25T17:36:27.120Z' on at least 1 of the following 'server_urls': https://deployment-puppetdb03.deployment-prep.eqiad.wmflabs
puppet-agent[29627]: Not using cache on failed catalog
puppet-agent[29627]: Could not retrieve catalog; skipping run

Event Timeline

dpifke claimed this task.

Failing due to T248041.

I restarted puppetdb.