PuppetDisabled - contint2002
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	phaultfinder
	Apr 13 2026, 3:43 PM

Project Tags

Referenced Files

None

Subscribers

Aklapper

phaultfinder

Description

Common information

dashboard: https://grafana.wikimedia.org/d/yOxVDGvWk/puppet?var-cluster=ci&viewPanel=14
description: Puppet disabled on contint2002:9100
runbook: https://wikitech.wikimedia.org/wiki/Puppet/Runbooks#Puppet_Disabled
summary: Puppet disabled on contint2002:9100

alertname: PuppetDisabled
cluster: ci
instance: contint2002:9100
job: node
prometheus: ops
severity: critical
site: codfw
source: prometheus
team: collaboration-services

Firing alerts

dashboard: https://grafana.wikimedia.org/d/yOxVDGvWk/puppet?var-cluster=ci&viewPanel=14
description: Puppet disabled on contint2002:9100
runbook: https://wikitech.wikimedia.org/wiki/Puppet/Runbooks#Puppet_Disabled
summary: Puppet disabled on contint2002:9100
alertname: PuppetDisabled
cluster: ci
instance: contint2002:9100
job: node
prometheus: ops
severity: critical
site: codfw
source: prometheus
team: collaboration-services
Source

Related Objects

Mentioned In: T420993: Rotate discovery intermediate certificate (expires 2026-05-03)
Mentioned Here: T420993: Rotate discovery intermediate certificate (expires 2026-05-03)

Event Timeline

phaultfinder created this task.Apr 13 2026, 3:43 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 13 2026, 3:43 PM

Dzahn claimed this task.Apr 13 2026, 3:50 PM

LSobanski triaged this task as Medium priority.Apr 13 2026, 3:54 PM

LSobanski moved this task from Incoming to Work in Progress on the Collaboration-Services board.

Dzahn renamed this task from PuppetDisabled to PuppetDisabled - contint2002.Apr 13 2026, 4:36 PM

This was disabled by me due related to debugging Java upgrades on jenkins hosts (on releases hosts) and / or installing docker.io and changing profile::ci::docker out of caution.

Then forgot to re-enable it.

Re-enabled puppet now.

This also applied refresh of the /etc/envoy/ssl/discovery__contint_wikimedia_org_server.chain.pem.

Mentioned in SAL (#wikimedia-operations) [2026-04-13T16:46:09Z] <mutante> contint2002 (prod CI) - re-enabled puppet - this applied a refresh of the contint.wikimedia.org certificate (T423152 T420993)

Stashbot mentioned this in T420993: Rotate discovery intermediate certificate (expires 2026-05-03).Apr 13 2026, 4:46 PM

Dzahn closed this task as Resolved.Apr 13 2026, 4:46 PM

PuppetDisabled - contint2002Closed, ResolvedPublicActions