SystemdUnitDown Unit ceph-osd@132.service on node cloudcephosd1017 has been down for long.
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	phaultfinder
	Mar 1 2024, 11:01 PM

Description

dashboard: https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcephosd1017
description: Unit ceph-osd@132.service on node cloudcephosd1017 has been down for long.
runbook: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown
summary: The systemd unit ceph-osd@132.service on node cloudcephosd1017 has been failing for more than two hours.

dashboard: https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcephosd1017
description: Unit ceph-osd@132.service on node cloudcephosd1017 has been down for long.
runbook: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown
summary: The systemd unit ceph-osd@132.service on node cloudcephosd1017 has been failing for more than two hours.
alertname: SystemdUnitDown
cluster: wmcs
instance: cloudcephosd1017:9100
job: node
name: ceph-osd@132.service
prometheus: ops
severity: critical
site: eqiad
source: prometheus
state: failed
team: wmcs
Source

Status	Assigned	Task
Resolved	fnegri	T358925 SystemdUnitDown Unit ceph-osd@132.service on node cloudcephosd1017 has been down for long.
Resolved	dcaro	T358945 cloudcephosd1017 /dev/sdg (osd.132) failed
Resolved	Jclark-ctr	T359049 hw troubleshooting: /dev/sdg disk not working properly in cloudcephosd1017.eqiad.wmnet

The alert is not firing anymore, I will resolve this task but T358945: cloudcephosd1017 /dev/sdg (osd.132) failed is still open until the drive is replaced.