Page MenuHomePhabricator
Create Task
Maniphest T219586

Degraded RAID on cp4032
Closed, InvalidPublic
Actions

Description

TASK AUTO-GENERATED by Nagios/Icinga RAID event handler

A degraded RAID (md) was detected on host cp4032. An automatic snapshot of the current RAID status is attached below.

Please sync with the service owner to find the appropriate time window before actually replacing any failed hardware.

connect to address 10.128.0.132 port 5666: No route to host

$ sudo /usr/local/lib/nagios/plugins/get-raid-status-md
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10] 
md0 : active raid1 sda1[0] sdb1[1]
      9756672 blocks super 1.2 [2/2] [UU]
      
unused devices: <none>

Event Timeline

ops-monitoring-bot added projects: ops-ulsfo, SRE.Mar 29 2019, 3:52 AM
ops-monitoring-bot subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 29 2019, 3:52 AM
fgiunchedi triaged this task as Medium priority.Apr 9 2019, 8:38 AM
RobH moved this task from Backlog to Hardware Failure / Repair on the ops-ulsfo board.Apr 24 2019, 3:11 PM
RobH closed this task as Invalid.Apr 24 2019, 10:14 PM
RobH subscribed.

not sure why that check made this task, as the output in the task description shows a perfectly fine raid. checked the system manually as well, no errors in systlog either

Dzahn subscribed.EditedApr 24 2019, 10:15 PM

It looks like the cause wasn't an actual RAID failure but a networking failure:

connect to address 10.128.0.132 port 5666: No route to host
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL