Degraded RAID on logstash2022
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	ops-monitoring-bot
	Dec 7 2020, 6:45 AM

Description

TASK AUTO-GENERATED by Nagios/Icinga RAID event handler

A degraded RAID (md) was detected on host logstash2022. An automatic snapshot of the current RAID status is attached below.

Please sync with the service owner to find the appropriate time window before actually replacing any failed hardware.

CRITICAL: State: degraded, Active: 7, Working: 7, Failed: 1, Spare: 0

$ sudo /usr/local/lib/nagios/plugins/get-raid-status-md
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10] 
md0 : active raid1 sda2[0] sdd2[3] sdc2[2](F) sdb2[1]
      48794624 blocks super 1.2 [4/3] [UU_U]
      
md1 : active raid0 sda3[0] sdd3[3] sdc3[2] sdb3[1]
      15432220672 blocks super 1.2 512k chunks
      
unused devices: <none>

Event Timeline

ops-monitoring-bot created this task.Dec 7 2020, 6:45 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 7 2020, 6:45 AM

wiki_willy assigned this task to Papaul.Dec 7 2020, 7:36 PM

Papaul triaged this task as Medium priority.Dec 8 2020, 2:58 PM

@wiki_willy the server is out of warranty and uses 4TB disks same as the ms-be. We do not have any spare 4TB disks on site.

Hi @herron - it looks like this server is due to be refreshed next next year. (around Nov 2021) Let me know if you want a replacement disk purchased for this in the mean time, or if you can go without it, until the server replacement.

Thanks,
Willy

@herron any update on this?

I think we can go without it, we plan to replace these older hosts in the near future and also have some logstash refresh hardware that was just ordered. Thanks!

@herron I am closing this task, please fell free to open a decom task when server is ready for decommission

Thanks

Degraded RAID on logstash2022Closed, ResolvedPublicActions

Description

Event Timeline

Degraded RAID on logstash2022
Closed, ResolvedPublic
Actions