Page MenuHomePhabricator

Degraded RAID on an-worker1204
Open, Needs TriagePublic

Description

TASK AUTO-GENERATED by Nagios/Icinga RAID event handler

A degraded RAID (broadcom) was detected on host an-worker1204. An automatic snapshot of the current RAID status is attached below.

Please sync with the service owner to find the appropriate time window before actually replacing any failed hardware.

communication: 0 OK : controller: 1 Needs Attention : physical_disk: 2 UGood : virtual_disk: 1 OfLn : bbu: 0 OK : enclosure: 0 OK : CLI Version = 007.1910.0000.0000 Oct 08, 2021

$ sudo /usr/local/lib/nagios/plugins/get-raid-status-broadcom
Failed to execute '['/usr/lib/nagios/plugins/check_nrpe', '-4', '-H', 'an-worker1204', '-c', 'get_raid_status_broadcom']': RETCODE: 2
STDOUT:
communication: 0 OK ; controller: 1 Needs Attention ; physical_disk: 2 UGood ; virtual_disk: 1 OfLn ; bbu: 0 OK ; enclosure: 0 OK ; CLI Version = 007.1910.0000.0000 Oct 08, 2021
Operating system = Linux 5.10.0-34-amd64
Controller = 0
Status = Success
Description = Show Drive Group Succeeded


TOPOLOGY :
========

-----------------------------------------------------------------------------
DG Arr Row EID:Slot DID Type  State BT       Size PDC  PI SED DS3  FSpace TR 
-----------------------------------------------------------------------------
 0 -   -   -        -   RAID1 Optl  N  446.625 GB enbl N  N   dflt N      N  
 0 0   -   -        -   RAID1 Optl  N  446.625 GB enbl N  N   dflt N      N  
 0 0   0   251:0    3   DRIVE Onln  N  446.625 GB enbl N  N   dflt -      N  
 0 0   1   251:1    7   DRIVE Onln  N  446.625 GB enbl N  N   dflt -      N  
 1 -   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 1 0   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 1 0   0   252:0    6   DRIVE Onln  N    7.276 TB enbl N  N   dflt -      N  
 2 -   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 2 0   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 2 0   0   252:1    8   DRIVE Onln  N    7.276 TB enbl N  N   dflt -      N  
 3 -   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 3 0   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 3 0   0   252:2    9   DRIVE Onln  N    7.276 TB enbl N  N   dflt -      N  
 4 -   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 4 0   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 4 0   0   252:3    11  DRIVE Onln  N    7.276 TB enbl N  N   dflt -      N  
 5 -   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 5 0   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 5 0   0   252:4    10  DRIVE Onln  N    7.276 TB enbl N  N   dflt -      N  
 6 -   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 6 0   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 6 0   0   252:5    13  DRIVE Onln  N    7.276 TB enbl N  N   dflt -      N  
 7 -   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 7 0   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 7 0   0   252:6    12  DRIVE Onln  N    7.276 TB enbl N  N   dflt -      N  
 8 -   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 8 0   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 8 0   0   252:8    4   DRIVE Onln  N    7.276 TB enbl N  N   dflt -      N  
 9 -   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 9 0   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
 9 0   0   252:9    0   DRIVE Onln  N    7.276 TB enbl N  N   dflt -      N  
10 -   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
10 0   -   -        -   RAID0 Optl  N    7.276 TB enbl N  N   dflt N      N  
10 0   0   252:10   2   DRIVE Onln  N    7.276 TB enbl N  N   dflt -      N  
11 -   -   -        -   RAID0 OfLn  N    7.276 TB enbl N  N   dflt N      N  
11 0   -   -        -   RAID0 Dgrd  N    7.276 TB enbl N  N   dflt N      N  
-----------------------------------------------------------------------------

DG=Disk Group Index|Arr=Array Index|Row=Row Index|EID=Enclosure Device ID
DID=Device ID|Type=Drive Type|Onln=Online|Rbld=Rebuild|Optl=Optimal|Dgrd=Degraded
Pdgd=Partially degraded|Offln=Offline|BT=Background Task Active
PDC=PD Cache|PI=Protection Info|SED=Self Encrypting Drive|Frgn=Foreign
DS3=Dimmer Switch 3|dflt=Default|Msng=Missing|FSpace=Free Space Present
TR=Transport Ready






STDERR:
None

Details

Other Assignee
BTullis

Event Timeline

You have successfully submitted request SR221528423.

@BTullis replacement drive will be on site Jan 21st Please let me know when i can swap drive

Hi @Jclark-ctr - I've unmounted the problematic drive. You can replace it whenever is convenient for you. Thanks.