Page MenuHomePhabricator

Degraded RAID on dumpsdata1007
Closed, ResolvedPublic

Description

TASK AUTO-GENERATED by Nagios/Icinga RAID event handler

A degraded RAID (perccli) was detected on host dumpsdata1007. An automatic snapshot of the current RAID status is attached below.

Please sync with the service owner to find the appropriate time window before actually replacing any failed hardware.

communication: 0 OK

$ sudo /usr/local/lib/nagios/plugins/get-raid-status-perccli
Failed to execute '['/usr/lib/nagios/plugins/check_nrpe', '-4', '-H', 'dumpsdata1007', '-c', 'get_raid_status_perccli']': RETCODE: 2
STDOUT:
communication: 0 OK | controller: 1 Needs Attention | physical_disk: 0 OK | virtual_disk: 1 Dgrd | bbu: 0 OK | enclosure: 0 OK | CLI Version = 007.1910.0000.0000 Oct 08, 2021
Operating system = Linux 5.10.0-25-amd64
Controller = 0
Status = Success
Description = Show Drive Group Succeeded


TOPOLOGY :
========

------------------------------------------------------------------------------
DG Arr Row EID:Slot DID Type   State BT       Size PDC  PI SED DS3  FSpace TR 
------------------------------------------------------------------------------
 0 -   -   -        -   RAID10 Dgrd  N   43.661 TB dflt N  N   dflt N      N  
 0 0   -   -        -   RAID1  Dgrd  N   43.661 TB dflt N  N   dflt N      N  
 0 0   0   64:0     1   DRIVE  Onln  Y    7.276 TB dflt N  N   dflt -      N  
 0 0   1   64:1     2   DRIVE  Onln  Y    7.276 TB dflt N  N   dflt -      N  
 0 0   2   64:2     6   DRIVE  Onln  Y    7.276 TB dflt N  N   dflt -      N  
 0 0   3   64:3     7   DRIVE  Onln  Y    7.276 TB dflt N  N   dflt -      N  
 0 0   4   64:4     5   DRIVE  Onln  Y    7.276 TB dflt N  N   dflt -      N  
 0 0   5   -        -   DRIVE  Msng  -    7.276 TB -    -  -   -    -      N  
 0 0   6   64:6     3   DRIVE  Onln  Y    7.276 TB dflt N  N   dflt -      N  
 0 0   7   64:7     12  DRIVE  Onln  Y    7.276 TB dflt N  N   dflt -      N  
 0 0   8   64:8     8   DRIVE  Onln  Y    7.276 TB dflt N  N   dflt -      N  
 0 0   9   64:9     11  DRIVE  Onln  Y    7.276 TB dflt N  N   dflt -      N  
 0 0   10  64:10    10  DRIVE  Onln  Y    7.276 TB dflt N  N   dflt -      N  
 0 0   11  64:11    13  DRIVE  Onln  Y    7.276 TB dflt N  N   dflt -      N  
 1 -   -   -        -   RAID1  Optl  N  446.625 GB dflt N  N   dflt N      N  
 1 0   -   -        -   RAID1  Optl  N  446.625 GB dflt N  N   dflt N      N  
 1 0   0   64:12    0   DRIVE  Onln  N  446.625 GB dflt N  N   dflt -      N  
 1 0   1   64:13    4   DRIVE  Onln  N  446.625 GB dflt N  N   dflt -      N  
------------------------------------------------------------------------------

DG=Disk Group Index|Arr=Array Index|Row=Row Index|EID=Enclosure Device ID
DID=Device ID|Type=Drive Type|Onln=Online|Rbld=Rebuild|Optl=Optimal|Dgrd=Degraded
Pdgd=Partially degraded|Offln=Offline|BT=Background Task Active
PDC=PD Cache|PI=Protection Info|SED=Self Encrypting Drive|Frgn=Foreign
DS3=Dimmer Switch 3|dflt=Default|Msng=Missing|FSpace=Free Space Present
TR=Transport Ready






STDERR:
None

Event Timeline

ticket submitted

You have successfully submitted request SR186677718.

@Marostegui lets catch up about eta for replacement

Ticket canceled by dell SR186677718 with no reason 14 hours after creating request.

Resubmitted ticket request SR186760900.

Replaced disk 5.

noticed 2nd disk failure disk 7. opened another ticket for replacement of disk 7 You have successfully submitted request SR187258816.

replaced disk 7 with onhand disk will put replacement into extra storage when it arrives