Degraded RAID on db1175
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	ops-monitoring-bot
	Jul 22 2021, 3:35 AM

Description

TASK AUTO-GENERATED by Nagios/Icinga RAID event handler

A degraded RAID (megacli) was detected on host db1175. An automatic snapshot of the current RAID status is attached below.

Please sync with the service owner to find the appropriate time window before actually replacing any failed hardware.

CRITICAL: 1 failed LD(s) (Degraded)

$ sudo /usr/local/lib/nagios/plugins/get-raid-status-megacli
=== RaidStatus (does not include components in optimal state)
name: Adapter #0

	Virtual Drive: 0 (Target Id: 0)
	RAID Level: Primary-1, Secondary-0, RAID Level Qualifier-0
	State: =====> Degraded <=====
	Number Of Drives: 10
	Number of Spans: 1
	Current Cache Policy: WriteBack, ReadAhead, Direct, No Write Cache if Bad BBU

		Span: 0 - Number of PDs: 10

			PD: 1 Information
			ERROR: =====> MISSING DRIVE INFO <=====

=== RaidStatus completed

Event Timeline

ops-monitoring-bot created this task.Jul 22 2021, 3:35 AM

Restricted Application added a subscriber: • Marostegui. · View Herald TranscriptJul 22 2021, 3:35 AM

Can we get a new disk for this host?

• Marostegui moved this task from Triage to In progress on the DBA board.Jul 22 2021, 5:02 AM

wiki_willy assigned this task to Jclark-ctr.Jul 22 2021, 3:04 PM

Ticket created with Dell

Create Dispatch: Service Tag: DYV8773

• Cmjohnson moved this task from Backlog to High Priority Task on the ops-eqiad board.Aug 2 2021, 6:44 PM

@Marostegui the disk has been swapped but it appears to have been removed. You will need to add back to the raid configuration. Resolve this task after you restore the raid config.

This is all good now:

root@db1175:~# megacli -LDInfo -Lall -aALL


Adapter 0 -- Virtual Drive Information:
Virtual Drive: 0 (Target Id: 0)
Name                :
RAID Level          : Primary-1, Secondary-0, RAID Level Qualifier-0
Size                : 8.729 TB
Sector Size         : 512
Is VD emulated      : Yes
Mirror Data         : 8.729 TB
State               : Optimal

Thanks Chris!

Degraded RAID on db1175Closed, ResolvedPublicActions

Description

Event Timeline

Degraded RAID on db1175
Closed, ResolvedPublic
Actions