ms-be1012.eqiad.wmnet: slot=7 dev=sdh failed
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	fgiunchedi
	Jul 12 2016, 2:20 PM

Description

slot=7 dev=sdh has been reported failed, please replace.

/var/log/kern.log

Jul 12 14:09:39 ms-be1012 kernel: [706415.835897] Buffer I/O error on device sdh1, logical block 6
Jul 12 14:09:52 ms-be1012 kernel: [706428.381244] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:10:22 ms-be1012 kernel: [706458.460471] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:10:52 ms-be1012 kernel: [706488.539747] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:11:22 ms-be1012 kernel: [706518.618970] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:11:52 ms-be1012 kernel: [706548.698243] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:12:22 ms-be1012 kernel: [706578.777488] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:12:52 ms-be1012 kernel: [706608.856769] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:13:22 ms-be1012 kernel: [706638.936051] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:13:52 ms-be1012 kernel: [706669.015343] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:14:22 ms-be1012 kernel: [706699.094563] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:14:52 ms-be1012 kernel: [706729.173825] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:15:23 ms-be1012 kernel: [706759.253046] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:15:53 ms-be1012 kernel: [706789.332384] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:16:23 ms-be1012 kernel: [706819.411589] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:16:53 ms-be1012 kernel: [706849.490821] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:17:23 ms-be1012 kernel: [706879.570088] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:17:53 ms-be1012 kernel: [706909.649383] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:18:23 ms-be1012 kernel: [706939.728611] XFS (sdh1): xfs_log_force: error 5 returned.
Jul 12 14:18:53 ms-be1012 kernel: [706969.807845] XFS (sdh1): xfs_log_force: error 5 returned.

smartctl

megacli

Event Timeline

fgiunchedi created this task.Jul 12 2016, 2:20 PM

fgiunchedi updated the task description. (Show Details)

fgiunchedi added a project: ops-eqiad.

fgiunchedi subscribed.

Restricted Application added a project: SRE. · View Herald TranscriptJul 12 2016, 2:20 PM

Restricted Application added subscribers: Zppix, Southparkfan, Aklapper. · View Herald Transcript

fgiunchedi triaged this task as Medium priority.Jul 12 2016, 3:10 PM

• Cmjohnson raised the priority of this task from Medium to Unbreak Now!.Jul 13 2016, 7:38 PM

Restricted Application added subscribers: Luke081515, TerraCodes. · View Herald TranscriptJul 13 2016, 7:38 PM

@fgiunchedi Replaced the disk in slot 7 shows as unconfigured good but could not add back. Please take a look.

thanks! yeah the disk was marked as foreign config, cleared it and readded, now rebuilding

ms-be1012.eqiad.wmnet: slot=7 dev=sdh failedClosed, ResolvedPublicActions