dmesg on analytics1047.eqiad.wmnet:
[3899221.881936] sd 0:2:3:0: [sdd] [3899221.881944] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [3899221.881945] sd 0:2:3:0: [sdd] [3899221.881946] Sense Key : Medium Error [current] [3899221.881949] sd 0:2:3:0: [sdd] [3899221.881950] Add. Sense: No additional sense information [3899221.881951] sd 0:2:3:0: [sdd] CDB: [3899221.881952] Read(16): 88 00 00 00 00 00 e2 80 08 08 00 00 00 08 00 00 [3899221.881958] end_request: I/O error, dev sdd, sector 3800041480 [3899221.888699] EXT4-fs error (device sdd1): ext4_wait_block_bitmap:476: comm kworker/u289:2: Cannot read block bitmap - block_group = 14497, block_bitmap = 475004929 [3899221.905274] EXT4-fs (sdd1): Delayed block allocation failed for inode 193462982 at logical offset 153 with max blocks 18 with error 5 [3899221.918908] EXT4-fs (sdd1): This should not happen!! Data will be lost
Trying to run fsck on /dev/sdd1 but I am not feeling too confident that it will work. Stopped Hadoop services and scheduled downtime for the host.
Would it be possible to check/swap the disk?
Thanks!
Luca