Page MenuHomePhabricator
Paste P52903

Masterwork From Distant Lands
ActivePublic
Actions

Authored by ProdPasteBot on Oct 11 2023, 12:31 PM.
Tags
None
Referenced Files
F38205241: Masterwork From Distant Lands
Oct 11 2023, 12:31 PM
Subscribers
None
===== NODE GROUP =====
(1) cloudcephosd1030.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 01 01:45:02 cloudcephosd1030 smart_failure[1384923]: Device: /dev/sdd [SAT], 712 Offline uncorrectable sectors
Oct 01 02:15:02 cloudcephosd1030 smart_failure[1396279]: Device: /dev/sdj [SAT], 1168 Offline uncorrectable sectors
Oct 01 02:45:02 cloudcephosd1030 smart_failure[1407428]: Device: /dev/sde [SAT], 1936 Offline uncorrectable sectors
Oct 01 04:45:02 cloudcephosd1030 smart_failure[1452484]: Device: /dev/sdf [SAT], 2904 Offline uncorrectable sectors
Oct 01 10:15:02 cloudcephosd1030 smart_failure[1576410]: Device: /dev/sdh [SAT], 2600 Offline uncorrectable sectors
Oct 01 13:15:02 cloudcephosd1030 smart_failure[1644186]: Device: /dev/sdc [SAT], 2264 Offline uncorrectable sectors (changed +8)
Oct 01 13:15:02 cloudcephosd1030 smart_failure[1644205]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Oct 01 16:15:02 cloudcephosd1030 smart_failure[1711798]: Device: /dev/sdg [SAT], 1392 Offline uncorrectable sectors
Oct 02 01:45:02 cloudcephosd1030 smart_failure[1924241]: Device: /dev/sdd [SAT], 720 Offline uncorrectable sectors
Oct 02 02:15:02 cloudcephosd1030 smart_failure[1935840]: Device: /dev/sdj [SAT], 1176 Offline uncorrectable sectors
Oct 02 02:45:02 cloudcephosd1030 smart_failure[1946947]: Device: /dev/sde [SAT], 1936 Offline uncorrectable sectors
Oct 02 04:45:02 cloudcephosd1030 smart_failure[1992109]: Device: /dev/sdf [SAT], 2912 Offline uncorrectable sectors
Oct 02 10:15:02 cloudcephosd1030 smart_failure[2115614]: Device: /dev/sdh [SAT], 2600 Offline uncorrectable sectors
Oct 02 13:15:02 cloudcephosd1030 smart_failure[2182941]: Device: /dev/sdc [SAT], 2264 Offline uncorrectable sectors
Oct 02 13:15:02 cloudcephosd1030 smart_failure[2182960]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Oct 02 16:15:02 cloudcephosd1030 smart_failure[2250370]: Device: /dev/sdg [SAT], 1400 Offline uncorrectable sectors
Oct 03 01:45:02 cloudcephosd1030 smart_failure[2455412]: Device: /dev/sdd [SAT], 720 Offline uncorrectable sectors
Oct 03 02:15:02 cloudcephosd1030 smart_failure[2466805]: Device: /dev/sdj [SAT], 1176 Offline uncorrectable sectors
Oct 03 02:45:02 cloudcephosd1030 smart_failure[2478029]: Device: /dev/sde [SAT], 1944 Offline uncorrectable sectors
Oct 03 04:45:02 cloudcephosd1030 smart_failure[2523016]: Device: /dev/sdf [SAT], 2912 Offline uncorrectable sectors
Oct 03 10:15:02 cloudcephosd1030 smart_failure[2646781]: Device: /dev/sdh [SAT], 2600 Offline uncorrectable sectors
Oct 03 13:15:02 cloudcephosd1030 smart_failure[2715327]: Device: /dev/sdc [SAT], 2264 Offline uncorrectable sectors
Oct 03 13:15:02 cloudcephosd1030 smart_failure[2715346]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Oct 03 16:15:02 cloudcephosd1030 smart_failure[2782722]: Device: /dev/sdg [SAT], 1408 Offline uncorrectable sectors
Oct 04 01:45:02 cloudcephosd1030 smart_failure[2996161]: Device: /dev/sdd [SAT], 720 Offline uncorrectable sectors
Oct 04 02:15:02 cloudcephosd1030 smart_failure[3007509]: Device: /dev/sdj [SAT], 1208 Offline uncorrectable sectors
Oct 04 02:45:02 cloudcephosd1030 smart_failure[3018755]: Device: /dev/sde [SAT], 1944 Offline uncorrectable sectors
Oct 04 04:45:02 cloudcephosd1030 smart_failure[3063745]: Device: /dev/sdf [SAT], 2944 Offline uncorrectable sectors
Oct 04 10:15:02 cloudcephosd1030 smart_failure[3188825]: Device: /dev/sdh [SAT], 2600 Offline uncorrectable sectors
Oct 04 13:15:02 cloudcephosd1030 smart_failure[3256447]: Device: /dev/sdc [SAT], 2264 Offline uncorrectable sectors
Oct 04 13:15:02 cloudcephosd1030 smart_failure[3256466]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Oct 04 16:15:02 cloudcephosd1030 smart_failure[3324555]: Device: /dev/sdg [SAT], 1408 Offline uncorrectable sectors
Oct 05 01:45:02 cloudcephosd1030 smart_failure[3538912]: Device: /dev/sdd [SAT], 720 Offline uncorrectable sectors
Oct 05 02:15:02 cloudcephosd1030 smart_failure[3550065]: Device: /dev/sdj [SAT], 1208 Offline uncorrectable sectors
Oct 05 02:45:02 cloudcephosd1030 smart_failure[3561206]: Device: /dev/sde [SAT], 1944 Offline uncorrectable sectors
Oct 05 04:45:02 cloudcephosd1030 smart_failure[3605969]: Device: /dev/sdf [SAT], 2976 Offline uncorrectable sectors
Oct 05 10:15:02 cloudcephosd1030 smart_failure[3730002]: Device: /dev/sdh [SAT], 2608 Offline uncorrectable sectors
Oct 05 13:15:02 cloudcephosd1030 smart_failure[3809622]: Device: /dev/sdc [SAT], 2264 Offline uncorrectable sectors
Oct 05 13:15:02 cloudcephosd1030 smart_failure[3809641]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Oct 05 16:15:02 cloudcephosd1030 smart_failure[3877380]: Device: /dev/sdg [SAT], 1424 Offline uncorrectable sectors
Oct 06 01:45:02 cloudcephosd1030 smart_failure[4091308]: Device: /dev/sdd [SAT], 720 Offline uncorrectable sectors
Oct 06 02:15:02 cloudcephosd1030 smart_failure[4102610]: Device: /dev/sdj [SAT], 1208 Offline uncorrectable sectors
Oct 06 02:45:02 cloudcephosd1030 smart_failure[4113861]: Device: /dev/sde [SAT], 1944 Offline uncorrectable sectors
Oct 06 04:45:02 cloudcephosd1030 smart_failure[4159497]: Device: /dev/sdf [SAT], 2976 Offline uncorrectable sectors
Oct 06 10:15:02 cloudcephosd1030 smart_failure[90096]: Device: /dev/sdh [SAT], 2608 Offline uncorrectable sectors
Oct 06 13:15:02 cloudcephosd1030 smart_failure[158069]: Device: /dev/sdc [SAT], 2272 Offline uncorrectable sectors
Oct 06 13:15:02 cloudcephosd1030 smart_failure[158088]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Oct 06 16:15:02 cloudcephosd1030 smart_failure[226246]: Device: /dev/sdg [SAT], 1424 Offline uncorrectable sectors
Oct 07 01:45:02 cloudcephosd1030 smart_failure[440224]: Device: /dev/sdd [SAT], 720 Offline uncorrectable sectors
Oct 07 02:15:02 cloudcephosd1030 smart_failure[451415]: Device: /dev/sdj [SAT], 1216 Offline uncorrectable sectors
Oct 07 02:45:02 cloudcephosd1030 smart_failure[462623]: Device: /dev/sde [SAT], 1952 Offline uncorrectable sectors
Oct 07 04:45:03 cloudcephosd1030 smart_failure[507605]: Device: /dev/sdf [SAT], 2984 Offline uncorrectable sectors
Oct 07 10:15:02 cloudcephosd1030 smart_failure[631776]: Device: /dev/sdh [SAT], 2616 Offline uncorrectable sectors
Oct 07 13:15:02 cloudcephosd1030 smart_failure[699449]: Device: /dev/sdc [SAT], 2272 Offline uncorrectable sectors
Oct 07 13:15:02 cloudcephosd1030 smart_failure[699469]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Oct 07 16:15:02 cloudcephosd1030 smart_failure[766980]: Device: /dev/sdg [SAT], 1424 Offline uncorrectable sectors
Oct 08 01:45:02 cloudcephosd1030 smart_failure[981267]: Device: /dev/sdd [SAT], 720 Offline uncorrectable sectors
Oct 08 02:15:02 cloudcephosd1030 smart_failure[992579]: Device: /dev/sdj [SAT], 1216 Offline uncorrectable sectors
Oct 08 02:45:02 cloudcephosd1030 smart_failure[1004041]: Device: /dev/sde [SAT], 1952 Offline uncorrectable sectors
Oct 08 05:15:02 cloudcephosd1030 smart_failure[1060303]: Device: /dev/sdf [SAT], 2984 Offline uncorrectable sectors
Oct 08 10:15:02 cloudcephosd1030 smart_failure[1173008]: Device: /dev/sdh [SAT], 2616 Offline uncorrectable sectors
Oct 08 13:15:03 cloudcephosd1030 smart_failure[1240338]: Device: /dev/sdc [SAT], 2272 Offline uncorrectable sectors
Oct 08 13:15:03 cloudcephosd1030 smart_failure[1240357]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Oct 08 16:15:02 cloudcephosd1030 smart_failure[1308078]: Device: /dev/sdg [SAT], 1432 Offline uncorrectable sectors
Oct 09 01:45:02 cloudcephosd1030 smart_failure[1522376]: Device: /dev/sdd [SAT], 720 Offline uncorrectable sectors
Oct 09 02:15:02 cloudcephosd1030 smart_failure[1533713]: Device: /dev/sdj [SAT], 1224 Offline uncorrectable sectors
Oct 09 02:45:02 cloudcephosd1030 smart_failure[1545051]: Device: /dev/sde [SAT], 1952 Offline uncorrectable sectors
Oct 09 05:15:03 cloudcephosd1030 smart_failure[1601083]: Device: /dev/sdf [SAT], 2984 Offline uncorrectable sectors
Oct 09 10:15:02 cloudcephosd1030 smart_failure[1713436]: Device: /dev/sdh [SAT], 2616 Offline uncorrectable sectors
Oct 09 13:15:02 cloudcephosd1030 smart_failure[1781526]: Device: /dev/sdc [SAT], 2272 Offline uncorrectable sectors
Oct 09 13:45:02 cloudcephosd1030 smart_failure[1792886]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Oct 09 16:15:02 cloudcephosd1030 smart_failure[1848892]: Device: /dev/sdg [SAT], 1448 Offline uncorrectable sectors
Oct 10 01:45:02 cloudcephosd1030 smart_failure[2063321]: Device: /dev/sdd [SAT], 720 Offline uncorrectable sectors
Oct 10 02:15:02 cloudcephosd1030 smart_failure[2074508]: Device: /dev/sdj [SAT], 1224 Offline uncorrectable sectors
Oct 10 02:45:02 cloudcephosd1030 smart_failure[2085711]: Device: /dev/sde [SAT], 1952 Offline uncorrectable sectors
Oct 10 05:15:02 cloudcephosd1030 smart_failure[2141993]: Device: /dev/sdf [SAT], 3000 Offline uncorrectable sectors
Oct 10 10:15:02 cloudcephosd1030 smart_failure[2254994]: Device: /dev/sdh [SAT], 2624 Offline uncorrectable sectors
Oct 10 13:15:03 cloudcephosd1030 smart_failure[2322239]: Device: /dev/sdc [SAT], 2280 Offline uncorrectable sectors
Oct 10 13:45:02 cloudcephosd1030 smart_failure[2333507]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Oct 10 16:15:02 cloudcephosd1030 smart_failure[2389839]: Device: /dev/sdg [SAT], 1448 Offline uncorrectable sectors
Oct 11 01:45:02 cloudcephosd1030 smart_failure[2605386]: Device: /dev/sdd [SAT], 720 Offline uncorrectable sectors
Oct 11 02:15:02 cloudcephosd1030 smart_failure[2616555]: Device: /dev/sdj [SAT], 1232 Offline uncorrectable sectors
Oct 11 02:45:02 cloudcephosd1030 smart_failure[2627846]: Device: /dev/sde [SAT], 1952 Offline uncorrectable sectors
Oct 11 05:15:02 cloudcephosd1030 smart_failure[2684512]: Device: /dev/sdf [SAT], 3000 Offline uncorrectable sectors
Oct 11 10:15:02 cloudcephosd1030 smart_failure[2797289]: Device: /dev/sdh [SAT], 2624 Offline uncorrectable sectors
Sep 15 01:45:02 cloudcephosd1030 smart_failure[1116327]: Device: /dev/sdd [SAT], 624 Offline uncorrectable sectors
Sep 15 02:15:02 cloudcephosd1030 smart_failure[1127611]: Device: /dev/sdj [SAT], 1040 Offline uncorrectable sectors (changed +8)
Sep 15 02:45:02 cloudcephosd1030 smart_failure[1139031]: Device: /dev/sde [SAT], 1856 Offline uncorrectable sectors
Sep 15 04:45:02 cloudcephosd1030 smart_failure[1183790]: Device: /dev/sdf [SAT], 2696 Offline uncorrectable sectors
Sep 15 09:45:02 cloudcephosd1030 smart_failure[1296453]: Device: /dev/sdh [SAT], 2520 Offline uncorrectable sectors
Sep 15 11:45:02 cloudcephosd1030 smart_failure[1341462]: Device: /dev/sdc [SAT], 2192 Offline uncorrectable sectors
Sep 15 12:45:02 cloudcephosd1030 smart_failure[1363915]: Device: /dev/sdi [SAT], 1688 Offline uncorrectable sectors
Sep 15 15:45:03 cloudcephosd1030 smart_failure[1431098]: Device: /dev/sdg [SAT], 1328 Offline uncorrectable sectors
Sep 16 01:45:02 cloudcephosd1030 smart_failure[1655783]: Device: /dev/sdd [SAT], 624 Offline uncorrectable sectors
Sep 16 02:15:02 cloudcephosd1030 smart_failure[1666982]: Device: /dev/sdj [SAT], 1048 Offline uncorrectable sectors
Sep 16 02:45:02 cloudcephosd1030 smart_failure[1678273]: Device: /dev/sde [SAT], 1856 Offline uncorrectable sectors
Sep 16 04:45:02 cloudcephosd1030 smart_failure[1723143]: Device: /dev/sdf [SAT], 2728 Offline uncorrectable sectors
Sep 16 09:45:02 cloudcephosd1030 smart_failure[1835225]: Device: /dev/sdh [SAT], 2528 Offline uncorrectable sectors
Sep 16 11:45:02 cloudcephosd1030 smart_failure[1880134]: Device: /dev/sdc [SAT], 2192 Offline uncorrectable sectors
Sep 16 12:45:02 cloudcephosd1030 smart_failure[1902551]: Device: /dev/sdi [SAT], 1688 Offline uncorrectable sectors
Sep 16 16:15:02 cloudcephosd1030 smart_failure[1980579]: Device: /dev/sdg [SAT], 1328 Offline uncorrectable sectors
Sep 17 01:45:02 cloudcephosd1030 smart_failure[2193135]: Device: /dev/sdd [SAT], 624 Offline uncorrectable sectors
Sep 17 02:15:02 cloudcephosd1030 smart_failure[2204385]: Device: /dev/sdj [SAT], 1048 Offline uncorrectable sectors
Sep 17 02:45:02 cloudcephosd1030 smart_failure[2215568]: Device: /dev/sde [SAT], 1856 Offline uncorrectable sectors
Sep 17 04:45:02 cloudcephosd1030 smart_failure[2260473]: Device: /dev/sdf [SAT], 2744 Offline uncorrectable sectors
Sep 17 09:45:02 cloudcephosd1030 smart_failure[2372370]: Device: /dev/sdh [SAT], 2544 Offline uncorrectable sectors
Sep 17 11:45:02 cloudcephosd1030 smart_failure[2417056]: Device: /dev/sdc [SAT], 2192 Offline uncorrectable sectors
Sep 17 12:45:02 cloudcephosd1030 smart_failure[2439459]: Device: /dev/sdi [SAT], 1688 Offline uncorrectable sectors
Sep 17 16:15:02 cloudcephosd1030 smart_failure[2517571]: Device: /dev/sdg [SAT], 1344 Offline uncorrectable sectors
Sep 18 01:45:02 cloudcephosd1030 smart_failure[2730357]: Device: /dev/sdd [SAT], 624 Offline uncorrectable sectors
Sep 18 02:15:02 cloudcephosd1030 smart_failure[2741574]: Device: /dev/sdj [SAT], 1048 Offline uncorrectable sectors
Sep 18 02:45:02 cloudcephosd1030 smart_failure[2752821]: Device: /dev/sde [SAT], 1880 Offline uncorrectable sectors
Sep 18 04:45:02 cloudcephosd1030 smart_failure[2797696]: Device: /dev/sdf [SAT], 2752 Offline uncorrectable sectors
Sep 18 09:45:03 cloudcephosd1030 smart_failure[2909503]: Device: /dev/sdh [SAT], 2552 Offline uncorrectable sectors
Sep 18 11:45:02 cloudcephosd1030 smart_failure[2954649]: Device: /dev/sdc [SAT], 2192 Offline uncorrectable sectors
Sep 18 12:45:02 cloudcephosd1030 smart_failure[2977788]: Device: /dev/sdi [SAT], 1696 Offline uncorrectable sectors
Sep 18 16:15:02 cloudcephosd1030 smart_failure[3056702]: Device: /dev/sdg [SAT], 1344 Offline uncorrectable sectors
Sep 19 01:45:03 cloudcephosd1030 smart_failure[3269674]: Device: /dev/sdd [SAT], 640 Offline uncorrectable sectors
Sep 19 02:15:02 cloudcephosd1030 smart_failure[3280976]: Device: /dev/sdj [SAT], 1048 Offline uncorrectable sectors
Sep 19 02:45:02 cloudcephosd1030 smart_failure[3292193]: Device: /dev/sde [SAT], 1880 Offline uncorrectable sectors
Sep 19 04:45:02 cloudcephosd1030 smart_failure[3337002]: Device: /dev/sdf [SAT], 2760 Offline uncorrectable sectors
Sep 19 10:15:02 cloudcephosd1030 smart_failure[3461294]: Device: /dev/sdh [SAT], 2552 Offline uncorrectable sectors
Sep 19 11:45:02 cloudcephosd1030 smart_failure[3494978]: Device: /dev/sdc [SAT], 2200 Offline uncorrectable sectors
Sep 19 12:45:02 cloudcephosd1030 smart_failure[3517478]: Device: /dev/sdi [SAT], 1696 Offline uncorrectable sectors
Sep 19 16:15:02 cloudcephosd1030 smart_failure[3597100]: Device: /dev/sdg [SAT], 1360 Offline uncorrectable sectors
Sep 20 01:45:02 cloudcephosd1030 smart_failure[3814352]: Device: /dev/sdd [SAT], 640 Offline uncorrectable sectors
Sep 20 02:15:02 cloudcephosd1030 smart_failure[3825850]: Device: /dev/sdj [SAT], 1056 Offline uncorrectable sectors
Sep 20 02:45:02 cloudcephosd1030 smart_failure[3837231]: Device: /dev/sde [SAT], 1880 Offline uncorrectable sectors
Sep 20 04:45:02 cloudcephosd1030 smart_failure[3882644]: Device: /dev/sdf [SAT], 2768 Offline uncorrectable sectors
Sep 20 10:15:02 cloudcephosd1030 smart_failure[4007829]: Device: /dev/sdh [SAT], 2552 Offline uncorrectable sectors
Sep 20 11:45:02 cloudcephosd1030 smart_failure[4041908]: Device: /dev/sdc [SAT], 2200 Offline uncorrectable sectors
Sep 20 12:45:02 cloudcephosd1030 smart_failure[4064363]: Device: /dev/sdi [SAT], 1728 Offline uncorrectable sectors
Sep 20 16:15:02 cloudcephosd1030 smart_failure[4144255]: Device: /dev/sdg [SAT], 1360 Offline uncorrectable sectors
Sep 21 01:45:02 cloudcephosd1030 smart_failure[166807]: Device: /dev/sdd [SAT], 640 Offline uncorrectable sectors
Sep 21 02:15:02 cloudcephosd1030 smart_failure[178165]: Device: /dev/sdj [SAT], 1056 Offline uncorrectable sectors
Sep 21 02:45:02 cloudcephosd1030 smart_failure[189415]: Device: /dev/sde [SAT], 1904 Offline uncorrectable sectors
Sep 21 04:45:02 cloudcephosd1030 smart_failure[234584]: Device: /dev/sdf [SAT], 2792 Offline uncorrectable sectors
Sep 21 10:15:02 cloudcephosd1030 smart_failure[359618]: Device: /dev/sdh [SAT], 2552 Offline uncorrectable sectors
Sep 21 11:45:02 cloudcephosd1030 smart_failure[393093]: Device: /dev/sdc [SAT], 2200 Offline uncorrectable sectors
Sep 21 12:45:02 cloudcephosd1030 smart_failure[415951]: Device: /dev/sdi [SAT], 1728 Offline uncorrectable sectors
Sep 21 16:15:02 cloudcephosd1030 smart_failure[495992]: Device: /dev/sdg [SAT], 1360 Offline uncorrectable sectors
Sep 22 01:45:02 cloudcephosd1030 smart_failure[711405]: Device: /dev/sdd [SAT], 640 Offline uncorrectable sectors
Sep 22 02:15:02 cloudcephosd1030 smart_failure[722881]: Device: /dev/sdj [SAT], 1072 Offline uncorrectable sectors
Sep 22 02:45:02 cloudcephosd1030 smart_failure[734307]: Device: /dev/sde [SAT], 1904 Offline uncorrectable sectors
Sep 22 04:45:02 cloudcephosd1030 smart_failure[779725]: Device: /dev/sdf [SAT], 2792 Offline uncorrectable sectors
Sep 22 10:15:02 cloudcephosd1030 smart_failure[904949]: Device: /dev/sdh [SAT], 2552 Offline uncorrectable sectors
Sep 22 11:45:03 cloudcephosd1030 smart_failure[938741]: Device: /dev/sdc [SAT], 2200 Offline uncorrectable sectors
Sep 22 12:45:02 cloudcephosd1030 smart_failure[961300]: Device: /dev/sdi [SAT], 1728 Offline uncorrectable sectors
Sep 22 16:15:02 cloudcephosd1030 smart_failure[1040102]: Device: /dev/sdg [SAT], 1360 Offline uncorrectable sectors
Sep 23 01:45:02 cloudcephosd1030 smart_failure[1253502]: Device: /dev/sdd [SAT], 640 Offline uncorrectable sectors
Sep 23 02:15:02 cloudcephosd1030 smart_failure[1264806]: Device: /dev/sdj [SAT], 1104 Offline uncorrectable sectors
Sep 23 02:45:02 cloudcephosd1030 smart_failure[1275893]: Device: /dev/sde [SAT], 1904 Offline uncorrectable sectors
Sep 23 04:45:02 cloudcephosd1030 smart_failure[1320603]: Device: /dev/sdf [SAT], 2792 Offline uncorrectable sectors
Sep 23 10:15:02 cloudcephosd1030 smart_failure[1444674]: Device: /dev/sdh [SAT], 2560 Offline uncorrectable sectors
Sep 23 12:15:02 cloudcephosd1030 smart_failure[1489718]: Device: /dev/sdc [SAT], 2200 Offline uncorrectable sectors
Sep 23 12:45:02 cloudcephosd1030 smart_failure[1501082]: Device: /dev/sdi [SAT], 1728 Offline uncorrectable sectors
Sep 23 16:15:02 cloudcephosd1030 smart_failure[1579938]: Device: /dev/sdg [SAT], 1360 Offline uncorrectable sectors
Sep 24 01:45:02 cloudcephosd1030 smart_failure[1794212]: Device: /dev/sdd [SAT], 640 Offline uncorrectable sectors
Sep 24 02:15:02 cloudcephosd1030 smart_failure[1805528]: Device: /dev/sdj [SAT], 1112 Offline uncorrectable sectors
Sep 24 02:45:02 cloudcephosd1030 smart_failure[1816918]: Device: /dev/sde [SAT], 1904 Offline uncorrectable sectors
Sep 24 04:45:02 cloudcephosd1030 smart_failure[1861942]: Device: /dev/sdf [SAT], 2800 Offline uncorrectable sectors
Sep 24 10:15:02 cloudcephosd1030 smart_failure[1985742]: Device: /dev/sdh [SAT], 2568 Offline uncorrectable sectors
Sep 24 12:15:03 cloudcephosd1030 smart_failure[2030401]: Device: /dev/sdc [SAT], 2208 Offline uncorrectable sectors
Sep 24 12:45:02 cloudcephosd1030 smart_failure[2041326]: Device: /dev/sdi [SAT], 1728 Offline uncorrectable sectors
Sep 24 16:15:02 cloudcephosd1030 smart_failure[2119937]: Device: /dev/sdg [SAT], 1368 Offline uncorrectable sectors
Sep 25 01:45:02 cloudcephosd1030 smart_failure[2333626]: Device: /dev/sdd [SAT], 648 Offline uncorrectable sectors
Sep 25 02:15:02 cloudcephosd1030 smart_failure[2344954]: Device: /dev/sdj [SAT], 1112 Offline uncorrectable sectors
Sep 25 02:45:02 cloudcephosd1030 smart_failure[2356147]: Device: /dev/sde [SAT], 1920 Offline uncorrectable sectors
Sep 25 04:45:02 cloudcephosd1030 smart_failure[2400978]: Device: /dev/sdf [SAT], 2800 Offline uncorrectable sectors
Sep 25 10:15:02 cloudcephosd1030 smart_failure[2524714]: Device: /dev/sdh [SAT], 2576 Offline uncorrectable sectors
Sep 25 12:45:02 cloudcephosd1030 smart_failure[2580713]: Device: /dev/sdc [SAT], 2216 Offline uncorrectable sectors
Sep 25 12:45:02 cloudcephosd1030 smart_failure[2580732]: Device: /dev/sdi [SAT], 1736 Offline uncorrectable sectors
Sep 25 16:15:02 cloudcephosd1030 smart_failure[2659422]: Device: /dev/sdg [SAT], 1368 Offline uncorrectable sectors
Sep 26 01:45:02 cloudcephosd1030 smart_failure[2874395]: Device: /dev/sdd [SAT], 648 Offline uncorrectable sectors
Sep 26 02:15:02 cloudcephosd1030 smart_failure[2885926]: Device: /dev/sdj [SAT], 1112 Offline uncorrectable sectors
Sep 26 02:45:02 cloudcephosd1030 smart_failure[2897294]: Device: /dev/sde [SAT], 1928 Offline uncorrectable sectors
Sep 26 04:45:02 cloudcephosd1030 smart_failure[2942104]: Device: /dev/sdf [SAT], 2800 Offline uncorrectable sectors
Sep 26 10:15:02 cloudcephosd1030 smart_failure[3066211]: Device: /dev/sdh [SAT], 2584 Offline uncorrectable sectors
Sep 26 12:45:03 cloudcephosd1030 smart_failure[3122492]: Device: /dev/sdc [SAT], 2216 Offline uncorrectable sectors
Sep 26 12:45:03 cloudcephosd1030 smart_failure[3122511]: Device: /dev/sdi [SAT], 1752 Offline uncorrectable sectors
Sep 26 16:15:02 cloudcephosd1030 smart_failure[3201645]: Device: /dev/sdg [SAT], 1368 Offline uncorrectable sectors
Sep 27 01:45:02 cloudcephosd1030 smart_failure[3416531]: Device: /dev/sdd [SAT], 648 Offline uncorrectable sectors
Sep 27 02:15:02 cloudcephosd1030 smart_failure[3427742]: Device: /dev/sdj [SAT], 1112 Offline uncorrectable sectors
Sep 27 02:45:02 cloudcephosd1030 smart_failure[3439110]: Device: /dev/sde [SAT], 1928 Offline uncorrectable sectors
Sep 27 04:45:02 cloudcephosd1030 smart_failure[3484056]: Device: /dev/sdf [SAT], 2824 Offline uncorrectable sectors
Sep 27 10:15:02 cloudcephosd1030 smart_failure[3607349]: Device: /dev/sdh [SAT], 2592 Offline uncorrectable sectors
Sep 27 13:15:02 cloudcephosd1030 smart_failure[3675266]: Device: /dev/sdc [SAT], 2240 Offline uncorrectable sectors
Sep 27 13:15:02 cloudcephosd1030 smart_failure[3675285]: Device: /dev/sdi [SAT], 1752 Offline uncorrectable sectors
Sep 27 16:15:02 cloudcephosd1030 smart_failure[3742423]: Device: /dev/sdg [SAT], 1368 Offline uncorrectable sectors
Sep 28 01:45:02 cloudcephosd1030 smart_failure[3956027]: Device: /dev/sdd [SAT], 648 Offline uncorrectable sectors
Sep 28 02:15:02 cloudcephosd1030 smart_failure[3967495]: Device: /dev/sdj [SAT], 1112 Offline uncorrectable sectors
Sep 28 02:45:02 cloudcephosd1030 smart_failure[3978987]: Device: /dev/sde [SAT], 1928 Offline uncorrectable sectors
Sep 28 04:45:02 cloudcephosd1030 smart_failure[4023847]: Device: /dev/sdf [SAT], 2832 Offline uncorrectable sectors
Sep 28 10:15:02 cloudcephosd1030 smart_failure[4147179]: Device: /dev/sdh [SAT], 2592 Offline uncorrectable sectors
Sep 28 13:15:02 cloudcephosd1030 smart_failure[20719]: Device: /dev/sdc [SAT], 2248 Offline uncorrectable sectors
Sep 28 13:15:03 cloudcephosd1030 smart_failure[20738]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Sep 28 16:15:02 cloudcephosd1030 smart_failure[88214]: Device: /dev/sdg [SAT], 1376 Offline uncorrectable sectors
Sep 29 01:45:02 cloudcephosd1030 smart_failure[302443]: Device: /dev/sdd [SAT], 680 Offline uncorrectable sectors
Sep 29 02:15:02 cloudcephosd1030 smart_failure[313735]: Device: /dev/sdj [SAT], 1144 Offline uncorrectable sectors
Sep 29 02:45:02 cloudcephosd1030 smart_failure[324907]: Device: /dev/sde [SAT], 1928 Offline uncorrectable sectors
Sep 29 04:45:02 cloudcephosd1030 smart_failure[370051]: Device: /dev/sdf [SAT], 2896 Offline uncorrectable sectors
Sep 29 10:15:02 cloudcephosd1030 smart_failure[493756]: Device: /dev/sdh [SAT], 2592 Offline uncorrectable sectors
Sep 29 13:15:02 cloudcephosd1030 smart_failure[561361]: Device: /dev/sdc [SAT], 2256 Offline uncorrectable sectors
Sep 29 13:15:02 cloudcephosd1030 smart_failure[561380]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Sep 29 16:15:02 cloudcephosd1030 smart_failure[628981]: Device: /dev/sdg [SAT], 1392 Offline uncorrectable sectors
Sep 30 01:45:02 cloudcephosd1030 smart_failure[842938]: Device: /dev/sdd [SAT], 712 Offline uncorrectable sectors
Sep 30 02:15:02 cloudcephosd1030 smart_failure[854340]: Device: /dev/sdj [SAT], 1152 Offline uncorrectable sectors
Sep 30 02:45:02 cloudcephosd1030 smart_failure[865808]: Device: /dev/sde [SAT], 1928 Offline uncorrectable sectors
Sep 30 04:45:02 cloudcephosd1030 smart_failure[911012]: Device: /dev/sdf [SAT], 2896 Offline uncorrectable sectors
Sep 30 10:15:02 cloudcephosd1030 smart_failure[1035248]: Device: /dev/sdh [SAT], 2600 Offline uncorrectable sectors
Sep 30 13:15:02 cloudcephosd1030 smart_failure[1102857]: Device: /dev/sdc [SAT], 2256 Offline uncorrectable sectors
Sep 30 13:15:02 cloudcephosd1030 smart_failure[1102876]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Sep 30 16:15:02 cloudcephosd1030 smart_failure[1170560]: Device: /dev/sdg [SAT], 1392 Offline uncorrectable sectors
===== NODE GROUP =====
(1) cloudcephosd1029.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 01 00:27:05 cloudcephosd1029 smart_failure[1375666]: Device: /dev/sde [SAT], 2896 Offline uncorrectable sectors
Oct 01 00:27:05 cloudcephosd1029 smart_failure[1375685]: Device: /dev/sdf [SAT], 1024 Offline uncorrectable sectors
Oct 01 00:57:05 cloudcephosd1029 smart_failure[1386513]: Device: /dev/sdj [SAT], 2480 Offline uncorrectable sectors
Oct 01 06:27:05 cloudcephosd1029 smart_failure[1509999]: Device: /dev/sdc [SAT], 1408 Offline uncorrectable sectors
Oct 01 06:27:05 cloudcephosd1029 smart_failure[1510056]: Device: /dev/sdd [SAT], 1920 Offline uncorrectable sectors
Oct 01 10:57:05 cloudcephosd1029 smart_failure[1610909]: Device: /dev/sdh [SAT], 1056 Offline uncorrectable sectors
Oct 01 12:27:05 cloudcephosd1029 smart_failure[1644741]: Device: /dev/sdi [SAT], 960 Offline uncorrectable sectors
Oct 01 19:57:05 cloudcephosd1029 smart_failure[1813227]: Device: /dev/sdg [SAT], 680 Offline uncorrectable sectors
Oct 02 00:27:05 cloudcephosd1029 smart_failure[1913543]: Device: /dev/sde [SAT], 2912 Offline uncorrectable sectors
Oct 02 00:27:05 cloudcephosd1029 smart_failure[1913591]: Device: /dev/sdf [SAT], 1032 Offline uncorrectable sectors
Oct 02 00:57:05 cloudcephosd1029 smart_failure[1924554]: Device: /dev/sdj [SAT], 2488 Offline uncorrectable sectors
Oct 02 06:27:05 cloudcephosd1029 smart_failure[2048181]: Device: /dev/sdc [SAT], 1408 Offline uncorrectable sectors
Oct 02 06:27:05 cloudcephosd1029 smart_failure[2048200]: Device: /dev/sdd [SAT], 1928 Offline uncorrectable sectors
Oct 02 10:57:05 cloudcephosd1029 smart_failure[2148471]: Device: /dev/sdh [SAT], 1056 Offline uncorrectable sectors
Oct 02 12:27:05 cloudcephosd1029 smart_failure[2182294]: Device: /dev/sdi [SAT], 960 Offline uncorrectable sectors
Oct 02 19:57:05 cloudcephosd1029 smart_failure[2349669]: Device: /dev/sdg [SAT], 680 Offline uncorrectable sectors
Oct 03 00:27:05 cloudcephosd1029 smart_failure[2444400]: Device: /dev/sde [SAT], 2928 Offline uncorrectable sectors
Oct 03 00:27:05 cloudcephosd1029 smart_failure[2444419]: Device: /dev/sdf [SAT], 1032 Offline uncorrectable sectors
Oct 03 00:57:05 cloudcephosd1029 smart_failure[2454114]: Device: /dev/sdj [SAT], 2488 Offline uncorrectable sectors
Oct 03 06:27:05 cloudcephosd1029 smart_failure[2576177]: Device: /dev/sdc [SAT], 1408 Offline uncorrectable sectors
Oct 03 06:27:05 cloudcephosd1029 smart_failure[2576223]: Device: /dev/sdd [SAT], 1928 Offline uncorrectable sectors
Oct 03 10:57:05 cloudcephosd1029 smart_failure[2677573]: Device: /dev/sdh [SAT], 1056 Offline uncorrectable sectors
Oct 03 12:27:05 cloudcephosd1029 smart_failure[2711815]: Device: /dev/sdi [SAT], 960 Offline uncorrectable sectors
Oct 03 19:57:05 cloudcephosd1029 smart_failure[2879076]: Device: /dev/sdg [SAT], 680 Offline uncorrectable sectors
Oct 04 00:27:05 cloudcephosd1029 smart_failure[2979814]: Device: /dev/sde [SAT], 2936 Offline uncorrectable sectors
Oct 04 00:27:05 cloudcephosd1029 smart_failure[2979857]: Device: /dev/sdf [SAT], 1032 Offline uncorrectable sectors
Oct 04 00:57:05 cloudcephosd1029 smart_failure[2991026]: Device: /dev/sdj [SAT], 2504 Offline uncorrectable sectors
Oct 04 06:27:05 cloudcephosd1029 smart_failure[3114419]: Device: /dev/sdc [SAT], 1408 Offline uncorrectable sectors
Oct 04 06:27:05 cloudcephosd1029 smart_failure[3114438]: Device: /dev/sdd [SAT], 1928 Offline uncorrectable sectors
Oct 04 10:57:05 cloudcephosd1029 smart_failure[3215056]: Device: /dev/sdh [SAT], 1056 Offline uncorrectable sectors
Oct 04 12:27:05 cloudcephosd1029 smart_failure[3248764]: Device: /dev/sdi [SAT], 960 Offline uncorrectable sectors
Oct 04 19:57:05 cloudcephosd1029 smart_failure[3418157]: Device: /dev/sdg [SAT], 680 Offline uncorrectable sectors
Oct 05 00:57:01 cloudcephosd1029 smart_failure[3530346]: Device: /dev/sde [SAT], 2944 Offline uncorrectable sectors
Oct 05 00:57:01 cloudcephosd1029 smart_failure[3530392]: Device: /dev/sdf [SAT], 1032 Offline uncorrectable sectors
Oct 05 01:27:01 cloudcephosd1029 smart_failure[3541714]: Device: /dev/sdj [SAT], 2504 Offline uncorrectable sectors
Oct 05 06:57:01 cloudcephosd1029 smart_failure[3665213]: Device: /dev/sdc [SAT], 1408 Offline uncorrectable sectors
Oct 05 06:57:01 cloudcephosd1029 smart_failure[3665256]: Device: /dev/sdd [SAT], 1928 Offline uncorrectable sectors
Oct 05 11:27:01 cloudcephosd1029 smart_failure[3767486]: Device: /dev/sdh [SAT], 1056 Offline uncorrectable sectors
Oct 05 12:57:02 cloudcephosd1029 smart_failure[3813117]: Device: /dev/sdi [SAT], 968 Offline uncorrectable sectors
Oct 05 20:27:01 cloudcephosd1029 smart_failure[3981412]: Device: /dev/sdg [SAT], 680 Offline uncorrectable sectors
Oct 06 00:57:01 cloudcephosd1029 smart_failure[4082101]: Device: /dev/sde [SAT], 2944 Offline uncorrectable sectors
Oct 06 00:57:01 cloudcephosd1029 smart_failure[4082149]: Device: /dev/sdf [SAT], 1032 Offline uncorrectable sectors
Oct 06 01:27:01 cloudcephosd1029 smart_failure[4093413]: Device: /dev/sdj [SAT], 2504 Offline uncorrectable sectors
Oct 06 06:57:01 cloudcephosd1029 smart_failure[23991]: Device: /dev/sdc [SAT], 1408 Offline uncorrectable sectors
Oct 06 06:57:01 cloudcephosd1029 smart_failure[24010]: Device: /dev/sdd [SAT], 1936 Offline uncorrectable sectors
Oct 06 11:27:01 cloudcephosd1029 smart_failure[124764]: Device: /dev/sdh [SAT], 1056 Offline uncorrectable sectors
Oct 06 13:27:01 cloudcephosd1029 smart_failure[169759]: Device: /dev/sdi [SAT], 968 Offline uncorrectable sectors
Oct 06 20:27:01 cloudcephosd1029 smart_failure[327496]: Device: /dev/sdg [SAT], 680 Offline uncorrectable sectors
Oct 07 00:57:01 cloudcephosd1029 smart_failure[429102]: Device: /dev/sde [SAT], 2944 Offline uncorrectable sectors
Oct 07 00:57:01 cloudcephosd1029 smart_failure[429150]: Device: /dev/sdf [SAT], 1032 Offline uncorrectable sectors
Oct 07 01:27:01 cloudcephosd1029 smart_failure[440491]: Device: /dev/sdj [SAT], 2528 Offline uncorrectable sectors
Oct 07 06:57:01 cloudcephosd1029 smart_failure[564824]: Device: /dev/sdc [SAT], 1416 Offline uncorrectable sectors
Oct 07 06:57:01 cloudcephosd1029 smart_failure[564869]: Device: /dev/sdd [SAT], 1936 Offline uncorrectable sectors
Oct 07 11:27:01 cloudcephosd1029 smart_failure[666970]: Device: /dev/sdh [SAT], 1064 Offline uncorrectable sectors
Oct 07 13:27:02 cloudcephosd1029 smart_failure[712297]: Device: /dev/sdi [SAT], 968 Offline uncorrectable sectors
Oct 07 20:27:01 cloudcephosd1029 smart_failure[870672]: Device: /dev/sdg [SAT], 680 Offline uncorrectable sectors
Oct 08 00:57:01 cloudcephosd1029 smart_failure[972835]: Device: /dev/sde [SAT], 2960 Offline uncorrectable sectors
Oct 08 00:57:01 cloudcephosd1029 smart_failure[972879]: Device: /dev/sdf [SAT], 1032 Offline uncorrectable sectors
Oct 08 01:27:01 cloudcephosd1029 smart_failure[984368]: Device: /dev/sdj [SAT], 2528 Offline uncorrectable sectors
Oct 08 06:57:02 cloudcephosd1029 smart_failure[1109372]: Device: /dev/sdc [SAT], 1416 Offline uncorrectable sectors
Oct 08 06:57:02 cloudcephosd1029 smart_failure[1109391]: Device: /dev/sdd [SAT], 1944 Offline uncorrectable sectors
Oct 08 11:27:01 cloudcephosd1029 smart_failure[1210980]: Device: /dev/sdh [SAT], 1064 Offline uncorrectable sectors
Oct 08 13:57:01 cloudcephosd1029 smart_failure[1267264]: Device: /dev/sdi [SAT], 968 Offline uncorrectable sectors
Oct 08 20:27:01 cloudcephosd1029 smart_failure[1415033]: Device: /dev/sdg [SAT], 680 Offline uncorrectable sectors
Oct 09 00:57:01 cloudcephosd1029 smart_failure[1516836]: Device: /dev/sde [SAT], 2960 Offline uncorrectable sectors
Oct 09 00:57:01 cloudcephosd1029 smart_failure[1516879]: Device: /dev/sdf [SAT], 1040 Offline uncorrectable sectors
Oct 09 01:27:01 cloudcephosd1029 smart_failure[1528371]: Device: /dev/sdj [SAT], 2528 Offline uncorrectable sectors
Oct 09 07:27:01 cloudcephosd1029 smart_failure[1663926]: Device: /dev/sdc [SAT], 1416 Offline uncorrectable sectors
Oct 09 07:27:01 cloudcephosd1029 smart_failure[1663970]: Device: /dev/sdd [SAT], 1952 Offline uncorrectable sectors
Oct 09 11:27:01 cloudcephosd1029 smart_failure[1754859]: Device: /dev/sdh [SAT], 1064 Offline uncorrectable sectors
Oct 09 13:57:02 cloudcephosd1029 smart_failure[1811474]: Device: /dev/sdi [SAT], 968 Offline uncorrectable sectors
Oct 09 20:27:01 cloudcephosd1029 smart_failure[1958853]: Device: /dev/sdg [SAT], 680 Offline uncorrectable sectors
Oct 10 00:57:01 cloudcephosd1029 smart_failure[2060685]: Device: /dev/sde [SAT], 2984 Offline uncorrectable sectors
Oct 10 00:57:01 cloudcephosd1029 smart_failure[2060728]: Device: /dev/sdf [SAT], 1040 Offline uncorrectable sectors
Oct 10 01:27:01 cloudcephosd1029 smart_failure[2072395]: Device: /dev/sdj [SAT], 2536 Offline uncorrectable sectors
Oct 10 07:27:01 cloudcephosd1029 smart_failure[2208036]: Device: /dev/sdc [SAT], 1424 Offline uncorrectable sectors
Oct 10 07:27:01 cloudcephosd1029 smart_failure[2208079]: Device: /dev/sdd [SAT], 1952 Offline uncorrectable sectors
Oct 10 11:27:01 cloudcephosd1029 smart_failure[2299134]: Device: /dev/sdh [SAT], 1064 Offline uncorrectable sectors
Oct 10 13:57:01 cloudcephosd1029 smart_failure[2355234]: Device: /dev/sdi [SAT], 968 Offline uncorrectable sectors
Oct 10 20:27:01 cloudcephosd1029 smart_failure[2502673]: Device: /dev/sdg [SAT], 680 Offline uncorrectable sectors
Oct 11 00:57:01 cloudcephosd1029 smart_failure[2603689]: Device: /dev/sde [SAT], 2984 Offline uncorrectable sectors
Oct 11 00:57:01 cloudcephosd1029 smart_failure[2603732]: Device: /dev/sdf [SAT], 1040 Offline uncorrectable sectors
Oct 11 01:27:01 cloudcephosd1029 smart_failure[2615210]: Device: /dev/sdj [SAT], 2544 Offline uncorrectable sectors
Oct 11 07:27:01 cloudcephosd1029 smart_failure[2750424]: Device: /dev/sdc [SAT], 1424 Offline uncorrectable sectors
Oct 11 07:27:01 cloudcephosd1029 smart_failure[2750468]: Device: /dev/sdd [SAT], 1952 Offline uncorrectable sectors
Oct 11 11:27:01 cloudcephosd1029 smart_failure[2841042]: Device: /dev/sdh [SAT], 1064 Offline uncorrectable sectors
Sep 08 05:57:05 cloudcephosd1029 smart_failure[1631346]: Device: /dev/sdc [SAT], 1312 Offline uncorrectable sectors
Sep 08 06:27:05 cloudcephosd1029 smart_failure[1643045]: Device: /dev/sdd [SAT], 1872 Offline uncorrectable sectors
Sep 08 10:27:05 cloudcephosd1029 smart_failure[1733333]: Device: /dev/sdh [SAT], 944 Offline uncorrectable sectors
Sep 08 11:57:05 cloudcephosd1029 smart_failure[1767196]: Device: /dev/sdi [SAT], 936 Offline uncorrectable sectors
Sep 08 19:27:05 cloudcephosd1029 smart_failure[1936126]: Device: /dev/sdg [SAT], 640 Offline uncorrectable sectors
Sep 09 00:27:05 cloudcephosd1029 smart_failure[2049517]: Device: /dev/sde [SAT], 2744 Offline uncorrectable sectors
Sep 09 00:27:05 cloudcephosd1029 smart_failure[2049536]: Device: /dev/sdf [SAT], 936 Offline uncorrectable sectors
Sep 09 00:57:05 cloudcephosd1029 smart_failure[2060633]: Device: /dev/sdj [SAT], 2248 Offline uncorrectable sectors
Sep 09 05:57:05 cloudcephosd1029 smart_failure[2173421]: Device: /dev/sdc [SAT], 1312 Offline uncorrectable sectors
Sep 09 06:27:05 cloudcephosd1029 smart_failure[2184877]: Device: /dev/sdd [SAT], 1872 Offline uncorrectable sectors
Sep 09 10:27:05 cloudcephosd1029 smart_failure[2274787]: Device: /dev/sdh [SAT], 976 Offline uncorrectable sectors
Sep 09 11:57:05 cloudcephosd1029 smart_failure[2308232]: Device: /dev/sdi [SAT], 936 Offline uncorrectable sectors
Sep 09 19:27:05 cloudcephosd1029 smart_failure[2477266]: Device: /dev/sdg [SAT], 640 Offline uncorrectable sectors
Sep 10 00:27:05 cloudcephosd1029 smart_failure[2590513]: Device: /dev/sde [SAT], 2744 Offline uncorrectable sectors
Sep 10 00:27:05 cloudcephosd1029 smart_failure[2590556]: Device: /dev/sdf [SAT], 936 Offline uncorrectable sectors
Sep 10 00:57:05 cloudcephosd1029 smart_failure[2601821]: Device: /dev/sdj [SAT], 2256 Offline uncorrectable sectors
Sep 10 05:57:05 cloudcephosd1029 smart_failure[2714485]: Device: /dev/sdc [SAT], 1312 Offline uncorrectable sectors
Sep 10 06:27:05 cloudcephosd1029 smart_failure[2726127]: Device: /dev/sdd [SAT], 1880 Offline uncorrectable sectors (changed +8)
Sep 10 10:27:05 cloudcephosd1029 smart_failure[2816141]: Device: /dev/sdh [SAT], 976 Offline uncorrectable sectors
Sep 10 11:57:05 cloudcephosd1029 smart_failure[2849984]: Device: /dev/sdi [SAT], 936 Offline uncorrectable sectors
Sep 10 19:27:05 cloudcephosd1029 smart_failure[3018959]: Device: /dev/sdg [SAT], 640 Offline uncorrectable sectors
Sep 11 00:27:05 cloudcephosd1029 smart_failure[3131772]: Device: /dev/sde [SAT], 2752 Offline uncorrectable sectors (changed +8)
Sep 11 00:27:05 cloudcephosd1029 smart_failure[3131791]: Device: /dev/sdf [SAT], 936 Offline uncorrectable sectors
Sep 11 00:57:05 cloudcephosd1029 smart_failure[3142873]: Device: /dev/sdj [SAT], 2256 Offline uncorrectable sectors
Sep 11 05:57:05 cloudcephosd1029 smart_failure[3255520]: Device: /dev/sdc [SAT], 1320 Offline uncorrectable sectors
Sep 11 06:27:05 cloudcephosd1029 smart_failure[3267115]: Device: /dev/sdd [SAT], 1880 Offline uncorrectable sectors
Sep 11 10:27:05 cloudcephosd1029 smart_failure[3357203]: Device: /dev/sdh [SAT], 984 Offline uncorrectable sectors
Sep 11 11:57:05 cloudcephosd1029 smart_failure[3391469]: Device: /dev/sdi [SAT], 936 Offline uncorrectable sectors
Sep 11 19:27:05 cloudcephosd1029 smart_failure[3560789]: Device: /dev/sdg [SAT], 648 Offline uncorrectable sectors
Sep 12 00:27:05 cloudcephosd1029 smart_failure[3674245]: Device: /dev/sde [SAT], 2776 Offline uncorrectable sectors
Sep 12 00:27:05 cloudcephosd1029 smart_failure[3674290]: Device: /dev/sdf [SAT], 944 Offline uncorrectable sectors
Sep 12 00:57:05 cloudcephosd1029 smart_failure[3685669]: Device: /dev/sdj [SAT], 2264 Offline uncorrectable sectors
Sep 12 05:57:05 cloudcephosd1029 smart_failure[3798642]: Device: /dev/sdc [SAT], 1320 Offline uncorrectable sectors
Sep 12 06:27:05 cloudcephosd1029 smart_failure[3810433]: Device: /dev/sdd [SAT], 1888 Offline uncorrectable sectors
Sep 12 10:27:05 cloudcephosd1029 smart_failure[3900679]: Device: /dev/sdh [SAT], 984 Offline uncorrectable sectors
Sep 12 11:57:05 cloudcephosd1029 smart_failure[3934237]: Device: /dev/sdi [SAT], 936 Offline uncorrectable sectors
Sep 12 19:27:05 cloudcephosd1029 smart_failure[4102562]: Device: /dev/sdg [SAT], 648 Offline uncorrectable sectors
Sep 13 00:27:05 cloudcephosd1029 smart_failure[20843]: Device: /dev/sde [SAT], 2776 Offline uncorrectable sectors
Sep 13 00:27:05 cloudcephosd1029 smart_failure[20886]: Device: /dev/sdf [SAT], 944 Offline uncorrectable sectors
Sep 13 00:57:05 cloudcephosd1029 smart_failure[32025]: Device: /dev/sdj [SAT], 2264 Offline uncorrectable sectors
Sep 13 05:57:05 cloudcephosd1029 smart_failure[143677]: Device: /dev/sdc [SAT], 1320 Offline uncorrectable sectors
Sep 13 06:27:05 cloudcephosd1029 smart_failure[155157]: Device: /dev/sdd [SAT], 1904 Offline uncorrectable sectors
Sep 13 10:27:05 cloudcephosd1029 smart_failure[244272]: Device: /dev/sdh [SAT], 984 Offline uncorrectable sectors
Sep 13 11:57:05 cloudcephosd1029 smart_failure[277433]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 13 19:27:05 cloudcephosd1029 smart_failure[445345]: Device: /dev/sdg [SAT], 656 Offline uncorrectable sectors
Sep 14 00:27:05 cloudcephosd1029 smart_failure[557257]: Device: /dev/sde [SAT], 2776 Offline uncorrectable sectors
Sep 14 00:27:06 cloudcephosd1029 smart_failure[557276]: Device: /dev/sdf [SAT], 944 Offline uncorrectable sectors
Sep 14 00:57:05 cloudcephosd1029 smart_failure[568238]: Device: /dev/sdj [SAT], 2312 Offline uncorrectable sectors
Sep 14 05:57:05 cloudcephosd1029 smart_failure[680940]: Device: /dev/sdc [SAT], 1328 Offline uncorrectable sectors
Sep 14 06:27:05 cloudcephosd1029 smart_failure[692730]: Device: /dev/sdd [SAT], 1904 Offline uncorrectable sectors
Sep 14 10:27:05 cloudcephosd1029 smart_failure[783278]: Device: /dev/sdh [SAT], 984 Offline uncorrectable sectors
Sep 14 11:57:05 cloudcephosd1029 smart_failure[817216]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 14 19:27:05 cloudcephosd1029 smart_failure[986085]: Device: /dev/sdg [SAT], 656 Offline uncorrectable sectors
Sep 15 00:27:05 cloudcephosd1029 smart_failure[1098343]: Device: /dev/sde [SAT], 2776 Offline uncorrectable sectors
Sep 15 00:27:05 cloudcephosd1029 smart_failure[1098387]: Device: /dev/sdf [SAT], 960 Offline uncorrectable sectors
Sep 15 00:57:05 cloudcephosd1029 smart_failure[1109998]: Device: /dev/sdj [SAT], 2320 Offline uncorrectable sectors
Sep 15 05:57:05 cloudcephosd1029 smart_failure[1223695]: Device: /dev/sdc [SAT], 1328 Offline uncorrectable sectors
Sep 15 06:27:05 cloudcephosd1029 smart_failure[1235359]: Device: /dev/sdd [SAT], 1904 Offline uncorrectable sectors
Sep 15 10:27:06 cloudcephosd1029 smart_failure[1325544]: Device: /dev/sdh [SAT], 984 Offline uncorrectable sectors
Sep 15 11:57:05 cloudcephosd1029 smart_failure[1359132]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 15 19:27:05 cloudcephosd1029 smart_failure[1528810]: Device: /dev/sdg [SAT], 656 Offline uncorrectable sectors
Sep 16 00:27:05 cloudcephosd1029 smart_failure[1642179]: Device: /dev/sde [SAT], 2784 Offline uncorrectable sectors
Sep 16 00:27:05 cloudcephosd1029 smart_failure[1642198]: Device: /dev/sdf [SAT], 960 Offline uncorrectable sectors
Sep 16 00:57:05 cloudcephosd1029 smart_failure[1653395]: Device: /dev/sdj [SAT], 2336 Offline uncorrectable sectors
Sep 16 05:57:05 cloudcephosd1029 smart_failure[1766484]: Device: /dev/sdc [SAT], 1328 Offline uncorrectable sectors
Sep 16 06:27:05 cloudcephosd1029 smart_failure[1778034]: Device: /dev/sdd [SAT], 1904 Offline uncorrectable sectors
Sep 16 10:57:05 cloudcephosd1029 smart_failure[1879608]: Device: /dev/sdh [SAT], 984 Offline uncorrectable sectors
Sep 16 11:57:05 cloudcephosd1029 smart_failure[1902254]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 16 19:27:06 cloudcephosd1029 smart_failure[2071553]: Device: /dev/sdg [SAT], 664 Offline uncorrectable sectors
Sep 17 00:27:05 cloudcephosd1029 smart_failure[2184695]: Device: /dev/sde [SAT], 2792 Offline uncorrectable sectors
Sep 17 00:27:05 cloudcephosd1029 smart_failure[2184714]: Device: /dev/sdf [SAT], 968 Offline uncorrectable sectors
Sep 17 00:57:05 cloudcephosd1029 smart_failure[2195746]: Device: /dev/sdj [SAT], 2336 Offline uncorrectable sectors
Sep 17 05:57:05 cloudcephosd1029 smart_failure[2308872]: Device: /dev/sdc [SAT], 1336 Offline uncorrectable sectors
Sep 17 06:27:05 cloudcephosd1029 smart_failure[2320265]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 17 10:57:05 cloudcephosd1029 smart_failure[2421926]: Device: /dev/sdh [SAT], 984 Offline uncorrectable sectors
Sep 17 11:57:06 cloudcephosd1029 smart_failure[2444377]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 17 19:57:05 cloudcephosd1029 smart_failure[2624512]: Device: /dev/sdg [SAT], 664 Offline uncorrectable sectors
Sep 18 00:27:05 cloudcephosd1029 smart_failure[2726828]: Device: /dev/sde [SAT], 2800 Offline uncorrectable sectors
Sep 18 00:27:05 cloudcephosd1029 smart_failure[2726847]: Device: /dev/sdf [SAT], 968 Offline uncorrectable sectors
Sep 18 00:57:05 cloudcephosd1029 smart_failure[2738037]: Device: /dev/sdj [SAT], 2352 Offline uncorrectable sectors
Sep 18 05:57:05 cloudcephosd1029 smart_failure[2850914]: Device: /dev/sdc [SAT], 1336 Offline uncorrectable sectors
Sep 18 06:27:05 cloudcephosd1029 smart_failure[2862375]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 18 10:57:05 cloudcephosd1029 smart_failure[2963945]: Device: /dev/sdh [SAT], 984 Offline uncorrectable sectors
Sep 18 12:27:05 cloudcephosd1029 smart_failure[2997386]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 18 19:57:05 cloudcephosd1029 smart_failure[3166698]: Device: /dev/sdg [SAT], 664 Offline uncorrectable sectors
Sep 19 00:27:05 cloudcephosd1029 smart_failure[3268377]: Device: /dev/sde [SAT], 2824 Offline uncorrectable sectors (changed +16)
Sep 19 00:27:05 cloudcephosd1029 smart_failure[3268396]: Device: /dev/sdf [SAT], 976 Offline uncorrectable sectors
Sep 19 00:57:05 cloudcephosd1029 smart_failure[3279512]: Device: /dev/sdj [SAT], 2352 Offline uncorrectable sectors
Sep 19 05:57:05 cloudcephosd1029 smart_failure[3392127]: Device: /dev/sdc [SAT], 1352 Offline uncorrectable sectors
Sep 19 06:27:05 cloudcephosd1029 smart_failure[3403862]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 19 10:57:05 cloudcephosd1029 smart_failure[3505775]: Device: /dev/sdh [SAT], 984 Offline uncorrectable sectors
Sep 19 12:27:05 cloudcephosd1029 smart_failure[3539957]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 19 19:57:05 cloudcephosd1029 smart_failure[3710384]: Device: /dev/sdg [SAT], 664 Offline uncorrectable sectors
Sep 20 00:27:05 cloudcephosd1029 smart_failure[3813885]: Device: /dev/sde [SAT], 2832 Offline uncorrectable sectors
Sep 20 00:27:05 cloudcephosd1029 smart_failure[3813904]: Device: /dev/sdf [SAT], 976 Offline uncorrectable sectors
Sep 20 00:57:05 cloudcephosd1029 smart_failure[3824877]: Device: /dev/sdj [SAT], 2368 Offline uncorrectable sectors
Sep 20 05:57:05 cloudcephosd1029 smart_failure[3938050]: Device: /dev/sdc [SAT], 1352 Offline uncorrectable sectors
Sep 20 06:27:05 cloudcephosd1029 smart_failure[3949271]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 20 10:57:05 cloudcephosd1029 smart_failure[4050654]: Device: /dev/sdh [SAT], 984 Offline uncorrectable sectors
Sep 20 12:27:05 cloudcephosd1029 smart_failure[4084774]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 20 19:57:05 cloudcephosd1029 smart_failure[60635]: Device: /dev/sdg [SAT], 664 Offline uncorrectable sectors
Sep 21 00:27:05 cloudcephosd1029 smart_failure[162779]: Device: /dev/sde [SAT], 2832 Offline uncorrectable sectors
Sep 21 00:27:05 cloudcephosd1029 smart_failure[162822]: Device: /dev/sdf [SAT], 976 Offline uncorrectable sectors
Sep 21 00:57:05 cloudcephosd1029 smart_failure[174284]: Device: /dev/sdj [SAT], 2392 Offline uncorrectable sectors
Sep 21 05:57:05 cloudcephosd1029 smart_failure[287122]: Device: /dev/sdc [SAT], 1368 Offline uncorrectable sectors
Sep 21 06:27:05 cloudcephosd1029 smart_failure[298527]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 21 10:57:05 cloudcephosd1029 smart_failure[399654]: Device: /dev/sdh [SAT], 1008 Offline uncorrectable sectors
Sep 21 12:27:05 cloudcephosd1029 smart_failure[433418]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 21 19:57:05 cloudcephosd1029 smart_failure[603440]: Device: /dev/sdg [SAT], 664 Offline uncorrectable sectors
Sep 22 00:27:05 cloudcephosd1029 smart_failure[704938]: Device: /dev/sde [SAT], 2832 Offline uncorrectable sectors
Sep 22 00:27:05 cloudcephosd1029 smart_failure[704980]: Device: /dev/sdf [SAT], 1000 Offline uncorrectable sectors
Sep 22 00:57:05 cloudcephosd1029 smart_failure[716129]: Device: /dev/sdj [SAT], 2392 Offline uncorrectable sectors
Sep 22 05:57:06 cloudcephosd1029 smart_failure[828849]: Device: /dev/sdc [SAT], 1376 Offline uncorrectable sectors
Sep 22 06:27:05 cloudcephosd1029 smart_failure[840207]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 22 10:57:05 cloudcephosd1029 smart_failure[942105]: Device: /dev/sdh [SAT], 1008 Offline uncorrectable sectors
Sep 22 12:27:05 cloudcephosd1029 smart_failure[975654]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 22 19:57:05 cloudcephosd1029 smart_failure[1144924]: Device: /dev/sdg [SAT], 664 Offline uncorrectable sectors
Sep 23 00:27:05 cloudcephosd1029 smart_failure[1246843]: Device: /dev/sde [SAT], 2832 Offline uncorrectable sectors
Sep 23 00:27:05 cloudcephosd1029 smart_failure[1246862]: Device: /dev/sdf [SAT], 1008 Offline uncorrectable sectors
Sep 23 00:57:05 cloudcephosd1029 smart_failure[1257765]: Device: /dev/sdj [SAT], 2400 Offline uncorrectable sectors
Sep 23 06:27:05 cloudcephosd1029 smart_failure[1382227]: Device: /dev/sdc [SAT], 1376 Offline uncorrectable sectors
Sep 23 06:27:05 cloudcephosd1029 smart_failure[1382270]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 23 10:57:05 cloudcephosd1029 smart_failure[1483654]: Device: /dev/sdh [SAT], 1032 Offline uncorrectable sectors
Sep 23 12:27:05 cloudcephosd1029 smart_failure[1517275]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 23 19:57:05 cloudcephosd1029 smart_failure[1685852]: Device: /dev/sdg [SAT], 664 Offline uncorrectable sectors
Sep 24 00:27:05 cloudcephosd1029 smart_failure[1787916]: Device: /dev/sde [SAT], 2840 Offline uncorrectable sectors
Sep 24 00:27:05 cloudcephosd1029 smart_failure[1787935]: Device: /dev/sdf [SAT], 1008 Offline uncorrectable sectors
Sep 24 00:57:05 cloudcephosd1029 smart_failure[1799177]: Device: /dev/sdj [SAT], 2416 Offline uncorrectable sectors
Sep 24 06:27:05 cloudcephosd1029 smart_failure[1923068]: Device: /dev/sdc [SAT], 1376 Offline uncorrectable sectors
Sep 24 06:27:05 cloudcephosd1029 smart_failure[1923087]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 24 10:57:05 cloudcephosd1029 smart_failure[2024731]: Device: /dev/sdh [SAT], 1032 Offline uncorrectable sectors
Sep 24 12:27:05 cloudcephosd1029 smart_failure[2058375]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 24 19:57:05 cloudcephosd1029 smart_failure[2227309]: Device: /dev/sdg [SAT], 664 Offline uncorrectable sectors
Sep 25 00:27:05 cloudcephosd1029 smart_failure[2328796]: Device: /dev/sde [SAT], 2840 Offline uncorrectable sectors
Sep 25 00:27:05 cloudcephosd1029 smart_failure[2328815]: Device: /dev/sdf [SAT], 1016 Offline uncorrectable sectors
Sep 25 00:57:05 cloudcephosd1029 smart_failure[2339875]: Device: /dev/sdj [SAT], 2416 Offline uncorrectable sectors
Sep 25 06:27:05 cloudcephosd1029 smart_failure[2463666]: Device: /dev/sdc [SAT], 1384 Offline uncorrectable sectors
Sep 25 06:27:05 cloudcephosd1029 smart_failure[2463685]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 25 10:57:05 cloudcephosd1029 smart_failure[2564359]: Device: /dev/sdh [SAT], 1040 Offline uncorrectable sectors
Sep 25 12:27:05 cloudcephosd1029 smart_failure[2598559]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 25 19:57:05 cloudcephosd1029 smart_failure[2767264]: Device: /dev/sdg [SAT], 664 Offline uncorrectable sectors
Sep 26 00:27:05 cloudcephosd1029 smart_failure[2868398]: Device: /dev/sde [SAT], 2848 Offline uncorrectable sectors
Sep 26 00:27:05 cloudcephosd1029 smart_failure[2868443]: Device: /dev/sdf [SAT], 1016 Offline uncorrectable sectors
Sep 26 00:57:05 cloudcephosd1029 smart_failure[2879744]: Device: /dev/sdj [SAT], 2424 Offline uncorrectable sectors
Sep 26 06:27:05 cloudcephosd1029 smart_failure[3003868]: Device: /dev/sdc [SAT], 1400 Offline uncorrectable sectors
Sep 26 06:27:05 cloudcephosd1029 smart_failure[3003916]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 26 10:57:05 cloudcephosd1029 smart_failure[3105737]: Device: /dev/sdh [SAT], 1040 Offline uncorrectable sectors
Sep 26 12:27:05 cloudcephosd1029 smart_failure[3139317]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 26 19:57:05 cloudcephosd1029 smart_failure[3307704]: Device: /dev/sdg [SAT], 664 Offline uncorrectable sectors
Sep 27 00:27:05 cloudcephosd1029 smart_failure[3409218]: Device: /dev/sde [SAT], 2864 Offline uncorrectable sectors
Sep 27 00:27:05 cloudcephosd1029 smart_failure[3409263]: Device: /dev/sdf [SAT], 1024 Offline uncorrectable sectors
Sep 27 00:57:05 cloudcephosd1029 smart_failure[3420344]: Device: /dev/sdj [SAT], 2456 Offline uncorrectable sectors
Sep 27 06:27:05 cloudcephosd1029 smart_failure[3544840]: Device: /dev/sdc [SAT], 1400 Offline uncorrectable sectors
Sep 27 06:27:05 cloudcephosd1029 smart_failure[3544883]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 27 10:57:05 cloudcephosd1029 smart_failure[3645164]: Device: /dev/sdh [SAT], 1040 Offline uncorrectable sectors
Sep 27 12:27:05 cloudcephosd1029 smart_failure[3679078]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 27 19:57:05 cloudcephosd1029 smart_failure[3847829]: Device: /dev/sdg [SAT], 664 Offline uncorrectable sectors
Sep 28 00:27:05 cloudcephosd1029 smart_failure[3949657]: Device: /dev/sde [SAT], 2872 Offline uncorrectable sectors
Sep 28 00:27:05 cloudcephosd1029 smart_failure[3949700]: Device: /dev/sdf [SAT], 1024 Offline uncorrectable sectors
Sep 28 00:57:05 cloudcephosd1029 smart_failure[3961065]: Device: /dev/sdj [SAT], 2464 Offline uncorrectable sectors
Sep 28 06:27:05 cloudcephosd1029 smart_failure[4085258]: Device: /dev/sdc [SAT], 1400 Offline uncorrectable sectors
Sep 28 06:27:05 cloudcephosd1029 smart_failure[4085306]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 28 10:57:05 cloudcephosd1029 smart_failure[4186490]: Device: /dev/sdh [SAT], 1048 Offline uncorrectable sectors
Sep 28 12:27:05 cloudcephosd1029 smart_failure[27182]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 28 19:57:05 cloudcephosd1029 smart_failure[196985]: Device: /dev/sdg [SAT], 664 Offline uncorrectable sectors
Sep 29 00:27:05 cloudcephosd1029 smart_failure[298545]: Device: /dev/sde [SAT], 2872 Offline uncorrectable sectors
Sep 29 00:27:05 cloudcephosd1029 smart_failure[298564]: Device: /dev/sdf [SAT], 1024 Offline uncorrectable sectors
Sep 29 00:57:05 cloudcephosd1029 smart_failure[309605]: Device: /dev/sdj [SAT], 2464 Offline uncorrectable sectors
Sep 29 06:27:05 cloudcephosd1029 smart_failure[432779]: Device: /dev/sdc [SAT], 1408 Offline uncorrectable sectors
Sep 29 06:27:05 cloudcephosd1029 smart_failure[432822]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 29 10:57:05 cloudcephosd1029 smart_failure[534165]: Device: /dev/sdh [SAT], 1048 Offline uncorrectable sectors
Sep 29 12:27:05 cloudcephosd1029 smart_failure[567832]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 29 19:57:05 cloudcephosd1029 smart_failure[735451]: Device: /dev/sdg [SAT], 672 Offline uncorrectable sectors
Sep 30 00:27:05 cloudcephosd1029 smart_failure[836529]: Device: /dev/sde [SAT], 2880 Offline uncorrectable sectors
Sep 30 00:27:05 cloudcephosd1029 smart_failure[836574]: Device: /dev/sdf [SAT], 1024 Offline uncorrectable sectors
Sep 30 00:57:05 cloudcephosd1029 smart_failure[847742]: Device: /dev/sdj [SAT], 2472 Offline uncorrectable sectors
Sep 30 06:27:05 cloudcephosd1029 smart_failure[971316]: Device: /dev/sdc [SAT], 1408 Offline uncorrectable sectors
Sep 30 06:27:05 cloudcephosd1029 smart_failure[971335]: Device: /dev/sdd [SAT], 1912 Offline uncorrectable sectors
Sep 30 10:57:05 cloudcephosd1029 smart_failure[1072014]: Device: /dev/sdh [SAT], 1048 Offline uncorrectable sectors
Sep 30 12:27:05 cloudcephosd1029 smart_failure[1106070]: Device: /dev/sdi [SAT], 944 Offline uncorrectable sectors
Sep 30 19:57:05 cloudcephosd1029 smart_failure[1274267]: Device: /dev/sdg [SAT], 680 Offline uncorrectable sectors
===== NODE GROUP =====
(1) cloudcephosd1025.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 01 04:23:01 cloudcephosd1025 smart_failure[1591431]: Device: /dev/sde [SAT], 1400 Offline uncorrectable sectors
Oct 01 09:23:01 cloudcephosd1025 smart_failure[1704445]: Device: /dev/sdh [SAT], 1904 Offline uncorrectable sectors
Oct 01 12:23:01 cloudcephosd1025 smart_failure[1771899]: Device: /dev/sdd [SAT], 2224 Offline uncorrectable sectors
Oct 01 13:23:01 cloudcephosd1025 smart_failure[1794383]: Device: /dev/sdg [SAT], 1576 Offline uncorrectable sectors
Oct 01 13:23:01 cloudcephosd1025 smart_failure[1794433]: Device: /dev/sdj [SAT], 840 Offline uncorrectable sectors
Oct 01 15:53:01 cloudcephosd1025 smart_failure[1850634]: Device: /dev/sdf [SAT], 1520 Offline uncorrectable sectors
Oct 01 20:53:01 cloudcephosd1025 smart_failure[1963871]: Device: /dev/sdb [SAT], 1440 Offline uncorrectable sectors
Oct 01 22:23:01 cloudcephosd1025 smart_failure[1997548]: Device: /dev/sdi [SAT], 1592 Offline uncorrectable sectors
Oct 02 04:23:01 cloudcephosd1025 smart_failure[2132344]: Device: /dev/sde [SAT], 1400 Offline uncorrectable sectors
Oct 02 09:23:01 cloudcephosd1025 smart_failure[2244397]: Device: /dev/sdh [SAT], 1904 Offline uncorrectable sectors
Oct 02 12:23:01 cloudcephosd1025 smart_failure[2312168]: Device: /dev/sdd [SAT], 2240 Offline uncorrectable sectors (changed +8)
Oct 02 13:23:02 cloudcephosd1025 smart_failure[2334913]: Device: /dev/sdg [SAT], 1576 Offline uncorrectable sectors
Oct 02 13:23:02 cloudcephosd1025 smart_failure[2334960]: Device: /dev/sdj [SAT], 848 Offline uncorrectable sectors (changed +8)
Oct 02 15:53:01 cloudcephosd1025 smart_failure[2390870]: Device: /dev/sdf [SAT], 1528 Offline uncorrectable sectors
Oct 02 20:53:01 cloudcephosd1025 smart_failure[2503484]: Device: /dev/sdb [SAT], 1440 Offline uncorrectable sectors
Oct 02 22:23:01 cloudcephosd1025 smart_failure[2536202]: Device: /dev/sdi [SAT], 1592 Offline uncorrectable sectors
Oct 03 04:23:01 cloudcephosd1025 smart_failure[2663927]: Device: /dev/sde [SAT], 1400 Offline uncorrectable sectors
Oct 03 09:23:01 cloudcephosd1025 smart_failure[2776542]: Device: /dev/sdh [SAT], 1904 Offline uncorrectable sectors
Oct 03 12:23:01 cloudcephosd1025 smart_failure[2843667]: Device: /dev/sdd [SAT], 2248 Offline uncorrectable sectors
Oct 03 13:23:01 cloudcephosd1025 smart_failure[2866780]: Device: /dev/sdg [SAT], 1576 Offline uncorrectable sectors
Oct 03 13:53:01 cloudcephosd1025 smart_failure[2877780]: Device: /dev/sdj [SAT], 848 Offline uncorrectable sectors
Oct 03 15:53:01 cloudcephosd1025 smart_failure[2922796]: Device: /dev/sdf [SAT], 1536 Offline uncorrectable sectors
Oct 03 20:53:01 cloudcephosd1025 smart_failure[3035559]: Device: /dev/sdb [SAT], 1440 Offline uncorrectable sectors
Oct 03 22:23:02 cloudcephosd1025 smart_failure[3069543]: Device: /dev/sdi [SAT], 1600 Offline uncorrectable sectors
Oct 04 04:23:01 cloudcephosd1025 smart_failure[3204851]: Device: /dev/sde [SAT], 1400 Offline uncorrectable sectors
Oct 04 09:23:01 cloudcephosd1025 smart_failure[3318347]: Device: /dev/sdh [SAT], 1912 Offline uncorrectable sectors
Oct 04 12:23:02 cloudcephosd1025 smart_failure[3385838]: Device: /dev/sdd [SAT], 2248 Offline uncorrectable sectors
Oct 04 13:23:02 cloudcephosd1025 smart_failure[3408428]: Device: /dev/sdg [SAT], 1576 Offline uncorrectable sectors
Oct 04 13:53:02 cloudcephosd1025 smart_failure[3419541]: Device: /dev/sdj [SAT], 864 Offline uncorrectable sectors
Oct 04 15:53:02 cloudcephosd1025 smart_failure[3464781]: Device: /dev/sdf [SAT], 1560 Offline uncorrectable sectors
Oct 04 20:53:02 cloudcephosd1025 smart_failure[3578205]: Device: /dev/sdb [SAT], 1440 Offline uncorrectable sectors
Oct 04 22:23:02 cloudcephosd1025 smart_failure[3612343]: Device: /dev/sdi [SAT], 1600 Offline uncorrectable sectors
Oct 05 04:23:02 cloudcephosd1025 smart_failure[3747212]: Device: /dev/sde [SAT], 1408 Offline uncorrectable sectors
Oct 05 09:23:02 cloudcephosd1025 smart_failure[3859935]: Device: /dev/sdh [SAT], 1912 Offline uncorrectable sectors
Oct 05 12:23:02 cloudcephosd1025 smart_failure[3928230]: Device: /dev/sdd [SAT], 2248 Offline uncorrectable sectors
Oct 05 13:23:02 cloudcephosd1025 smart_failure[3962147]: Device: /dev/sdg [SAT], 1576 Offline uncorrectable sectors
Oct 05 13:53:02 cloudcephosd1025 smart_failure[3973293]: Device: /dev/sdj [SAT], 864 Offline uncorrectable sectors
Oct 05 15:53:02 cloudcephosd1025 smart_failure[4018508]: Device: /dev/sdf [SAT], 1584 Offline uncorrectable sectors
Oct 05 20:53:02 cloudcephosd1025 smart_failure[4130925]: Device: /dev/sdb [SAT], 1448 Offline uncorrectable sectors
Oct 05 22:23:02 cloudcephosd1025 smart_failure[4165102]: Device: /dev/sdi [SAT], 1600 Offline uncorrectable sectors
Oct 06 04:23:02 cloudcephosd1025 smart_failure[106710]: Device: /dev/sde [SAT], 1408 Offline uncorrectable sectors
Oct 06 09:23:02 cloudcephosd1025 smart_failure[220519]: Device: /dev/sdh [SAT], 1912 Offline uncorrectable sectors
Oct 06 12:23:02 cloudcephosd1025 smart_failure[287823]: Device: /dev/sdd [SAT], 2248 Offline uncorrectable sectors
Oct 06 13:23:02 cloudcephosd1025 smart_failure[310104]: Device: /dev/sdg [SAT], 1576 Offline uncorrectable sectors
Oct 06 13:53:02 cloudcephosd1025 smart_failure[320988]: Device: /dev/sdj [SAT], 880 Offline uncorrectable sectors
Oct 06 15:53:02 cloudcephosd1025 smart_failure[366472]: Device: /dev/sdf [SAT], 1592 Offline uncorrectable sectors
Oct 06 20:53:02 cloudcephosd1025 smart_failure[479338]: Device: /dev/sdb [SAT], 1448 Offline uncorrectable sectors
Oct 06 22:23:02 cloudcephosd1025 smart_failure[513085]: Device: /dev/sdi [SAT], 1600 Offline uncorrectable sectors
Oct 07 04:23:02 cloudcephosd1025 smart_failure[648411]: Device: /dev/sde [SAT], 1416 Offline uncorrectable sectors
Oct 07 09:23:02 cloudcephosd1025 smart_failure[761011]: Device: /dev/sdh [SAT], 1912 Offline uncorrectable sectors
Oct 07 12:23:02 cloudcephosd1025 smart_failure[828676]: Device: /dev/sdd [SAT], 2248 Offline uncorrectable sectors
Oct 07 13:23:03 cloudcephosd1025 smart_failure[850999]: Device: /dev/sdg [SAT], 1576 Offline uncorrectable sectors
Oct 07 13:53:02 cloudcephosd1025 smart_failure[862029]: Device: /dev/sdj [SAT], 880 Offline uncorrectable sectors
Oct 07 15:53:02 cloudcephosd1025 smart_failure[907085]: Device: /dev/sdf [SAT], 1592 Offline uncorrectable sectors
Oct 07 20:53:02 cloudcephosd1025 smart_failure[1019682]: Device: /dev/sdb [SAT], 1448 Offline uncorrectable sectors
Oct 07 22:23:02 cloudcephosd1025 smart_failure[1053667]: Device: /dev/sdi [SAT], 1600 Offline uncorrectable sectors
Oct 08 04:23:02 cloudcephosd1025 smart_failure[1189158]: Device: /dev/sde [SAT], 1424 Offline uncorrectable sectors
Oct 08 09:23:02 cloudcephosd1025 smart_failure[1301764]: Device: /dev/sdh [SAT], 1912 Offline uncorrectable sectors
Oct 08 12:23:02 cloudcephosd1025 smart_failure[1369194]: Device: /dev/sdd [SAT], 2256 Offline uncorrectable sectors
Oct 08 13:23:02 cloudcephosd1025 smart_failure[1391588]: Device: /dev/sdg [SAT], 1576 Offline uncorrectable sectors
Oct 08 13:53:02 cloudcephosd1025 smart_failure[1402665]: Device: /dev/sdj [SAT], 880 Offline uncorrectable sectors
Oct 08 15:53:02 cloudcephosd1025 smart_failure[1447984]: Device: /dev/sdf [SAT], 1608 Offline uncorrectable sectors
Oct 08 20:53:02 cloudcephosd1025 smart_failure[1560962]: Device: /dev/sdb [SAT], 1448 Offline uncorrectable sectors
Oct 08 22:23:02 cloudcephosd1025 smart_failure[1594614]: Device: /dev/sdi [SAT], 1600 Offline uncorrectable sectors
Oct 09 04:23:02 cloudcephosd1025 smart_failure[1730123]: Device: /dev/sde [SAT], 1424 Offline uncorrectable sectors
Oct 09 09:23:02 cloudcephosd1025 smart_failure[1842523]: Device: /dev/sdh [SAT], 1920 Offline uncorrectable sectors
Oct 09 12:23:02 cloudcephosd1025 smart_failure[1910096]: Device: /dev/sdd [SAT], 2272 Offline uncorrectable sectors
Oct 09 13:23:03 cloudcephosd1025 smart_failure[1932693]: Device: /dev/sdg [SAT], 1584 Offline uncorrectable sectors
Oct 09 13:53:02 cloudcephosd1025 smart_failure[1943804]: Device: /dev/sdj [SAT], 888 Offline uncorrectable sectors
Oct 09 15:53:02 cloudcephosd1025 smart_failure[1988912]: Device: /dev/sdf [SAT], 1616 Offline uncorrectable sectors (changed +8)
Oct 09 20:53:02 cloudcephosd1025 smart_failure[2101515]: Device: /dev/sdb [SAT], 1464 Offline uncorrectable sectors
Oct 09 22:23:02 cloudcephosd1025 smart_failure[2135482]: Device: /dev/sdi [SAT], 1600 Offline uncorrectable sectors
Oct 10 04:23:02 cloudcephosd1025 smart_failure[2270560]: Device: /dev/sde [SAT], 1440 Offline uncorrectable sectors
Oct 10 09:23:02 cloudcephosd1025 smart_failure[2383411]: Device: /dev/sdh [SAT], 1920 Offline uncorrectable sectors
Oct 10 12:23:02 cloudcephosd1025 smart_failure[2451100]: Device: /dev/sdd [SAT], 2272 Offline uncorrectable sectors
Oct 10 13:23:02 cloudcephosd1025 smart_failure[2475138]: Device: /dev/sdg [SAT], 1584 Offline uncorrectable sectors
Oct 10 13:53:02 cloudcephosd1025 smart_failure[2485915]: Device: /dev/sdj [SAT], 896 Offline uncorrectable sectors
Oct 10 15:53:02 cloudcephosd1025 smart_failure[2530428]: Device: /dev/sdf [SAT], 1616 Offline uncorrectable sectors
Oct 10 20:53:02 cloudcephosd1025 smart_failure[2643401]: Device: /dev/sdb [SAT], 1464 Offline uncorrectable sectors
Oct 10 22:23:02 cloudcephosd1025 smart_failure[2677357]: Device: /dev/sdi [SAT], 1600 Offline uncorrectable sectors
Oct 11 04:23:02 cloudcephosd1025 smart_failure[2812474]: Device: /dev/sde [SAT], 1440 Offline uncorrectable sectors
Oct 11 09:23:02 cloudcephosd1025 smart_failure[2925458]: Device: /dev/sdh [SAT], 1920 Offline uncorrectable sectors
Oct 11 12:23:02 cloudcephosd1025 smart_failure[2993791]: Device: /dev/sdd [SAT], 2272 Offline uncorrectable sectors
Sep 09 08:23:01 cloudcephosd1025 smart_failure[2330694]: Device: /dev/sdh [SAT], 1824 Offline uncorrectable sectors
Sep 09 12:23:01 cloudcephosd1025 smart_failure[2420433]: Device: /dev/sdd [SAT], 2112 Offline uncorrectable sectors (changed +8)
Sep 09 12:53:01 cloudcephosd1025 smart_failure[2431476]: Device: /dev/sdg [SAT], 1504 Offline uncorrectable sectors
Sep 09 13:23:01 cloudcephosd1025 smart_failure[2442933]: Device: /dev/sdj [SAT], 744 Offline uncorrectable sectors
Sep 09 15:53:01 cloudcephosd1025 smart_failure[2498949]: Device: /dev/sdf [SAT], 1400 Offline uncorrectable sectors
Sep 09 20:53:01 cloudcephosd1025 smart_failure[2611587]: Device: /dev/sdb [SAT], 1360 Offline uncorrectable sectors
Sep 09 22:23:01 cloudcephosd1025 smart_failure[2645738]: Device: /dev/sdi [SAT], 1472 Offline uncorrectable sectors
Sep 10 02:23:01 cloudcephosd1025 smart_failure[2736233]: Device: /dev/sde [SAT], 1280 Offline uncorrectable sectors
Sep 10 08:23:01 cloudcephosd1025 smart_failure[2871579]: Device: /dev/sdh [SAT], 1824 Offline uncorrectable sectors
Sep 10 12:23:01 cloudcephosd1025 smart_failure[2961730]: Device: /dev/sdd [SAT], 2112 Offline uncorrectable sectors
Sep 10 12:53:01 cloudcephosd1025 smart_failure[2972797]: Device: /dev/sdg [SAT], 1504 Offline uncorrectable sectors
Sep 10 13:23:01 cloudcephosd1025 smart_failure[2984295]: Device: /dev/sdj [SAT], 744 Offline uncorrectable sectors
Sep 10 15:53:01 cloudcephosd1025 smart_failure[3040673]: Device: /dev/sdf [SAT], 1400 Offline uncorrectable sectors
Sep 10 20:53:01 cloudcephosd1025 smart_failure[3153254]: Device: /dev/sdb [SAT], 1376 Offline uncorrectable sectors
Sep 10 22:23:01 cloudcephosd1025 smart_failure[3187285]: Device: /dev/sdi [SAT], 1480 Offline uncorrectable sectors
Sep 11 02:23:01 cloudcephosd1025 smart_failure[3277379]: Device: /dev/sde [SAT], 1280 Offline uncorrectable sectors
Sep 11 08:23:01 cloudcephosd1025 smart_failure[3412574]: Device: /dev/sdh [SAT], 1824 Offline uncorrectable sectors
Sep 11 12:23:01 cloudcephosd1025 smart_failure[3503531]: Device: /dev/sdd [SAT], 2136 Offline uncorrectable sectors
Sep 11 12:53:01 cloudcephosd1025 smart_failure[3514716]: Device: /dev/sdg [SAT], 1512 Offline uncorrectable sectors
Sep 11 13:23:01 cloudcephosd1025 smart_failure[3525997]: Device: /dev/sdj [SAT], 760 Offline uncorrectable sectors
Sep 11 15:53:01 cloudcephosd1025 smart_failure[3582635]: Device: /dev/sdf [SAT], 1400 Offline uncorrectable sectors
Sep 11 20:53:01 cloudcephosd1025 smart_failure[3695921]: Device: /dev/sdb [SAT], 1400 Offline uncorrectable sectors
Sep 11 22:23:01 cloudcephosd1025 smart_failure[3729853]: Device: /dev/sdi [SAT], 1480 Offline uncorrectable sectors
Sep 12 02:23:01 cloudcephosd1025 smart_failure[3820624]: Device: /dev/sde [SAT], 1280 Offline uncorrectable sectors
Sep 12 08:23:01 cloudcephosd1025 smart_failure[3956074]: Device: /dev/sdh [SAT], 1824 Offline uncorrectable sectors
Sep 12 12:23:01 cloudcephosd1025 smart_failure[4046583]: Device: /dev/sdd [SAT], 2136 Offline uncorrectable sectors
Sep 12 12:53:01 cloudcephosd1025 smart_failure[4057721]: Device: /dev/sdg [SAT], 1512 Offline uncorrectable sectors
Sep 12 13:23:01 cloudcephosd1025 smart_failure[4069535]: Device: /dev/sdj [SAT], 760 Offline uncorrectable sectors
Sep 12 15:53:01 cloudcephosd1025 smart_failure[4125524]: Device: /dev/sdf [SAT], 1408 Offline uncorrectable sectors
Sep 12 20:53:01 cloudcephosd1025 smart_failure[44799]: Device: /dev/sdb [SAT], 1400 Offline uncorrectable sectors
Sep 12 22:23:01 cloudcephosd1025 smart_failure[78778]: Device: /dev/sdi [SAT], 1480 Offline uncorrectable sectors
Sep 13 02:23:01 cloudcephosd1025 smart_failure[169491]: Device: /dev/sde [SAT], 1280 Offline uncorrectable sectors
Sep 13 08:23:01 cloudcephosd1025 smart_failure[304934]: Device: /dev/sdh [SAT], 1832 Offline uncorrectable sectors (changed +8)
Sep 13 12:23:01 cloudcephosd1025 smart_failure[395153]: Device: /dev/sdd [SAT], 2152 Offline uncorrectable sectors
Sep 13 12:53:01 cloudcephosd1025 smart_failure[406319]: Device: /dev/sdg [SAT], 1512 Offline uncorrectable sectors
Sep 13 13:23:01 cloudcephosd1025 smart_failure[417869]: Device: /dev/sdj [SAT], 768 Offline uncorrectable sectors
Sep 13 15:53:01 cloudcephosd1025 smart_failure[474402]: Device: /dev/sdf [SAT], 1416 Offline uncorrectable sectors
Sep 13 20:53:01 cloudcephosd1025 smart_failure[586824]: Device: /dev/sdb [SAT], 1400 Offline uncorrectable sectors
Sep 13 22:23:01 cloudcephosd1025 smart_failure[620868]: Device: /dev/sdi [SAT], 1480 Offline uncorrectable sectors
Sep 14 02:23:01 cloudcephosd1025 smart_failure[711696]: Device: /dev/sde [SAT], 1288 Offline uncorrectable sectors
Sep 14 08:23:02 cloudcephosd1025 smart_failure[847370]: Device: /dev/sdh [SAT], 1864 Offline uncorrectable sectors
Sep 14 12:23:01 cloudcephosd1025 smart_failure[937559]: Device: /dev/sdd [SAT], 2152 Offline uncorrectable sectors
Sep 14 12:53:01 cloudcephosd1025 smart_failure[948796]: Device: /dev/sdg [SAT], 1512 Offline uncorrectable sectors
Sep 14 13:23:01 cloudcephosd1025 smart_failure[960160]: Device: /dev/sdj [SAT], 768 Offline uncorrectable sectors
Sep 14 15:53:01 cloudcephosd1025 smart_failure[1017000]: Device: /dev/sdf [SAT], 1416 Offline uncorrectable sectors
Sep 14 20:53:01 cloudcephosd1025 smart_failure[1129802]: Device: /dev/sdb [SAT], 1400 Offline uncorrectable sectors
Sep 14 22:23:01 cloudcephosd1025 smart_failure[1163915]: Device: /dev/sdi [SAT], 1488 Offline uncorrectable sectors
Sep 15 02:23:01 cloudcephosd1025 smart_failure[1253817]: Device: /dev/sde [SAT], 1288 Offline uncorrectable sectors
Sep 15 08:53:01 cloudcephosd1025 smart_failure[1400897]: Device: /dev/sdh [SAT], 1864 Offline uncorrectable sectors
Sep 15 12:23:01 cloudcephosd1025 smart_failure[1480780]: Device: /dev/sdd [SAT], 2152 Offline uncorrectable sectors
Sep 15 12:53:01 cloudcephosd1025 smart_failure[1491987]: Device: /dev/sdg [SAT], 1512 Offline uncorrectable sectors
Sep 15 13:23:01 cloudcephosd1025 smart_failure[1503689]: Device: /dev/sdj [SAT], 768 Offline uncorrectable sectors
Sep 15 15:53:01 cloudcephosd1025 smart_failure[1559528]: Device: /dev/sdf [SAT], 1424 Offline uncorrectable sectors
Sep 15 20:53:01 cloudcephosd1025 smart_failure[1673335]: Device: /dev/sdb [SAT], 1408 Offline uncorrectable sectors
Sep 15 22:23:01 cloudcephosd1025 smart_failure[1707707]: Device: /dev/sdi [SAT], 1520 Offline uncorrectable sectors
Sep 16 02:23:01 cloudcephosd1025 smart_failure[1798863]: Device: /dev/sde [SAT], 1296 Offline uncorrectable sectors
Sep 16 08:53:02 cloudcephosd1025 smart_failure[1946509]: Device: /dev/sdh [SAT], 1880 Offline uncorrectable sectors
Sep 16 12:23:01 cloudcephosd1025 smart_failure[2026063]: Device: /dev/sdd [SAT], 2176 Offline uncorrectable sectors
Sep 16 12:53:01 cloudcephosd1025 smart_failure[2037224]: Device: /dev/sdg [SAT], 1512 Offline uncorrectable sectors
Sep 16 13:23:01 cloudcephosd1025 smart_failure[2048778]: Device: /dev/sdj [SAT], 776 Offline uncorrectable sectors
Sep 16 15:53:01 cloudcephosd1025 smart_failure[2105037]: Device: /dev/sdf [SAT], 1432 Offline uncorrectable sectors
Sep 16 20:53:01 cloudcephosd1025 smart_failure[2218427]: Device: /dev/sdb [SAT], 1408 Offline uncorrectable sectors
Sep 16 22:23:01 cloudcephosd1025 smart_failure[2252810]: Device: /dev/sdi [SAT], 1520 Offline uncorrectable sectors
Sep 17 02:23:01 cloudcephosd1025 smart_failure[2343659]: Device: /dev/sde [SAT], 1304 Offline uncorrectable sectors (changed +8)
Sep 17 09:23:01 cloudcephosd1025 smart_failure[2502488]: Device: /dev/sdh [SAT], 1888 Offline uncorrectable sectors
Sep 17 12:23:01 cloudcephosd1025 smart_failure[2570391]: Device: /dev/sdd [SAT], 2176 Offline uncorrectable sectors
Sep 17 12:53:01 cloudcephosd1025 smart_failure[2581649]: Device: /dev/sdg [SAT], 1512 Offline uncorrectable sectors
Sep 17 13:23:01 cloudcephosd1025 smart_failure[2593033]: Device: /dev/sdj [SAT], 784 Offline uncorrectable sectors
Sep 17 15:53:01 cloudcephosd1025 smart_failure[2649607]: Device: /dev/sdf [SAT], 1432 Offline uncorrectable sectors
Sep 17 20:53:01 cloudcephosd1025 smart_failure[2762654]: Device: /dev/sdb [SAT], 1408 Offline uncorrectable sectors
Sep 17 22:23:01 cloudcephosd1025 smart_failure[2796963]: Device: /dev/sdi [SAT], 1520 Offline uncorrectable sectors
Sep 18 02:23:01 cloudcephosd1025 smart_failure[2888030]: Device: /dev/sde [SAT], 1304 Offline uncorrectable sectors
Sep 18 09:23:01 cloudcephosd1025 smart_failure[3046676]: Device: /dev/sdh [SAT], 1888 Offline uncorrectable sectors
Sep 18 12:23:01 cloudcephosd1025 smart_failure[3114242]: Device: /dev/sdd [SAT], 2176 Offline uncorrectable sectors
Sep 18 12:53:01 cloudcephosd1025 smart_failure[3125883]: Device: /dev/sdg [SAT], 1512 Offline uncorrectable sectors
Sep 18 13:23:01 cloudcephosd1025 smart_failure[3137373]: Device: /dev/sdj [SAT], 800 Offline uncorrectable sectors (changed +8)
Sep 18 15:53:01 cloudcephosd1025 smart_failure[3193452]: Device: /dev/sdf [SAT], 1448 Offline uncorrectable sectors
Sep 18 20:53:01 cloudcephosd1025 smart_failure[3306871]: Device: /dev/sdb [SAT], 1408 Offline uncorrectable sectors
Sep 18 22:23:01 cloudcephosd1025 smart_failure[3341318]: Device: /dev/sdi [SAT], 1528 Offline uncorrectable sectors
Sep 19 02:23:01 cloudcephosd1025 smart_failure[3432656]: Device: /dev/sde [SAT], 1328 Offline uncorrectable sectors
Sep 19 09:23:01 cloudcephosd1025 smart_failure[3592274]: Device: /dev/sdh [SAT], 1888 Offline uncorrectable sectors
Sep 19 12:23:01 cloudcephosd1025 smart_failure[3660018]: Device: /dev/sdd [SAT], 2176 Offline uncorrectable sectors
Sep 19 12:53:01 cloudcephosd1025 smart_failure[3671425]: Device: /dev/sdg [SAT], 1512 Offline uncorrectable sectors
Sep 19 13:23:01 cloudcephosd1025 smart_failure[3682798]: Device: /dev/sdj [SAT], 800 Offline uncorrectable sectors
Sep 19 15:53:01 cloudcephosd1025 smart_failure[3739328]: Device: /dev/sdf [SAT], 1448 Offline uncorrectable sectors
Sep 19 20:53:01 cloudcephosd1025 smart_failure[3853728]: Device: /dev/sdb [SAT], 1408 Offline uncorrectable sectors
Sep 19 22:23:01 cloudcephosd1025 smart_failure[3888267]: Device: /dev/sdi [SAT], 1536 Offline uncorrectable sectors
Sep 20 02:23:01 cloudcephosd1025 smart_failure[3978906]: Device: /dev/sde [SAT], 1328 Offline uncorrectable sectors
Sep 20 09:23:01 cloudcephosd1025 smart_failure[4137162]: Device: /dev/sdh [SAT], 1896 Offline uncorrectable sectors
Sep 20 12:23:01 cloudcephosd1025 smart_failure[10833]: Device: /dev/sdd [SAT], 2192 Offline uncorrectable sectors
Sep 20 12:53:01 cloudcephosd1025 smart_failure[21893]: Device: /dev/sdg [SAT], 1536 Offline uncorrectable sectors
Sep 20 13:23:01 cloudcephosd1025 smart_failure[33434]: Device: /dev/sdj [SAT], 800 Offline uncorrectable sectors
Sep 20 15:53:01 cloudcephosd1025 smart_failure[89855]: Device: /dev/sdf [SAT], 1448 Offline uncorrectable sectors
Sep 20 20:53:01 cloudcephosd1025 smart_failure[201987]: Device: /dev/sdb [SAT], 1408 Offline uncorrectable sectors
Sep 20 22:23:01 cloudcephosd1025 smart_failure[236325]: Device: /dev/sdi [SAT], 1536 Offline uncorrectable sectors
Sep 21 02:23:02 cloudcephosd1025 smart_failure[326502]: Device: /dev/sde [SAT], 1344 Offline uncorrectable sectors
Sep 21 09:23:01 cloudcephosd1025 smart_failure[483394]: Device: /dev/sdh [SAT], 1896 Offline uncorrectable sectors
Sep 21 12:23:01 cloudcephosd1025 smart_failure[551285]: Device: /dev/sdd [SAT], 2192 Offline uncorrectable sectors
Sep 21 12:53:01 cloudcephosd1025 smart_failure[562360]: Device: /dev/sdg [SAT], 1536 Offline uncorrectable sectors
Sep 21 13:23:01 cloudcephosd1025 smart_failure[573773]: Device: /dev/sdj [SAT], 808 Offline uncorrectable sectors
Sep 21 15:53:01 cloudcephosd1025 smart_failure[629948]: Device: /dev/sdf [SAT], 1448 Offline uncorrectable sectors
Sep 21 20:53:01 cloudcephosd1025 smart_failure[742313]: Device: /dev/sdb [SAT], 1416 Offline uncorrectable sectors
Sep 21 22:23:01 cloudcephosd1025 smart_failure[776434]: Device: /dev/sdi [SAT], 1536 Offline uncorrectable sectors
Sep 22 02:53:01 cloudcephosd1025 smart_failure[877287]: Device: /dev/sde [SAT], 1352 Offline uncorrectable sectors
Sep 22 09:23:01 cloudcephosd1025 smart_failure[1023800]: Device: /dev/sdh [SAT], 1896 Offline uncorrectable sectors
Sep 22 12:23:01 cloudcephosd1025 smart_failure[1090679]: Device: /dev/sdd [SAT], 2192 Offline uncorrectable sectors
Sep 22 12:53:01 cloudcephosd1025 smart_failure[1102011]: Device: /dev/sdg [SAT], 1536 Offline uncorrectable sectors
Sep 22 13:23:01 cloudcephosd1025 smart_failure[1113549]: Device: /dev/sdj [SAT], 808 Offline uncorrectable sectors
Sep 22 15:53:01 cloudcephosd1025 smart_failure[1170173]: Device: /dev/sdf [SAT], 1448 Offline uncorrectable sectors
Sep 22 20:53:01 cloudcephosd1025 smart_failure[1283260]: Device: /dev/sdb [SAT], 1416 Offline uncorrectable sectors
Sep 22 22:23:01 cloudcephosd1025 smart_failure[1317345]: Device: /dev/sdi [SAT], 1536 Offline uncorrectable sectors
Sep 23 02:53:02 cloudcephosd1025 smart_failure[1418740]: Device: /dev/sde [SAT], 1360 Offline uncorrectable sectors
Sep 23 09:23:01 cloudcephosd1025 smart_failure[1565917]: Device: /dev/sdh [SAT], 1896 Offline uncorrectable sectors
Sep 23 12:23:01 cloudcephosd1025 smart_failure[1633288]: Device: /dev/sdd [SAT], 2192 Offline uncorrectable sectors
Sep 23 12:53:01 cloudcephosd1025 smart_failure[1644496]: Device: /dev/sdg [SAT], 1536 Offline uncorrectable sectors
Sep 23 13:23:01 cloudcephosd1025 smart_failure[1655643]: Device: /dev/sdj [SAT], 808 Offline uncorrectable sectors
Sep 23 15:53:01 cloudcephosd1025 smart_failure[1711730]: Device: /dev/sdf [SAT], 1448 Offline uncorrectable sectors
Sep 23 20:53:01 cloudcephosd1025 smart_failure[1824101]: Device: /dev/sdb [SAT], 1416 Offline uncorrectable sectors
Sep 23 22:23:01 cloudcephosd1025 smart_failure[1858212]: Device: /dev/sdi [SAT], 1544 Offline uncorrectable sectors
Sep 24 03:23:01 cloudcephosd1025 smart_failure[1970961]: Device: /dev/sde [SAT], 1368 Offline uncorrectable sectors
Sep 24 09:23:01 cloudcephosd1025 smart_failure[2107189]: Device: /dev/sdh [SAT], 1896 Offline uncorrectable sectors
Sep 24 12:23:01 cloudcephosd1025 smart_failure[2174218]: Device: /dev/sdd [SAT], 2200 Offline uncorrectable sectors
Sep 24 12:53:01 cloudcephosd1025 smart_failure[2185609]: Device: /dev/sdg [SAT], 1536 Offline uncorrectable sectors
Sep 24 13:23:01 cloudcephosd1025 smart_failure[2197144]: Device: /dev/sdj [SAT], 808 Offline uncorrectable sectors
Sep 24 15:53:01 cloudcephosd1025 smart_failure[2253325]: Device: /dev/sdf [SAT], 1456 Offline uncorrectable sectors
Sep 24 20:53:01 cloudcephosd1025 smart_failure[2366079]: Device: /dev/sdb [SAT], 1416 Offline uncorrectable sectors
Sep 24 22:23:01 cloudcephosd1025 smart_failure[2400288]: Device: /dev/sdi [SAT], 1552 Offline uncorrectable sectors
Sep 25 03:23:02 cloudcephosd1025 smart_failure[2512267]: Device: /dev/sde [SAT], 1368 Offline uncorrectable sectors
Sep 25 09:23:01 cloudcephosd1025 smart_failure[2647554]: Device: /dev/sdh [SAT], 1896 Offline uncorrectable sectors
Sep 25 12:23:01 cloudcephosd1025 smart_failure[2715438]: Device: /dev/sdd [SAT], 2208 Offline uncorrectable sectors
Sep 25 12:53:01 cloudcephosd1025 smart_failure[2726880]: Device: /dev/sdg [SAT], 1536 Offline uncorrectable sectors
Sep 25 13:23:01 cloudcephosd1025 smart_failure[2737916]: Device: /dev/sdj [SAT], 808 Offline uncorrectable sectors
Sep 25 15:53:01 cloudcephosd1025 smart_failure[2794359]: Device: /dev/sdf [SAT], 1472 Offline uncorrectable sectors
Sep 25 20:53:01 cloudcephosd1025 smart_failure[2907291]: Device: /dev/sdb [SAT], 1424 Offline uncorrectable sectors
Sep 25 22:23:01 cloudcephosd1025 smart_failure[2941348]: Device: /dev/sdi [SAT], 1552 Offline uncorrectable sectors
Sep 26 03:53:01 cloudcephosd1025 smart_failure[3065569]: Device: /dev/sde [SAT], 1384 Offline uncorrectable sectors
Sep 26 09:23:01 cloudcephosd1025 smart_failure[3189822]: Device: /dev/sdh [SAT], 1896 Offline uncorrectable sectors
Sep 26 12:23:01 cloudcephosd1025 smart_failure[3256947]: Device: /dev/sdd [SAT], 2208 Offline uncorrectable sectors
Sep 26 12:53:01 cloudcephosd1025 smart_failure[3268074]: Device: /dev/sdg [SAT], 1536 Offline uncorrectable sectors
Sep 26 13:23:01 cloudcephosd1025 smart_failure[3279885]: Device: /dev/sdj [SAT], 816 Offline uncorrectable sectors
Sep 26 15:53:01 cloudcephosd1025 smart_failure[3335911]: Device: /dev/sdf [SAT], 1472 Offline uncorrectable sectors
Sep 26 20:53:01 cloudcephosd1025 smart_failure[3448158]: Device: /dev/sdb [SAT], 1432 Offline uncorrectable sectors
Sep 26 22:23:01 cloudcephosd1025 smart_failure[3482373]: Device: /dev/sdi [SAT], 1552 Offline uncorrectable sectors
Sep 27 03:53:01 cloudcephosd1025 smart_failure[3606574]: Device: /dev/sde [SAT], 1384 Offline uncorrectable sectors
Sep 27 09:23:01 cloudcephosd1025 smart_failure[3729949]: Device: /dev/sdh [SAT], 1896 Offline uncorrectable sectors
Sep 27 12:23:01 cloudcephosd1025 smart_failure[3797970]: Device: /dev/sdd [SAT], 2216 Offline uncorrectable sectors
Sep 27 12:53:01 cloudcephosd1025 smart_failure[3808995]: Device: /dev/sdg [SAT], 1552 Offline uncorrectable sectors
Sep 27 13:23:01 cloudcephosd1025 smart_failure[3820476]: Device: /dev/sdj [SAT], 824 Offline uncorrectable sectors
Sep 27 15:53:01 cloudcephosd1025 smart_failure[3877478]: Device: /dev/sdf [SAT], 1496 Offline uncorrectable sectors
Sep 27 20:53:01 cloudcephosd1025 smart_failure[3990737]: Device: /dev/sdb [SAT], 1432 Offline uncorrectable sectors
Sep 27 22:23:01 cloudcephosd1025 smart_failure[4024269]: Device: /dev/sdi [SAT], 1552 Offline uncorrectable sectors
Sep 28 03:53:01 cloudcephosd1025 smart_failure[4148363]: Device: /dev/sde [SAT], 1384 Offline uncorrectable sectors
Sep 28 09:23:01 cloudcephosd1025 smart_failure[78823]: Device: /dev/sdh [SAT], 1896 Offline uncorrectable sectors
Sep 28 12:23:01 cloudcephosd1025 smart_failure[146335]: Device: /dev/sdd [SAT], 2216 Offline uncorrectable sectors
Sep 28 12:53:01 cloudcephosd1025 smart_failure[157846]: Device: /dev/sdg [SAT], 1552 Offline uncorrectable sectors
Sep 28 13:23:01 cloudcephosd1025 smart_failure[169215]: Device: /dev/sdj [SAT], 832 Offline uncorrectable sectors
Sep 28 15:53:01 cloudcephosd1025 smart_failure[225452]: Device: /dev/sdf [SAT], 1496 Offline uncorrectable sectors
Sep 28 20:53:01 cloudcephosd1025 smart_failure[338480]: Device: /dev/sdb [SAT], 1440 Offline uncorrectable sectors
Sep 28 22:23:01 cloudcephosd1025 smart_failure[372687]: Device: /dev/sdi [SAT], 1560 Offline uncorrectable sectors
Sep 29 03:53:02 cloudcephosd1025 smart_failure[496559]: Device: /dev/sde [SAT], 1400 Offline uncorrectable sectors
Sep 29 09:23:01 cloudcephosd1025 smart_failure[620641]: Device: /dev/sdh [SAT], 1896 Offline uncorrectable sectors
Sep 29 12:23:01 cloudcephosd1025 smart_failure[688201]: Device: /dev/sdd [SAT], 2224 Offline uncorrectable sectors
Sep 29 12:53:01 cloudcephosd1025 smart_failure[699318]: Device: /dev/sdg [SAT], 1552 Offline uncorrectable sectors
Sep 29 13:23:01 cloudcephosd1025 smart_failure[710762]: Device: /dev/sdj [SAT], 840 Offline uncorrectable sectors
Sep 29 15:53:01 cloudcephosd1025 smart_failure[766777]: Device: /dev/sdf [SAT], 1504 Offline uncorrectable sectors
Sep 29 20:53:01 cloudcephosd1025 smart_failure[879997]: Device: /dev/sdb [SAT], 1440 Offline uncorrectable sectors
Sep 29 22:23:01 cloudcephosd1025 smart_failure[913872]: Device: /dev/sdi [SAT], 1568 Offline uncorrectable sectors
Sep 30 04:23:01 cloudcephosd1025 smart_failure[1049210]: Device: /dev/sde [SAT], 1400 Offline uncorrectable sectors
Sep 30 09:23:01 cloudcephosd1025 smart_failure[1162342]: Device: /dev/sdh [SAT], 1896 Offline uncorrectable sectors
Sep 30 12:23:01 cloudcephosd1025 smart_failure[1229920]: Device: /dev/sdd [SAT], 2224 Offline uncorrectable sectors
Sep 30 12:53:02 cloudcephosd1025 smart_failure[1241050]: Device: /dev/sdg [SAT], 1552 Offline uncorrectable sectors
Sep 30 13:23:01 cloudcephosd1025 smart_failure[1252538]: Device: /dev/sdj [SAT], 840 Offline uncorrectable sectors
Sep 30 15:53:01 cloudcephosd1025 smart_failure[1308745]: Device: /dev/sdf [SAT], 1504 Offline uncorrectable sectors
Sep 30 20:53:01 cloudcephosd1025 smart_failure[1422032]: Device: /dev/sdb [SAT], 1440 Offline uncorrectable sectors
Sep 30 22:23:01 cloudcephosd1025 smart_failure[1456049]: Device: /dev/sdi [SAT], 1584 Offline uncorrectable sectors
===== NODE GROUP =====
(1) cloudcephosd1027.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 01 00:48:01 cloudcephosd1027 smart_failure[1407426]: Device: /dev/sdf [SAT], 2440 Offline uncorrectable sectors
Oct 01 01:48:01 cloudcephosd1027 smart_failure[1429892]: Device: /dev/sdj [SAT], 896 Offline uncorrectable sectors
Oct 01 08:18:01 cloudcephosd1027 smart_failure[1575636]: Device: /dev/sde [SAT], 864 Offline uncorrectable sectors
Oct 01 09:18:01 cloudcephosd1027 smart_failure[1597988]: Device: /dev/sdh [SAT], 672 Offline uncorrectable sectors
Oct 01 09:18:01 cloudcephosd1027 smart_failure[1598007]: Device: /dev/sdi [SAT], 1056 Offline uncorrectable sectors
Oct 01 12:18:01 cloudcephosd1027 smart_failure[1665249]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Oct 01 15:18:01 cloudcephosd1027 smart_failure[1732309]: Device: /dev/sdd [SAT], 1936 Offline uncorrectable sectors
Oct 01 18:18:01 cloudcephosd1027 smart_failure[1799939]: Device: /dev/sdc [SAT], 2120 Offline uncorrectable sectors
Oct 02 00:48:01 cloudcephosd1027 smart_failure[1945074]: Device: /dev/sdf [SAT], 2448 Offline uncorrectable sectors
Oct 02 01:48:01 cloudcephosd1027 smart_failure[1967352]: Device: /dev/sdj [SAT], 904 Offline uncorrectable sectors
Oct 02 08:18:01 cloudcephosd1027 smart_failure[2112840]: Device: /dev/sde [SAT], 864 Offline uncorrectable sectors
Oct 02 09:18:01 cloudcephosd1027 smart_failure[2134961]: Device: /dev/sdh [SAT], 672 Offline uncorrectable sectors
Oct 02 09:18:01 cloudcephosd1027 smart_failure[2134980]: Device: /dev/sdi [SAT], 1056 Offline uncorrectable sectors
Oct 02 12:18:01 cloudcephosd1027 smart_failure[2202462]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Oct 02 15:18:01 cloudcephosd1027 smart_failure[2269866]: Device: /dev/sdd [SAT], 1944 Offline uncorrectable sectors
Oct 02 18:18:01 cloudcephosd1027 smart_failure[2337479]: Device: /dev/sdc [SAT], 2120 Offline uncorrectable sectors
Oct 03 00:48:01 cloudcephosd1027 smart_failure[2476465]: Device: /dev/sdf [SAT], 2448 Offline uncorrectable sectors
Oct 03 01:48:01 cloudcephosd1027 smart_failure[2496554]: Device: /dev/sdj [SAT], 904 Offline uncorrectable sectors
Oct 03 08:18:01 cloudcephosd1027 smart_failure[2643030]: Device: /dev/sde [SAT], 864 Offline uncorrectable sectors
Oct 03 09:18:01 cloudcephosd1027 smart_failure[2665405]: Device: /dev/sdh [SAT], 680 Offline uncorrectable sectors
Oct 03 09:18:01 cloudcephosd1027 smart_failure[2665424]: Device: /dev/sdi [SAT], 1056 Offline uncorrectable sectors
Oct 03 12:18:01 cloudcephosd1027 smart_failure[2732540]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Oct 03 15:18:01 cloudcephosd1027 smart_failure[2800195]: Device: /dev/sdd [SAT], 1976 Offline uncorrectable sectors
Oct 03 18:18:01 cloudcephosd1027 smart_failure[2867308]: Device: /dev/sdc [SAT], 2128 Offline uncorrectable sectors
Oct 04 00:48:01 cloudcephosd1027 smart_failure[3013628]: Device: /dev/sdf [SAT], 2456 Offline uncorrectable sectors
Oct 04 01:48:01 cloudcephosd1027 smart_failure[3036227]: Device: /dev/sdj [SAT], 904 Offline uncorrectable sectors
Oct 04 08:18:01 cloudcephosd1027 smart_failure[3183280]: Device: /dev/sde [SAT], 864 Offline uncorrectable sectors
Oct 04 09:18:01 cloudcephosd1027 smart_failure[3205769]: Device: /dev/sdh [SAT], 680 Offline uncorrectable sectors
Oct 04 09:18:01 cloudcephosd1027 smart_failure[3205788]: Device: /dev/sdi [SAT], 1064 Offline uncorrectable sectors
Oct 04 12:18:01 cloudcephosd1027 smart_failure[3273448]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Oct 04 15:18:02 cloudcephosd1027 smart_failure[3341621]: Device: /dev/sdd [SAT], 1992 Offline uncorrectable sectors
Oct 04 18:18:01 cloudcephosd1027 smart_failure[3409392]: Device: /dev/sdc [SAT], 2152 Offline uncorrectable sectors
Oct 05 00:48:01 cloudcephosd1027 smart_failure[3556413]: Device: /dev/sdf [SAT], 2480 Offline uncorrectable sectors
Oct 05 01:48:02 cloudcephosd1027 smart_failure[3578809]: Device: /dev/sdj [SAT], 904 Offline uncorrectable sectors
Oct 05 08:18:01 cloudcephosd1027 smart_failure[3724646]: Device: /dev/sde [SAT], 864 Offline uncorrectable sectors
Oct 05 09:18:01 cloudcephosd1027 smart_failure[3747323]: Device: /dev/sdh [SAT], 680 Offline uncorrectable sectors
Oct 05 09:18:01 cloudcephosd1027 smart_failure[3747342]: Device: /dev/sdi [SAT], 1064 Offline uncorrectable sectors
Oct 05 12:18:01 cloudcephosd1027 smart_failure[3814997]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Oct 05 15:48:01 cloudcephosd1027 smart_failure[3905824]: Device: /dev/sdd [SAT], 1992 Offline uncorrectable sectors
Oct 05 18:18:01 cloudcephosd1027 smart_failure[3961953]: Device: /dev/sdc [SAT], 2152 Offline uncorrectable sectors
Oct 06 00:48:01 cloudcephosd1027 smart_failure[4108286]: Device: /dev/sdf [SAT], 2480 Offline uncorrectable sectors
Oct 06 02:18:01 cloudcephosd1027 smart_failure[4142015]: Device: /dev/sdj [SAT], 904 Offline uncorrectable sectors
Oct 06 08:18:01 cloudcephosd1027 smart_failure[83046]: Device: /dev/sde [SAT], 864 Offline uncorrectable sectors
Oct 06 09:18:01 cloudcephosd1027 smart_failure[105228]: Device: /dev/sdh [SAT], 688 Offline uncorrectable sectors
Oct 06 09:18:01 cloudcephosd1027 smart_failure[105247]: Device: /dev/sdi [SAT], 1064 Offline uncorrectable sectors
Oct 06 12:18:01 cloudcephosd1027 smart_failure[172800]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Oct 06 15:48:01 cloudcephosd1027 smart_failure[251428]: Device: /dev/sdd [SAT], 1992 Offline uncorrectable sectors
Oct 06 18:18:01 cloudcephosd1027 smart_failure[307474]: Device: /dev/sdc [SAT], 2168 Offline uncorrectable sectors
Oct 07 00:48:01 cloudcephosd1027 smart_failure[454729]: Device: /dev/sdf [SAT], 2496 Offline uncorrectable sectors
Oct 07 02:18:01 cloudcephosd1027 smart_failure[488566]: Device: /dev/sdj [SAT], 912 Offline uncorrectable sectors
Oct 07 08:18:01 cloudcephosd1027 smart_failure[624427]: Device: /dev/sde [SAT], 864 Offline uncorrectable sectors
Oct 07 09:18:01 cloudcephosd1027 smart_failure[647116]: Device: /dev/sdh [SAT], 688 Offline uncorrectable sectors
Oct 07 09:18:01 cloudcephosd1027 smart_failure[647135]: Device: /dev/sdi [SAT], 1064 Offline uncorrectable sectors
Oct 07 12:18:01 cloudcephosd1027 smart_failure[714900]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Oct 07 15:48:01 cloudcephosd1027 smart_failure[793921]: Device: /dev/sdd [SAT], 1992 Offline uncorrectable sectors
Oct 07 18:18:01 cloudcephosd1027 smart_failure[850853]: Device: /dev/sdc [SAT], 2176 Offline uncorrectable sectors
Oct 08 00:48:01 cloudcephosd1027 smart_failure[998025]: Device: /dev/sdf [SAT], 2496 Offline uncorrectable sectors
Oct 08 02:18:01 cloudcephosd1027 smart_failure[1032258]: Device: /dev/sdj [SAT], 912 Offline uncorrectable sectors
Oct 08 08:18:01 cloudcephosd1027 smart_failure[1168086]: Device: /dev/sde [SAT], 864 Offline uncorrectable sectors
Oct 08 09:18:01 cloudcephosd1027 smart_failure[1190599]: Device: /dev/sdh [SAT], 688 Offline uncorrectable sectors
Oct 08 09:18:01 cloudcephosd1027 smart_failure[1190618]: Device: /dev/sdi [SAT], 1072 Offline uncorrectable sectors
Oct 08 12:18:02 cloudcephosd1027 smart_failure[1258345]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Oct 08 15:48:01 cloudcephosd1027 smart_failure[1337519]: Device: /dev/sdd [SAT], 2008 Offline uncorrectable sectors
Oct 08 18:18:01 cloudcephosd1027 smart_failure[1394502]: Device: /dev/sdc [SAT], 2176 Offline uncorrectable sectors
Oct 09 00:48:01 cloudcephosd1027 smart_failure[1541620]: Device: /dev/sdf [SAT], 2496 Offline uncorrectable sectors
Oct 09 02:18:01 cloudcephosd1027 smart_failure[1575868]: Device: /dev/sdj [SAT], 912 Offline uncorrectable sectors
Oct 09 08:18:01 cloudcephosd1027 smart_failure[1711022]: Device: /dev/sde [SAT], 864 Offline uncorrectable sectors
Oct 09 09:18:01 cloudcephosd1027 smart_failure[1733715]: Device: /dev/sdh [SAT], 696 Offline uncorrectable sectors
Oct 09 09:18:01 cloudcephosd1027 smart_failure[1733734]: Device: /dev/sdi [SAT], 1072 Offline uncorrectable sectors
Oct 09 12:48:01 cloudcephosd1027 smart_failure[1813199]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Oct 09 15:48:01 cloudcephosd1027 smart_failure[1881028]: Device: /dev/sdd [SAT], 2008 Offline uncorrectable sectors
Oct 09 18:18:01 cloudcephosd1027 smart_failure[1937697]: Device: /dev/sdc [SAT], 2176 Offline uncorrectable sectors
Oct 10 00:48:01 cloudcephosd1027 smart_failure[2084995]: Device: /dev/sdf [SAT], 2504 Offline uncorrectable sectors
Oct 10 02:18:01 cloudcephosd1027 smart_failure[2119018]: Device: /dev/sdj [SAT], 912 Offline uncorrectable sectors
Oct 10 08:18:01 cloudcephosd1027 smart_failure[2254966]: Device: /dev/sde [SAT], 864 Offline uncorrectable sectors
Oct 10 09:18:01 cloudcephosd1027 smart_failure[2277707]: Device: /dev/sdh [SAT], 696 Offline uncorrectable sectors
Oct 10 09:18:01 cloudcephosd1027 smart_failure[2277726]: Device: /dev/sdi [SAT], 1072 Offline uncorrectable sectors
Oct 10 12:48:01 cloudcephosd1027 smart_failure[2356919]: Device: /dev/sdg [SAT], 976 Offline uncorrectable sectors
Oct 10 15:48:01 cloudcephosd1027 smart_failure[2424246]: Device: /dev/sdd [SAT], 2008 Offline uncorrectable sectors
Oct 10 18:18:01 cloudcephosd1027 smart_failure[2480871]: Device: /dev/sdc [SAT], 2184 Offline uncorrectable sectors
Oct 11 00:48:01 cloudcephosd1027 smart_failure[2627100]: Device: /dev/sdf [SAT], 2504 Offline uncorrectable sectors
Oct 11 02:18:01 cloudcephosd1027 smart_failure[2660979]: Device: /dev/sdj [SAT], 912 Offline uncorrectable sectors
Oct 11 08:18:01 cloudcephosd1027 smart_failure[2796199]: Device: /dev/sde [SAT], 864 Offline uncorrectable sectors
Oct 11 09:18:01 cloudcephosd1027 smart_failure[2818983]: Device: /dev/sdh [SAT], 696 Offline uncorrectable sectors
Oct 11 09:18:01 cloudcephosd1027 smart_failure[2819002]: Device: /dev/sdi [SAT], 1080 Offline uncorrectable sectors
Sep 09 18:18:01 cloudcephosd1027 smart_failure[2459339]: Device: /dev/sdc [SAT], 1960 Offline uncorrectable sectors
Sep 10 00:18:01 cloudcephosd1027 smart_failure[2594945]: Device: /dev/sdf [SAT], 2288 Offline uncorrectable sectors
Sep 10 01:48:01 cloudcephosd1027 smart_failure[2628970]: Device: /dev/sdj [SAT], 856 Offline uncorrectable sectors
Sep 10 07:48:01 cloudcephosd1027 smart_failure[2764651]: Device: /dev/sde [SAT], 816 Offline uncorrectable sectors
Sep 10 09:18:01 cloudcephosd1027 smart_failure[2798365]: Device: /dev/sdh [SAT], 656 Offline uncorrectable sectors
Sep 10 09:18:01 cloudcephosd1027 smart_failure[2798384]: Device: /dev/sdi [SAT], 1000 Offline uncorrectable sectors
Sep 10 12:18:01 cloudcephosd1027 smart_failure[2866106]: Device: /dev/sdg [SAT], 944 Offline uncorrectable sectors
Sep 10 14:48:02 cloudcephosd1027 smart_failure[2922555]: Device: /dev/sdd [SAT], 1784 Offline uncorrectable sectors
Sep 10 18:18:01 cloudcephosd1027 smart_failure[3001583]: Device: /dev/sdc [SAT], 1960 Offline uncorrectable sectors
Sep 11 00:18:01 cloudcephosd1027 smart_failure[3136947]: Device: /dev/sdf [SAT], 2312 Offline uncorrectable sectors
Sep 11 01:48:01 cloudcephosd1027 smart_failure[3170817]: Device: /dev/sdj [SAT], 856 Offline uncorrectable sectors
Sep 11 07:48:02 cloudcephosd1027 smart_failure[3306125]: Device: /dev/sde [SAT], 816 Offline uncorrectable sectors
Sep 11 09:18:01 cloudcephosd1027 smart_failure[3339297]: Device: /dev/sdh [SAT], 656 Offline uncorrectable sectors
Sep 11 09:18:01 cloudcephosd1027 smart_failure[3339316]: Device: /dev/sdi [SAT], 1000 Offline uncorrectable sectors
Sep 11 12:18:01 cloudcephosd1027 smart_failure[3407012]: Device: /dev/sdg [SAT], 944 Offline uncorrectable sectors
Sep 11 14:48:01 cloudcephosd1027 smart_failure[3462608]: Device: /dev/sdd [SAT], 1792 Offline uncorrectable sectors
Sep 11 18:18:01 cloudcephosd1027 smart_failure[3542304]: Device: /dev/sdc [SAT], 1968 Offline uncorrectable sectors
Sep 12 00:18:02 cloudcephosd1027 smart_failure[3677042]: Device: /dev/sdf [SAT], 2312 Offline uncorrectable sectors
Sep 12 01:48:01 cloudcephosd1027 smart_failure[3710678]: Device: /dev/sdj [SAT], 856 Offline uncorrectable sectors
Sep 12 08:18:01 cloudcephosd1027 smart_failure[3857342]: Device: /dev/sde [SAT], 816 Offline uncorrectable sectors
Sep 12 09:18:01 cloudcephosd1027 smart_failure[3879933]: Device: /dev/sdh [SAT], 656 Offline uncorrectable sectors
Sep 12 09:18:01 cloudcephosd1027 smart_failure[3879952]: Device: /dev/sdi [SAT], 1032 Offline uncorrectable sectors
Sep 12 12:18:01 cloudcephosd1027 smart_failure[3947232]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 12 14:48:01 cloudcephosd1027 smart_failure[4004022]: Device: /dev/sdd [SAT], 1832 Offline uncorrectable sectors
Sep 12 18:18:01 cloudcephosd1027 smart_failure[4082828]: Device: /dev/sdc [SAT], 2000 Offline uncorrectable sectors
Sep 13 00:18:01 cloudcephosd1027 smart_failure[24656]: Device: /dev/sdf [SAT], 2320 Offline uncorrectable sectors (changed +8)
Sep 13 01:48:01 cloudcephosd1027 smart_failure[58575]: Device: /dev/sdj [SAT], 856 Offline uncorrectable sectors
Sep 13 08:18:01 cloudcephosd1027 smart_failure[205383]: Device: /dev/sde [SAT], 816 Offline uncorrectable sectors
Sep 13 09:18:01 cloudcephosd1027 smart_failure[227910]: Device: /dev/sdh [SAT], 656 Offline uncorrectable sectors
Sep 13 09:18:01 cloudcephosd1027 smart_failure[227929]: Device: /dev/sdi [SAT], 1032 Offline uncorrectable sectors
Sep 13 12:18:01 cloudcephosd1027 smart_failure[295613]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 13 14:48:01 cloudcephosd1027 smart_failure[352211]: Device: /dev/sdd [SAT], 1832 Offline uncorrectable sectors
Sep 13 18:18:01 cloudcephosd1027 smart_failure[430984]: Device: /dev/sdc [SAT], 2008 Offline uncorrectable sectors
Sep 14 00:18:02 cloudcephosd1027 smart_failure[566756]: Device: /dev/sdf [SAT], 2360 Offline uncorrectable sectors
Sep 14 01:48:01 cloudcephosd1027 smart_failure[600605]: Device: /dev/sdj [SAT], 856 Offline uncorrectable sectors
Sep 14 08:18:01 cloudcephosd1027 smart_failure[747900]: Device: /dev/sde [SAT], 816 Offline uncorrectable sectors
Sep 14 09:18:01 cloudcephosd1027 smart_failure[770664]: Device: /dev/sdh [SAT], 664 Offline uncorrectable sectors
Sep 14 09:18:01 cloudcephosd1027 smart_failure[770683]: Device: /dev/sdi [SAT], 1032 Offline uncorrectable sectors
Sep 14 12:18:01 cloudcephosd1027 smart_failure[838348]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 14 14:48:01 cloudcephosd1027 smart_failure[894451]: Device: /dev/sdd [SAT], 1848 Offline uncorrectable sectors
Sep 14 18:18:01 cloudcephosd1027 smart_failure[973966]: Device: /dev/sdc [SAT], 2008 Offline uncorrectable sectors
Sep 15 00:48:01 cloudcephosd1027 smart_failure[1120494]: Device: /dev/sdf [SAT], 2360 Offline uncorrectable sectors
Sep 15 01:48:01 cloudcephosd1027 smart_failure[1143227]: Device: /dev/sdj [SAT], 872 Offline uncorrectable sectors
Sep 15 08:18:01 cloudcephosd1027 smart_failure[1290368]: Device: /dev/sde [SAT], 816 Offline uncorrectable sectors
Sep 15 09:18:01 cloudcephosd1027 smart_failure[1313127]: Device: /dev/sdh [SAT], 664 Offline uncorrectable sectors
Sep 15 09:18:01 cloudcephosd1027 smart_failure[1313146]: Device: /dev/sdi [SAT], 1032 Offline uncorrectable sectors
Sep 15 12:18:01 cloudcephosd1027 smart_failure[1380859]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 15 14:48:01 cloudcephosd1027 smart_failure[1437244]: Device: /dev/sdd [SAT], 1856 Offline uncorrectable sectors
Sep 15 18:18:01 cloudcephosd1027 smart_failure[1516576]: Device: /dev/sdc [SAT], 2016 Offline uncorrectable sectors
Sep 16 00:48:01 cloudcephosd1027 smart_failure[1664028]: Device: /dev/sdf [SAT], 2360 Offline uncorrectable sectors
Sep 16 01:48:01 cloudcephosd1027 smart_failure[1686674]: Device: /dev/sdj [SAT], 872 Offline uncorrectable sectors
Sep 16 08:18:01 cloudcephosd1027 smart_failure[1834409]: Device: /dev/sde [SAT], 816 Offline uncorrectable sectors
Sep 16 09:18:01 cloudcephosd1027 smart_failure[1857033]: Device: /dev/sdh [SAT], 664 Offline uncorrectable sectors
Sep 16 09:18:01 cloudcephosd1027 smart_failure[1857052]: Device: /dev/sdi [SAT], 1040 Offline uncorrectable sectors
Sep 16 12:18:01 cloudcephosd1027 smart_failure[1924894]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 16 14:48:01 cloudcephosd1027 smart_failure[1981282]: Device: /dev/sdd [SAT], 1872 Offline uncorrectable sectors
Sep 16 18:18:02 cloudcephosd1027 smart_failure[2060523]: Device: /dev/sdc [SAT], 2016 Offline uncorrectable sectors
Sep 17 00:48:01 cloudcephosd1027 smart_failure[2207437]: Device: /dev/sdf [SAT], 2360 Offline uncorrectable sectors
Sep 17 01:48:01 cloudcephosd1027 smart_failure[2230152]: Device: /dev/sdj [SAT], 872 Offline uncorrectable sectors
Sep 17 08:18:01 cloudcephosd1027 smart_failure[2377517]: Device: /dev/sde [SAT], 816 Offline uncorrectable sectors
Sep 17 09:18:01 cloudcephosd1027 smart_failure[2399970]: Device: /dev/sdh [SAT], 664 Offline uncorrectable sectors
Sep 17 09:18:01 cloudcephosd1027 smart_failure[2399989]: Device: /dev/sdi [SAT], 1040 Offline uncorrectable sectors
Sep 17 12:18:01 cloudcephosd1027 smart_failure[2467690]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 17 14:48:01 cloudcephosd1027 smart_failure[2524037]: Device: /dev/sdd [SAT], 1880 Offline uncorrectable sectors
Sep 17 18:18:01 cloudcephosd1027 smart_failure[2603134]: Device: /dev/sdc [SAT], 2016 Offline uncorrectable sectors
Sep 18 00:48:01 cloudcephosd1027 smart_failure[2750432]: Device: /dev/sdf [SAT], 2360 Offline uncorrectable sectors
Sep 18 01:48:01 cloudcephosd1027 smart_failure[2773062]: Device: /dev/sdj [SAT], 872 Offline uncorrectable sectors
Sep 18 08:18:01 cloudcephosd1027 smart_failure[2919987]: Device: /dev/sde [SAT], 816 Offline uncorrectable sectors
Sep 18 09:18:01 cloudcephosd1027 smart_failure[2942850]: Device: /dev/sdh [SAT], 664 Offline uncorrectable sectors
Sep 18 09:18:01 cloudcephosd1027 smart_failure[2942869]: Device: /dev/sdi [SAT], 1040 Offline uncorrectable sectors
Sep 18 12:18:01 cloudcephosd1027 smart_failure[3010690]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 18 14:48:01 cloudcephosd1027 smart_failure[3067133]: Device: /dev/sdd [SAT], 1888 Offline uncorrectable sectors
Sep 18 18:18:01 cloudcephosd1027 smart_failure[3146154]: Device: /dev/sdc [SAT], 2016 Offline uncorrectable sectors
Sep 19 00:48:01 cloudcephosd1027 smart_failure[3293819]: Device: /dev/sdf [SAT], 2368 Offline uncorrectable sectors
Sep 19 01:48:01 cloudcephosd1027 smart_failure[3316545]: Device: /dev/sdj [SAT], 872 Offline uncorrectable sectors
Sep 19 08:18:01 cloudcephosd1027 smart_failure[3464350]: Device: /dev/sde [SAT], 816 Offline uncorrectable sectors
Sep 19 09:18:01 cloudcephosd1027 smart_failure[3487175]: Device: /dev/sdh [SAT], 664 Offline uncorrectable sectors
Sep 19 09:18:01 cloudcephosd1027 smart_failure[3487194]: Device: /dev/sdi [SAT], 1040 Offline uncorrectable sectors
Sep 19 12:18:01 cloudcephosd1027 smart_failure[3555128]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 19 14:48:01 cloudcephosd1027 smart_failure[3611956]: Device: /dev/sdd [SAT], 1888 Offline uncorrectable sectors
Sep 19 18:18:01 cloudcephosd1027 smart_failure[3692031]: Device: /dev/sdc [SAT], 2032 Offline uncorrectable sectors
Sep 20 00:48:01 cloudcephosd1027 smart_failure[3840873]: Device: /dev/sdf [SAT], 2384 Offline uncorrectable sectors
Sep 20 01:48:01 cloudcephosd1027 smart_failure[3863570]: Device: /dev/sdj [SAT], 872 Offline uncorrectable sectors
Sep 20 08:18:01 cloudcephosd1027 smart_failure[4011443]: Device: /dev/sde [SAT], 824 Offline uncorrectable sectors
Sep 20 09:18:01 cloudcephosd1027 smart_failure[4034071]: Device: /dev/sdh [SAT], 664 Offline uncorrectable sectors
Sep 20 09:18:01 cloudcephosd1027 smart_failure[4034090]: Device: /dev/sdi [SAT], 1040 Offline uncorrectable sectors
Sep 20 12:18:01 cloudcephosd1027 smart_failure[4102182]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 20 14:48:01 cloudcephosd1027 smart_failure[4159068]: Device: /dev/sdd [SAT], 1888 Offline uncorrectable sectors
Sep 20 18:18:01 cloudcephosd1027 smart_failure[44348]: Device: /dev/sdc [SAT], 2056 Offline uncorrectable sectors
Sep 21 00:48:01 cloudcephosd1027 smart_failure[191847]: Device: /dev/sdf [SAT], 2384 Offline uncorrectable sectors
Sep 21 01:48:01 cloudcephosd1027 smart_failure[214638]: Device: /dev/sdj [SAT], 872 Offline uncorrectable sectors
Sep 21 08:18:01 cloudcephosd1027 smart_failure[361552]: Device: /dev/sde [SAT], 832 Offline uncorrectable sectors
Sep 21 09:18:01 cloudcephosd1027 smart_failure[384309]: Device: /dev/sdh [SAT], 664 Offline uncorrectable sectors
Sep 21 09:18:01 cloudcephosd1027 smart_failure[384333]: Device: /dev/sdi [SAT], 1040 Offline uncorrectable sectors
Sep 21 12:18:01 cloudcephosd1027 smart_failure[451993]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 21 14:48:01 cloudcephosd1027 smart_failure[508845]: Device: /dev/sdd [SAT], 1904 Offline uncorrectable sectors
Sep 21 18:18:01 cloudcephosd1027 smart_failure[588521]: Device: /dev/sdc [SAT], 2064 Offline uncorrectable sectors
Sep 22 00:48:01 cloudcephosd1027 smart_failure[735549]: Device: /dev/sdf [SAT], 2408 Offline uncorrectable sectors
Sep 22 01:48:01 cloudcephosd1027 smart_failure[757990]: Device: /dev/sdj [SAT], 880 Offline uncorrectable sectors
Sep 22 08:18:01 cloudcephosd1027 smart_failure[905631]: Device: /dev/sde [SAT], 832 Offline uncorrectable sectors
Sep 22 09:18:01 cloudcephosd1027 smart_failure[928544]: Device: /dev/sdh [SAT], 664 Offline uncorrectable sectors
Sep 22 09:18:01 cloudcephosd1027 smart_failure[928563]: Device: /dev/sdi [SAT], 1040 Offline uncorrectable sectors
Sep 22 12:18:01 cloudcephosd1027 smart_failure[995830]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 22 14:48:01 cloudcephosd1027 smart_failure[1052134]: Device: /dev/sdd [SAT], 1904 Offline uncorrectable sectors
Sep 22 18:18:01 cloudcephosd1027 smart_failure[1131384]: Device: /dev/sdc [SAT], 2064 Offline uncorrectable sectors
Sep 23 00:48:01 cloudcephosd1027 smart_failure[1278120]: Device: /dev/sdf [SAT], 2408 Offline uncorrectable sectors
Sep 23 01:48:01 cloudcephosd1027 smart_failure[1300613]: Device: /dev/sdj [SAT], 888 Offline uncorrectable sectors
Sep 23 08:18:01 cloudcephosd1027 smart_failure[1447754]: Device: /dev/sde [SAT], 832 Offline uncorrectable sectors
Sep 23 09:18:01 cloudcephosd1027 smart_failure[1470307]: Device: /dev/sdh [SAT], 672 Offline uncorrectable sectors
Sep 23 09:18:01 cloudcephosd1027 smart_failure[1470326]: Device: /dev/sdi [SAT], 1040 Offline uncorrectable sectors
Sep 23 12:18:01 cloudcephosd1027 smart_failure[1537516]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 23 14:48:02 cloudcephosd1027 smart_failure[1593971]: Device: /dev/sdd [SAT], 1904 Offline uncorrectable sectors
Sep 23 18:18:01 cloudcephosd1027 smart_failure[1672879]: Device: /dev/sdc [SAT], 2088 Offline uncorrectable sectors
Sep 24 00:48:01 cloudcephosd1027 smart_failure[1819642]: Device: /dev/sdf [SAT], 2408 Offline uncorrectable sectors
Sep 24 01:48:01 cloudcephosd1027 smart_failure[1842237]: Device: /dev/sdj [SAT], 896 Offline uncorrectable sectors
Sep 24 08:18:01 cloudcephosd1027 smart_failure[1989228]: Device: /dev/sde [SAT], 832 Offline uncorrectable sectors
Sep 24 09:18:01 cloudcephosd1027 smart_failure[2011794]: Device: /dev/sdh [SAT], 672 Offline uncorrectable sectors
Sep 24 09:18:01 cloudcephosd1027 smart_failure[2011813]: Device: /dev/sdi [SAT], 1040 Offline uncorrectable sectors
Sep 24 12:18:01 cloudcephosd1027 smart_failure[2078919]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 24 15:18:01 cloudcephosd1027 smart_failure[2146663]: Device: /dev/sdd [SAT], 1920 Offline uncorrectable sectors
Sep 24 18:18:01 cloudcephosd1027 smart_failure[2214197]: Device: /dev/sdc [SAT], 2088 Offline uncorrectable sectors
Sep 25 00:48:01 cloudcephosd1027 smart_failure[2360345]: Device: /dev/sdf [SAT], 2408 Offline uncorrectable sectors
Sep 25 01:48:01 cloudcephosd1027 smart_failure[2382782]: Device: /dev/sdj [SAT], 896 Offline uncorrectable sectors
Sep 25 08:18:01 cloudcephosd1027 smart_failure[2529324]: Device: /dev/sde [SAT], 832 Offline uncorrectable sectors
Sep 25 09:18:01 cloudcephosd1027 smart_failure[2552168]: Device: /dev/sdh [SAT], 672 Offline uncorrectable sectors
Sep 25 09:18:01 cloudcephosd1027 smart_failure[2552187]: Device: /dev/sdi [SAT], 1040 Offline uncorrectable sectors
Sep 25 12:18:01 cloudcephosd1027 smart_failure[2619853]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 25 15:18:01 cloudcephosd1027 smart_failure[2688116]: Device: /dev/sdd [SAT], 1920 Offline uncorrectable sectors
Sep 25 18:18:01 cloudcephosd1027 smart_failure[2755463]: Device: /dev/sdc [SAT], 2104 Offline uncorrectable sectors
Sep 26 00:48:01 cloudcephosd1027 smart_failure[2901584]: Device: /dev/sdf [SAT], 2408 Offline uncorrectable sectors
Sep 26 01:48:01 cloudcephosd1027 smart_failure[2924159]: Device: /dev/sdj [SAT], 896 Offline uncorrectable sectors
Sep 26 08:18:01 cloudcephosd1027 smart_failure[3070117]: Device: /dev/sde [SAT], 832 Offline uncorrectable sectors
Sep 26 09:18:01 cloudcephosd1027 smart_failure[3092699]: Device: /dev/sdh [SAT], 672 Offline uncorrectable sectors
Sep 26 09:18:01 cloudcephosd1027 smart_failure[3092718]: Device: /dev/sdi [SAT], 1048 Offline uncorrectable sectors
Sep 26 12:18:01 cloudcephosd1027 smart_failure[3160652]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 26 15:18:01 cloudcephosd1027 smart_failure[3228096]: Device: /dev/sdd [SAT], 1920 Offline uncorrectable sectors
Sep 26 18:18:01 cloudcephosd1027 smart_failure[3295370]: Device: /dev/sdc [SAT], 2104 Offline uncorrectable sectors
Sep 27 00:48:01 cloudcephosd1027 smart_failure[3441243]: Device: /dev/sdf [SAT], 2416 Offline uncorrectable sectors
Sep 27 01:48:01 cloudcephosd1027 smart_failure[3463783]: Device: /dev/sdj [SAT], 896 Offline uncorrectable sectors
Sep 27 08:18:01 cloudcephosd1027 smart_failure[3610113]: Device: /dev/sde [SAT], 832 Offline uncorrectable sectors
Sep 27 09:18:01 cloudcephosd1027 smart_failure[3632515]: Device: /dev/sdh [SAT], 672 Offline uncorrectable sectors
Sep 27 09:18:01 cloudcephosd1027 smart_failure[3632534]: Device: /dev/sdi [SAT], 1048 Offline uncorrectable sectors
Sep 27 12:18:01 cloudcephosd1027 smart_failure[3700013]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 27 15:18:01 cloudcephosd1027 smart_failure[3768553]: Device: /dev/sdd [SAT], 1920 Offline uncorrectable sectors
Sep 27 18:18:01 cloudcephosd1027 smart_failure[3836321]: Device: /dev/sdc [SAT], 2104 Offline uncorrectable sectors
Sep 28 00:48:01 cloudcephosd1027 smart_failure[3982503]: Device: /dev/sdf [SAT], 2424 Offline uncorrectable sectors
Sep 28 01:48:01 cloudcephosd1027 smart_failure[4005070]: Device: /dev/sdj [SAT], 896 Offline uncorrectable sectors
Sep 28 08:18:01 cloudcephosd1027 smart_failure[4151903]: Device: /dev/sde [SAT], 856 Offline uncorrectable sectors
Sep 28 09:18:01 cloudcephosd1027 smart_failure[4174125]: Device: /dev/sdh [SAT], 672 Offline uncorrectable sectors
Sep 28 09:18:01 cloudcephosd1027 smart_failure[4174144]: Device: /dev/sdi [SAT], 1048 Offline uncorrectable sectors
Sep 28 12:18:01 cloudcephosd1027 smart_failure[47614]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 28 15:18:01 cloudcephosd1027 smart_failure[115715]: Device: /dev/sdd [SAT], 1920 Offline uncorrectable sectors
Sep 28 18:18:01 cloudcephosd1027 smart_failure[183294]: Device: /dev/sdc [SAT], 2112 Offline uncorrectable sectors
Sep 29 00:48:01 cloudcephosd1027 smart_failure[330094]: Device: /dev/sdf [SAT], 2432 Offline uncorrectable sectors
Sep 29 01:48:01 cloudcephosd1027 smart_failure[352460]: Device: /dev/sdj [SAT], 896 Offline uncorrectable sectors
Sep 29 08:18:01 cloudcephosd1027 smart_failure[498095]: Device: /dev/sde [SAT], 864 Offline uncorrectable sectors
Sep 29 09:18:01 cloudcephosd1027 smart_failure[520900]: Device: /dev/sdh [SAT], 672 Offline uncorrectable sectors
Sep 29 09:18:01 cloudcephosd1027 smart_failure[520919]: Device: /dev/sdi [SAT], 1048 Offline uncorrectable sectors
Sep 29 12:18:01 cloudcephosd1027 smart_failure[588811]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 29 15:18:01 cloudcephosd1027 smart_failure[655813]: Device: /dev/sdd [SAT], 1920 Offline uncorrectable sectors
Sep 29 18:18:01 cloudcephosd1027 smart_failure[723201]: Device: /dev/sdc [SAT], 2112 Offline uncorrectable sectors
Sep 30 00:48:01 cloudcephosd1027 smart_failure[869050]: Device: /dev/sdf [SAT], 2432 Offline uncorrectable sectors
Sep 30 01:48:01 cloudcephosd1027 smart_failure[891323]: Device: /dev/sdj [SAT], 896 Offline uncorrectable sectors
Sep 30 08:18:01 cloudcephosd1027 smart_failure[1037422]: Device: /dev/sde [SAT], 864 Offline uncorrectable sectors
Sep 30 09:18:01 cloudcephosd1027 smart_failure[1059941]: Device: /dev/sdh [SAT], 672 Offline uncorrectable sectors
Sep 30 09:18:01 cloudcephosd1027 smart_failure[1059960]: Device: /dev/sdi [SAT], 1056 Offline uncorrectable sectors
Sep 30 12:18:01 cloudcephosd1027 smart_failure[1127080]: Device: /dev/sdg [SAT], 968 Offline uncorrectable sectors
Sep 30 15:18:01 cloudcephosd1027 smart_failure[1194281]: Device: /dev/sdd [SAT], 1920 Offline uncorrectable sectors
Sep 30 18:18:01 cloudcephosd1027 smart_failure[1261533]: Device: /dev/sdc [SAT], 2112 Offline uncorrectable sectors
===== NODE GROUP =====
(1) cloudcephosd1032.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 01 01:12:04 cloudcephosd1032 smart_failure[1233833]: Device: /dev/sdc [SAT], 1840 Offline uncorrectable sectors
Oct 01 04:12:04 cloudcephosd1032 smart_failure[1301467]: Device: /dev/sde [SAT], 2408 Offline uncorrectable sectors
Oct 01 05:42:04 cloudcephosd1032 smart_failure[1335330]: Device: /dev/sdh [SAT], 2240 Offline uncorrectable sectors
Oct 01 09:12:05 cloudcephosd1032 smart_failure[1414046]: Device: /dev/sdf [SAT], 1624 Offline uncorrectable sectors
Oct 01 12:42:04 cloudcephosd1032 smart_failure[1492773]: Device: /dev/sdj [SAT], 1416 Offline uncorrectable sectors
Oct 01 19:42:04 cloudcephosd1032 smart_failure[1650404]: Device: /dev/sdd [SAT], 2632 Offline uncorrectable sectors
Oct 01 19:42:04 cloudcephosd1032 smart_failure[1650454]: Device: /dev/sdi [SAT], 1432 Offline uncorrectable sectors
Oct 01 22:12:04 cloudcephosd1032 smart_failure[1706312]: Device: /dev/sdg [SAT], 1328 Offline uncorrectable sectors
Oct 02 01:12:04 cloudcephosd1032 smart_failure[1773526]: Device: /dev/sdc [SAT], 1848 Offline uncorrectable sectors
Oct 02 04:12:04 cloudcephosd1032 smart_failure[1841058]: Device: /dev/sde [SAT], 2416 Offline uncorrectable sectors
Oct 02 05:42:04 cloudcephosd1032 smart_failure[1874484]: Device: /dev/sdh [SAT], 2240 Offline uncorrectable sectors
Oct 02 09:12:04 cloudcephosd1032 smart_failure[1953108]: Device: /dev/sdf [SAT], 1624 Offline uncorrectable sectors
Oct 02 12:42:04 cloudcephosd1032 smart_failure[2031668]: Device: /dev/sdj [SAT], 1416 Offline uncorrectable sectors
Oct 02 19:42:04 cloudcephosd1032 smart_failure[2189713]: Device: /dev/sdd [SAT], 2640 Offline uncorrectable sectors
Oct 02 19:42:04 cloudcephosd1032 smart_failure[2189732]: Device: /dev/sdi [SAT], 1432 Offline uncorrectable sectors
Oct 02 22:12:04 cloudcephosd1032 smart_failure[2244850]: Device: /dev/sdg [SAT], 1328 Offline uncorrectable sectors
Oct 03 01:12:04 cloudcephosd1032 smart_failure[2304989]: Device: /dev/sdc [SAT], 1848 Offline uncorrectable sectors
Oct 03 04:12:04 cloudcephosd1032 smart_failure[2371893]: Device: /dev/sde [SAT], 2424 Offline uncorrectable sectors
Oct 03 05:42:04 cloudcephosd1032 smart_failure[2405626]: Device: /dev/sdh [SAT], 2256 Offline uncorrectable sectors
Oct 03 09:12:04 cloudcephosd1032 smart_failure[2484303]: Device: /dev/sdf [SAT], 1632 Offline uncorrectable sectors
Oct 03 12:42:04 cloudcephosd1032 smart_failure[2563013]: Device: /dev/sdj [SAT], 1416 Offline uncorrectable sectors
Oct 03 19:42:04 cloudcephosd1032 smart_failure[2720945]: Device: /dev/sdd [SAT], 2640 Offline uncorrectable sectors
Oct 03 19:42:04 cloudcephosd1032 smart_failure[2720994]: Device: /dev/sdi [SAT], 1448 Offline uncorrectable sectors
Oct 03 22:12:04 cloudcephosd1032 smart_failure[2777841]: Device: /dev/sdg [SAT], 1328 Offline uncorrectable sectors
Oct 04 01:12:04 cloudcephosd1032 smart_failure[2845714]: Device: /dev/sdc [SAT], 1864 Offline uncorrectable sectors
Oct 04 04:12:04 cloudcephosd1032 smart_failure[2913260]: Device: /dev/sde [SAT], 2424 Offline uncorrectable sectors
Oct 04 05:42:04 cloudcephosd1032 smart_failure[2947008]: Device: /dev/sdh [SAT], 2264 Offline uncorrectable sectors
Oct 04 09:42:00 cloudcephosd1032 smart_failure[3038704]: Device: /dev/sdf [SAT], 1632 Offline uncorrectable sectors
Oct 04 13:12:00 cloudcephosd1032 smart_failure[3118385]: Device: /dev/sdj [SAT], 1416 Offline uncorrectable sectors
Oct 04 20:12:00 cloudcephosd1032 smart_failure[3277831]: Device: /dev/sdd [SAT], 2640 Offline uncorrectable sectors
Oct 04 20:12:00 cloudcephosd1032 smart_failure[3277911]: Device: /dev/sdi [SAT], 1448 Offline uncorrectable sectors
Oct 04 22:42:00 cloudcephosd1032 smart_failure[3334002]: Device: /dev/sdg [SAT], 1328 Offline uncorrectable sectors
Oct 05 01:42:01 cloudcephosd1032 smart_failure[3402110]: Device: /dev/sdc [SAT], 1864 Offline uncorrectable sectors
Oct 05 04:42:00 cloudcephosd1032 smart_failure[3469157]: Device: /dev/sde [SAT], 2424 Offline uncorrectable sectors
Oct 05 06:12:00 cloudcephosd1032 smart_failure[3502614]: Device: /dev/sdh [SAT], 2272 Offline uncorrectable sectors
Oct 05 09:42:00 cloudcephosd1032 smart_failure[3581675]: Device: /dev/sdf [SAT], 1632 Offline uncorrectable sectors
Oct 05 13:12:00 cloudcephosd1032 smart_failure[3672206]: Device: /dev/sdj [SAT], 1416 Offline uncorrectable sectors
Oct 05 20:12:00 cloudcephosd1032 smart_failure[3830405]: Device: /dev/sdd [SAT], 2656 Offline uncorrectable sectors
Oct 05 20:12:00 cloudcephosd1032 smart_failure[3830424]: Device: /dev/sdi [SAT], 1448 Offline uncorrectable sectors
Oct 05 22:42:00 cloudcephosd1032 smart_failure[3887012]: Device: /dev/sdg [SAT], 1328 Offline uncorrectable sectors
Oct 06 02:12:00 cloudcephosd1032 smart_failure[3966366]: Device: /dev/sdc [SAT], 1896 Offline uncorrectable sectors
Oct 06 04:42:00 cloudcephosd1032 smart_failure[4022837]: Device: /dev/sde [SAT], 2424 Offline uncorrectable sectors
Oct 06 06:12:00 cloudcephosd1032 smart_failure[4056761]: Device: /dev/sdh [SAT], 2272 Offline uncorrectable sectors
Oct 06 09:42:01 cloudcephosd1032 smart_failure[4135996]: Device: /dev/sdf [SAT], 1632 Offline uncorrectable sectors
Oct 06 13:12:00 cloudcephosd1032 smart_failure[21473]: Device: /dev/sdj [SAT], 1416 Offline uncorrectable sectors
Oct 06 20:12:00 cloudcephosd1032 smart_failure[179769]: Device: /dev/sdd [SAT], 2656 Offline uncorrectable sectors
Oct 06 20:12:00 cloudcephosd1032 smart_failure[179819]: Device: /dev/sdi [SAT], 1448 Offline uncorrectable sectors
Oct 06 22:42:00 cloudcephosd1032 smart_failure[235997]: Device: /dev/sdg [SAT], 1336 Offline uncorrectable sectors
Oct 07 02:12:00 cloudcephosd1032 smart_failure[314767]: Device: /dev/sdc [SAT], 1896 Offline uncorrectable sectors
Oct 07 04:42:00 cloudcephosd1032 smart_failure[370479]: Device: /dev/sde [SAT], 2432 Offline uncorrectable sectors
Oct 07 06:12:00 cloudcephosd1032 smart_failure[404122]: Device: /dev/sdh [SAT], 2272 Offline uncorrectable sectors
Oct 07 10:12:00 cloudcephosd1032 smart_failure[494019]: Device: /dev/sdf [SAT], 1632 Offline uncorrectable sectors
Oct 07 13:12:00 cloudcephosd1032 smart_failure[561026]: Device: /dev/sdj [SAT], 1416 Offline uncorrectable sectors
Oct 07 20:12:00 cloudcephosd1032 smart_failure[717844]: Device: /dev/sdd [SAT], 2656 Offline uncorrectable sectors
Oct 07 20:12:00 cloudcephosd1032 smart_failure[717897]: Device: /dev/sdi [SAT], 1448 Offline uncorrectable sectors
Oct 07 22:42:00 cloudcephosd1032 smart_failure[773814]: Device: /dev/sdg [SAT], 1352 Offline uncorrectable sectors
Oct 08 02:12:00 cloudcephosd1032 smart_failure[852755]: Device: /dev/sdc [SAT], 1904 Offline uncorrectable sectors
Oct 08 04:42:00 cloudcephosd1032 smart_failure[908581]: Device: /dev/sde [SAT], 2464 Offline uncorrectable sectors
Oct 08 06:12:00 cloudcephosd1032 smart_failure[942420]: Device: /dev/sdh [SAT], 2272 Offline uncorrectable sectors
Oct 08 10:12:01 cloudcephosd1032 smart_failure[1031956]: Device: /dev/sdf [SAT], 1632 Offline uncorrectable sectors
Oct 08 13:12:00 cloudcephosd1032 smart_failure[1098844]: Device: /dev/sdj [SAT], 1416 Offline uncorrectable sectors
Oct 08 20:12:00 cloudcephosd1032 smart_failure[1256129]: Device: /dev/sdd [SAT], 2656 Offline uncorrectable sectors
Oct 08 20:12:00 cloudcephosd1032 smart_failure[1256166]: Device: /dev/sdi [SAT], 1456 Offline uncorrectable sectors
Oct 08 22:42:00 cloudcephosd1032 smart_failure[1311623]: Device: /dev/sdg [SAT], 1352 Offline uncorrectable sectors
Oct 09 02:12:00 cloudcephosd1032 smart_failure[1390576]: Device: /dev/sdc [SAT], 1912 Offline uncorrectable sectors
Oct 09 04:42:00 cloudcephosd1032 smart_failure[1446366]: Device: /dev/sde [SAT], 2472 Offline uncorrectable sectors
Oct 09 06:12:00 cloudcephosd1032 smart_failure[1479758]: Device: /dev/sdh [SAT], 2272 Offline uncorrectable sectors
Oct 09 10:42:00 cloudcephosd1032 smart_failure[1580722]: Device: /dev/sdf [SAT], 1640 Offline uncorrectable sectors
Oct 09 13:12:00 cloudcephosd1032 smart_failure[1636712]: Device: /dev/sdj [SAT], 1424 Offline uncorrectable sectors
Oct 09 20:12:00 cloudcephosd1032 smart_failure[1793473]: Device: /dev/sdd [SAT], 2664 Offline uncorrectable sectors
Oct 09 20:12:00 cloudcephosd1032 smart_failure[1793523]: Device: /dev/sdi [SAT], 1456 Offline uncorrectable sectors
Oct 09 22:42:00 cloudcephosd1032 smart_failure[1849387]: Device: /dev/sdg [SAT], 1352 Offline uncorrectable sectors
Oct 10 02:12:00 cloudcephosd1032 smart_failure[1927970]: Device: /dev/sdc [SAT], 1912 Offline uncorrectable sectors
Oct 10 04:42:00 cloudcephosd1032 smart_failure[1983806]: Device: /dev/sde [SAT], 2480 Offline uncorrectable sectors
Oct 10 06:12:00 cloudcephosd1032 smart_failure[2017499]: Device: /dev/sdh [SAT], 2272 Offline uncorrectable sectors
Oct 10 10:42:00 cloudcephosd1032 smart_failure[2118722]: Device: /dev/sdf [SAT], 1648 Offline uncorrectable sectors
Oct 10 13:12:00 cloudcephosd1032 smart_failure[2174742]: Device: /dev/sdj [SAT], 1424 Offline uncorrectable sectors
Oct 10 20:12:00 cloudcephosd1032 smart_failure[2332639]: Device: /dev/sdd [SAT], 2664 Offline uncorrectable sectors
Oct 10 20:12:00 cloudcephosd1032 smart_failure[2332689]: Device: /dev/sdi [SAT], 1456 Offline uncorrectable sectors
Oct 10 22:42:00 cloudcephosd1032 smart_failure[2389420]: Device: /dev/sdg [SAT], 1368 Offline uncorrectable sectors
Oct 11 02:12:00 cloudcephosd1032 smart_failure[2469117]: Device: /dev/sdc [SAT], 1912 Offline uncorrectable sectors
Oct 11 04:42:00 cloudcephosd1032 smart_failure[2525505]: Device: /dev/sde [SAT], 2512 Offline uncorrectable sectors
Oct 11 06:12:00 cloudcephosd1032 smart_failure[2559578]: Device: /dev/sdh [SAT], 2288 Offline uncorrectable sectors
Oct 11 10:42:00 cloudcephosd1032 smart_failure[2661159]: Device: /dev/sdf [SAT], 1648 Offline uncorrectable sectors
Sep 14 19:42:04 cloudcephosd1032 smart_failure[844690]: Device: /dev/sdd [SAT], 2592 Offline uncorrectable sectors
Sep 14 19:42:04 cloudcephosd1032 smart_failure[844709]: Device: /dev/sdi [SAT], 1256 Offline uncorrectable sectors (changed +8)
Sep 14 20:42:04 cloudcephosd1032 smart_failure[867205]: Device: /dev/sdg [SAT], 1248 Offline uncorrectable sectors
Sep 15 00:12:04 cloudcephosd1032 smart_failure[946216]: Device: /dev/sdc [SAT], 1712 Offline uncorrectable sectors
Sep 15 04:12:04 cloudcephosd1032 smart_failure[1036514]: Device: /dev/sde [SAT], 2280 Offline uncorrectable sectors
Sep 15 05:42:04 cloudcephosd1032 smart_failure[1070671]: Device: /dev/sdh [SAT], 2136 Offline uncorrectable sectors
Sep 15 08:42:04 cloudcephosd1032 smart_failure[1137959]: Device: /dev/sdf [SAT], 1520 Offline uncorrectable sectors
Sep 15 12:42:04 cloudcephosd1032 smart_failure[1228307]: Device: /dev/sdj [SAT], 1368 Offline uncorrectable sectors
Sep 15 19:42:04 cloudcephosd1032 smart_failure[1386205]: Device: /dev/sdd [SAT], 2592 Offline uncorrectable sectors
Sep 15 19:42:04 cloudcephosd1032 smart_failure[1386255]: Device: /dev/sdi [SAT], 1264 Offline uncorrectable sectors
Sep 15 20:42:05 cloudcephosd1032 smart_failure[1408880]: Device: /dev/sdg [SAT], 1248 Offline uncorrectable sectors
Sep 16 00:12:04 cloudcephosd1032 smart_failure[1488259]: Device: /dev/sdc [SAT], 1712 Offline uncorrectable sectors
Sep 16 04:12:04 cloudcephosd1032 smart_failure[1579253]: Device: /dev/sde [SAT], 2280 Offline uncorrectable sectors
Sep 16 05:42:04 cloudcephosd1032 smart_failure[1612802]: Device: /dev/sdh [SAT], 2144 Offline uncorrectable sectors
Sep 16 08:42:04 cloudcephosd1032 smart_failure[1680484]: Device: /dev/sdf [SAT], 1528 Offline uncorrectable sectors
Sep 16 12:42:04 cloudcephosd1032 smart_failure[1770908]: Device: /dev/sdj [SAT], 1368 Offline uncorrectable sectors
Sep 16 19:42:04 cloudcephosd1032 smart_failure[1928652]: Device: /dev/sdd [SAT], 2592 Offline uncorrectable sectors
Sep 16 19:42:04 cloudcephosd1032 smart_failure[1928703]: Device: /dev/sdi [SAT], 1280 Offline uncorrectable sectors
Sep 16 21:12:04 cloudcephosd1032 smart_failure[1962951]: Device: /dev/sdg [SAT], 1248 Offline uncorrectable sectors
Sep 17 00:12:04 cloudcephosd1032 smart_failure[2030829]: Device: /dev/sdc [SAT], 1712 Offline uncorrectable sectors
Sep 17 04:12:05 cloudcephosd1032 smart_failure[2121236]: Device: /dev/sde [SAT], 2288 Offline uncorrectable sectors
Sep 17 05:42:04 cloudcephosd1032 smart_failure[2154836]: Device: /dev/sdh [SAT], 2152 Offline uncorrectable sectors (changed +8)
Sep 17 08:42:04 cloudcephosd1032 smart_failure[2222769]: Device: /dev/sdf [SAT], 1528 Offline uncorrectable sectors
Sep 17 12:42:04 cloudcephosd1032 smart_failure[2312970]: Device: /dev/sdj [SAT], 1368 Offline uncorrectable sectors
Sep 17 19:42:04 cloudcephosd1032 smart_failure[2470596]: Device: /dev/sdd [SAT], 2592 Offline uncorrectable sectors
Sep 17 19:42:04 cloudcephosd1032 smart_failure[2470615]: Device: /dev/sdi [SAT], 1288 Offline uncorrectable sectors
Sep 17 21:12:05 cloudcephosd1032 smart_failure[2504461]: Device: /dev/sdg [SAT], 1256 Offline uncorrectable sectors
Sep 18 00:12:04 cloudcephosd1032 smart_failure[2572497]: Device: /dev/sdc [SAT], 1712 Offline uncorrectable sectors
Sep 18 04:12:04 cloudcephosd1032 smart_failure[2663268]: Device: /dev/sde [SAT], 2288 Offline uncorrectable sectors
Sep 18 05:42:04 cloudcephosd1032 smart_failure[2697015]: Device: /dev/sdh [SAT], 2152 Offline uncorrectable sectors
Sep 18 08:42:04 cloudcephosd1032 smart_failure[2764094]: Device: /dev/sdf [SAT], 1528 Offline uncorrectable sectors
Sep 18 12:42:04 cloudcephosd1032 smart_failure[2854592]: Device: /dev/sdj [SAT], 1368 Offline uncorrectable sectors
Sep 18 19:42:04 cloudcephosd1032 smart_failure[3012241]: Device: /dev/sdd [SAT], 2592 Offline uncorrectable sectors
Sep 18 19:42:04 cloudcephosd1032 smart_failure[3012290]: Device: /dev/sdi [SAT], 1296 Offline uncorrectable sectors
Sep 18 21:42:04 cloudcephosd1032 smart_failure[3057729]: Device: /dev/sdg [SAT], 1264 Offline uncorrectable sectors
Sep 19 00:12:04 cloudcephosd1032 smart_failure[3114767]: Device: /dev/sdc [SAT], 1720 Offline uncorrectable sectors
Sep 19 04:12:04 cloudcephosd1032 smart_failure[3205895]: Device: /dev/sde [SAT], 2288 Offline uncorrectable sectors
Sep 19 05:42:04 cloudcephosd1032 smart_failure[3239702]: Device: /dev/sdh [SAT], 2152 Offline uncorrectable sectors
Sep 19 08:42:04 cloudcephosd1032 smart_failure[3307936]: Device: /dev/sdf [SAT], 1528 Offline uncorrectable sectors
Sep 19 12:42:04 cloudcephosd1032 smart_failure[3397768]: Device: /dev/sdj [SAT], 1368 Offline uncorrectable sectors
Sep 19 19:42:04 cloudcephosd1032 smart_failure[3556750]: Device: /dev/sdd [SAT], 2592 Offline uncorrectable sectors
Sep 19 19:42:04 cloudcephosd1032 smart_failure[3556798]: Device: /dev/sdi [SAT], 1336 Offline uncorrectable sectors
Sep 19 21:42:05 cloudcephosd1032 smart_failure[3602611]: Device: /dev/sdg [SAT], 1264 Offline uncorrectable sectors
Sep 20 00:12:04 cloudcephosd1032 smart_failure[3659915]: Device: /dev/sdc [SAT], 1728 Offline uncorrectable sectors
Sep 20 04:12:04 cloudcephosd1032 smart_failure[3749784]: Device: /dev/sde [SAT], 2288 Offline uncorrectable sectors
Sep 20 05:42:04 cloudcephosd1032 smart_failure[3783557]: Device: /dev/sdh [SAT], 2152 Offline uncorrectable sectors
Sep 20 08:42:04 cloudcephosd1032 smart_failure[3851079]: Device: /dev/sdf [SAT], 1528 Offline uncorrectable sectors
Sep 20 12:42:04 cloudcephosd1032 smart_failure[3940758]: Device: /dev/sdj [SAT], 1368 Offline uncorrectable sectors
Sep 20 19:42:04 cloudcephosd1032 smart_failure[4097554]: Device: /dev/sdd [SAT], 2592 Offline uncorrectable sectors
Sep 20 19:42:04 cloudcephosd1032 smart_failure[4097604]: Device: /dev/sdi [SAT], 1352 Offline uncorrectable sectors
Sep 20 22:12:04 cloudcephosd1032 smart_failure[4153928]: Device: /dev/sdg [SAT], 1272 Offline uncorrectable sectors
Sep 21 00:12:04 cloudcephosd1032 smart_failure[4899]: Device: /dev/sdc [SAT], 1728 Offline uncorrectable sectors
Sep 21 04:12:04 cloudcephosd1032 smart_failure[94659]: Device: /dev/sde [SAT], 2320 Offline uncorrectable sectors
Sep 21 05:42:04 cloudcephosd1032 smart_failure[127895]: Device: /dev/sdh [SAT], 2160 Offline uncorrectable sectors
Sep 21 08:42:04 cloudcephosd1032 smart_failure[194822]: Device: /dev/sdf [SAT], 1536 Offline uncorrectable sectors
Sep 21 12:42:04 cloudcephosd1032 smart_failure[285358]: Device: /dev/sdj [SAT], 1368 Offline uncorrectable sectors
Sep 21 19:42:04 cloudcephosd1032 smart_failure[442823]: Device: /dev/sdd [SAT], 2592 Offline uncorrectable sectors
Sep 21 19:42:04 cloudcephosd1032 smart_failure[442872]: Device: /dev/sdi [SAT], 1352 Offline uncorrectable sectors
Sep 21 22:12:05 cloudcephosd1032 smart_failure[498681]: Device: /dev/sdg [SAT], 1272 Offline uncorrectable sectors
Sep 22 00:12:04 cloudcephosd1032 smart_failure[543333]: Device: /dev/sdc [SAT], 1728 Offline uncorrectable sectors
Sep 22 04:12:04 cloudcephosd1032 smart_failure[632699]: Device: /dev/sde [SAT], 2336 Offline uncorrectable sectors
Sep 22 05:42:04 cloudcephosd1032 smart_failure[665967]: Device: /dev/sdh [SAT], 2160 Offline uncorrectable sectors
Sep 22 08:42:04 cloudcephosd1032 smart_failure[733436]: Device: /dev/sdf [SAT], 1552 Offline uncorrectable sectors
Sep 22 12:42:04 cloudcephosd1032 smart_failure[822538]: Device: /dev/sdj [SAT], 1376 Offline uncorrectable sectors
Sep 22 19:42:04 cloudcephosd1032 smart_failure[979623]: Device: /dev/sdd [SAT], 2592 Offline uncorrectable sectors
Sep 22 19:42:04 cloudcephosd1032 smart_failure[979672]: Device: /dev/sdi [SAT], 1368 Offline uncorrectable sectors
Sep 22 22:12:04 cloudcephosd1032 smart_failure[1036144]: Device: /dev/sdg [SAT], 1272 Offline uncorrectable sectors
Sep 23 00:12:04 cloudcephosd1032 smart_failure[1080983]: Device: /dev/sdc [SAT], 1728 Offline uncorrectable sectors
Sep 23 04:12:04 cloudcephosd1032 smart_failure[1171419]: Device: /dev/sde [SAT], 2336 Offline uncorrectable sectors
Sep 23 05:42:04 cloudcephosd1032 smart_failure[1205037]: Device: /dev/sdh [SAT], 2160 Offline uncorrectable sectors
Sep 23 08:42:04 cloudcephosd1032 smart_failure[1272525]: Device: /dev/sdf [SAT], 1560 Offline uncorrectable sectors
Sep 23 12:42:04 cloudcephosd1032 smart_failure[1362435]: Device: /dev/sdj [SAT], 1392 Offline uncorrectable sectors
Sep 23 19:42:04 cloudcephosd1032 smart_failure[1520454]: Device: /dev/sdd [SAT], 2592 Offline uncorrectable sectors
Sep 23 19:42:04 cloudcephosd1032 smart_failure[1520503]: Device: /dev/sdi [SAT], 1368 Offline uncorrectable sectors
Sep 23 22:12:04 cloudcephosd1032 smart_failure[1577052]: Device: /dev/sdg [SAT], 1272 Offline uncorrectable sectors
Sep 24 00:12:05 cloudcephosd1032 smart_failure[1622115]: Device: /dev/sdc [SAT], 1736 Offline uncorrectable sectors
Sep 24 04:12:04 cloudcephosd1032 smart_failure[1712071]: Device: /dev/sde [SAT], 2360 Offline uncorrectable sectors
Sep 24 05:42:04 cloudcephosd1032 smart_failure[1745802]: Device: /dev/sdh [SAT], 2168 Offline uncorrectable sectors
Sep 24 08:42:04 cloudcephosd1032 smart_failure[1813701]: Device: /dev/sdf [SAT], 1576 Offline uncorrectable sectors
Sep 24 12:42:04 cloudcephosd1032 smart_failure[1903188]: Device: /dev/sdj [SAT], 1392 Offline uncorrectable sectors
Sep 24 19:42:04 cloudcephosd1032 smart_failure[2060080]: Device: /dev/sdd [SAT], 2600 Offline uncorrectable sectors
Sep 24 19:42:04 cloudcephosd1032 smart_failure[2060134]: Device: /dev/sdi [SAT], 1392 Offline uncorrectable sectors
Sep 24 22:12:04 cloudcephosd1032 smart_failure[2116760]: Device: /dev/sdg [SAT], 1280 Offline uncorrectable sectors
Sep 25 00:42:04 cloudcephosd1032 smart_failure[2173376]: Device: /dev/sdc [SAT], 1744 Offline uncorrectable sectors
Sep 25 04:12:04 cloudcephosd1032 smart_failure[2252264]: Device: /dev/sde [SAT], 2384 Offline uncorrectable sectors
Sep 25 05:42:04 cloudcephosd1032 smart_failure[2285864]: Device: /dev/sdh [SAT], 2184 Offline uncorrectable sectors
Sep 25 08:42:04 cloudcephosd1032 smart_failure[2353430]: Device: /dev/sdf [SAT], 1600 Offline uncorrectable sectors
Sep 25 12:42:04 cloudcephosd1032 smart_failure[2443251]: Device: /dev/sdj [SAT], 1400 Offline uncorrectable sectors
Sep 25 19:42:04 cloudcephosd1032 smart_failure[2600604]: Device: /dev/sdd [SAT], 2600 Offline uncorrectable sectors
Sep 25 19:42:04 cloudcephosd1032 smart_failure[2600623]: Device: /dev/sdi [SAT], 1400 Offline uncorrectable sectors
Sep 25 22:12:04 cloudcephosd1032 smart_failure[2656972]: Device: /dev/sdg [SAT], 1280 Offline uncorrectable sectors
Sep 26 00:42:04 cloudcephosd1032 smart_failure[2713235]: Device: /dev/sdc [SAT], 1752 Offline uncorrectable sectors
Sep 26 04:12:04 cloudcephosd1032 smart_failure[2792148]: Device: /dev/sde [SAT], 2400 Offline uncorrectable sectors
Sep 26 05:42:04 cloudcephosd1032 smart_failure[2825497]: Device: /dev/sdh [SAT], 2192 Offline uncorrectable sectors
Sep 26 08:42:04 cloudcephosd1032 smart_failure[2893091]: Device: /dev/sdf [SAT], 1600 Offline uncorrectable sectors
Sep 26 12:42:04 cloudcephosd1032 smart_failure[2983126]: Device: /dev/sdj [SAT], 1408 Offline uncorrectable sectors
Sep 26 19:42:04 cloudcephosd1032 smart_failure[3140441]: Device: /dev/sdd [SAT], 2600 Offline uncorrectable sectors
Sep 26 19:42:04 cloudcephosd1032 smart_failure[3140460]: Device: /dev/sdi [SAT], 1400 Offline uncorrectable sectors
Sep 26 22:12:04 cloudcephosd1032 smart_failure[3196936]: Device: /dev/sdg [SAT], 1296 Offline uncorrectable sectors
Sep 27 00:42:04 cloudcephosd1032 smart_failure[3253404]: Device: /dev/sdc [SAT], 1776 Offline uncorrectable sectors
Sep 27 04:12:04 cloudcephosd1032 smart_failure[3332276]: Device: /dev/sde [SAT], 2400 Offline uncorrectable sectors
Sep 27 05:42:04 cloudcephosd1032 smart_failure[3366030]: Device: /dev/sdh [SAT], 2208 Offline uncorrectable sectors
Sep 27 08:42:05 cloudcephosd1032 smart_failure[3433173]: Device: /dev/sdf [SAT], 1608 Offline uncorrectable sectors
Sep 27 12:42:04 cloudcephosd1032 smart_failure[3523493]: Device: /dev/sdj [SAT], 1408 Offline uncorrectable sectors
Sep 27 19:42:04 cloudcephosd1032 smart_failure[3681055]: Device: /dev/sdd [SAT], 2616 Offline uncorrectable sectors
Sep 27 19:42:04 cloudcephosd1032 smart_failure[3681104]: Device: /dev/sdi [SAT], 1416 Offline uncorrectable sectors
Sep 27 22:12:04 cloudcephosd1032 smart_failure[3737941]: Device: /dev/sdg [SAT], 1304 Offline uncorrectable sectors
Sep 28 00:42:05 cloudcephosd1032 smart_failure[3794507]: Device: /dev/sdc [SAT], 1776 Offline uncorrectable sectors
Sep 28 04:12:04 cloudcephosd1032 smart_failure[3873478]: Device: /dev/sde [SAT], 2408 Offline uncorrectable sectors
Sep 28 05:42:04 cloudcephosd1032 smart_failure[3907307]: Device: /dev/sdh [SAT], 2224 Offline uncorrectable sectors
Sep 28 09:12:04 cloudcephosd1032 smart_failure[3986437]: Device: /dev/sdf [SAT], 1608 Offline uncorrectable sectors
Sep 28 12:42:04 cloudcephosd1032 smart_failure[4064786]: Device: /dev/sdj [SAT], 1408 Offline uncorrectable sectors
Sep 28 19:42:04 cloudcephosd1032 smart_failure[29530]: Device: /dev/sdd [SAT], 2616 Offline uncorrectable sectors
Sep 28 19:42:04 cloudcephosd1032 smart_failure[29549]: Device: /dev/sdi [SAT], 1416 Offline uncorrectable sectors
Sep 28 22:12:04 cloudcephosd1032 smart_failure[85745]: Device: /dev/sdg [SAT], 1304 Offline uncorrectable sectors
Sep 29 01:12:04 cloudcephosd1032 smart_failure[153250]: Device: /dev/sdc [SAT], 1792 Offline uncorrectable sectors
Sep 29 04:12:04 cloudcephosd1032 smart_failure[220731]: Device: /dev/sde [SAT], 2408 Offline uncorrectable sectors
Sep 29 05:42:04 cloudcephosd1032 smart_failure[254157]: Device: /dev/sdh [SAT], 2224 Offline uncorrectable sectors
Sep 29 09:12:04 cloudcephosd1032 smart_failure[333099]: Device: /dev/sdf [SAT], 1624 Offline uncorrectable sectors
Sep 29 12:42:04 cloudcephosd1032 smart_failure[411879]: Device: /dev/sdj [SAT], 1416 Offline uncorrectable sectors
Sep 29 19:42:04 cloudcephosd1032 smart_failure[569430]: Device: /dev/sdd [SAT], 2624 Offline uncorrectable sectors
Sep 29 19:42:04 cloudcephosd1032 smart_failure[569480]: Device: /dev/sdi [SAT], 1416 Offline uncorrectable sectors
Sep 29 22:12:04 cloudcephosd1032 smart_failure[625884]: Device: /dev/sdg [SAT], 1304 Offline uncorrectable sectors
Sep 30 01:12:04 cloudcephosd1032 smart_failure[693119]: Device: /dev/sdc [SAT], 1800 Offline uncorrectable sectors
Sep 30 04:12:04 cloudcephosd1032 smart_failure[760736]: Device: /dev/sde [SAT], 2408 Offline uncorrectable sectors
Sep 30 05:42:04 cloudcephosd1032 smart_failure[794321]: Device: /dev/sdh [SAT], 2240 Offline uncorrectable sectors
Sep 30 09:12:04 cloudcephosd1032 smart_failure[873529]: Device: /dev/sdf [SAT], 1624 Offline uncorrectable sectors
Sep 30 12:42:04 cloudcephosd1032 smart_failure[952078]: Device: /dev/sdj [SAT], 1416 Offline uncorrectable sectors
Sep 30 19:42:04 cloudcephosd1032 smart_failure[1109789]: Device: /dev/sdd [SAT], 2624 Offline uncorrectable sectors
Sep 30 19:42:04 cloudcephosd1032 smart_failure[1109838]: Device: /dev/sdi [SAT], 1424 Offline uncorrectable sectors
Sep 30 22:12:04 cloudcephosd1032 smart_failure[1166252]: Device: /dev/sdg [SAT], 1320 Offline uncorrectable sectors
===== NODE GROUP =====
(1) cloudcephosd1033.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 01 01:25:02 cloudcephosd1033 smart_failure[814502]: Device: /dev/sdg [SAT], 880 Offline uncorrectable sectors
Oct 01 01:55:02 cloudcephosd1033 smart_failure[825672]: Device: /dev/sdd [SAT], 1272 Offline uncorrectable sectors
Oct 01 01:55:02 cloudcephosd1033 smart_failure[825725]: Device: /dev/sdh [SAT], 1400 Offline uncorrectable sectors
Oct 01 06:25:02 cloudcephosd1033 smart_failure[927106]: Device: /dev/sdb [SAT], 632 Offline uncorrectable sectors
Oct 01 07:25:02 cloudcephosd1033 smart_failure[949698]: Device: /dev/sdi [SAT], 840 Offline uncorrectable sectors
Oct 01 07:55:02 cloudcephosd1033 smart_failure[960920]: Device: /dev/sdj [SAT], 1944 Offline uncorrectable sectors
Oct 01 09:25:02 cloudcephosd1033 smart_failure[994870]: Device: /dev/sde [SAT], 968 Offline uncorrectable sectors
Oct 01 16:25:02 cloudcephosd1033 smart_failure[1152270]: Device: /dev/sdf [SAT], 1008 Offline uncorrectable sectors
Oct 02 01:25:02 cloudcephosd1033 smart_failure[1353822]: Device: /dev/sdg [SAT], 896 Offline uncorrectable sectors
Oct 02 01:55:03 cloudcephosd1033 smart_failure[1365502]: Device: /dev/sdd [SAT], 1272 Offline uncorrectable sectors
Oct 02 01:55:03 cloudcephosd1033 smart_failure[1365552]: Device: /dev/sdh [SAT], 1400 Offline uncorrectable sectors
Oct 02 06:25:02 cloudcephosd1033 smart_failure[1466876]: Device: /dev/sdb [SAT], 632 Offline uncorrectable sectors
Oct 02 07:25:02 cloudcephosd1033 smart_failure[1489459]: Device: /dev/sdi [SAT], 840 Offline uncorrectable sectors
Oct 02 07:55:02 cloudcephosd1033 smart_failure[1500578]: Device: /dev/sdj [SAT], 1952 Offline uncorrectable sectors
Oct 02 09:25:02 cloudcephosd1033 smart_failure[1533891]: Device: /dev/sde [SAT], 976 Offline uncorrectable sectors (changed +8)
Oct 02 16:25:02 cloudcephosd1033 smart_failure[1691106]: Device: /dev/sdf [SAT], 1008 Offline uncorrectable sectors
Oct 03 01:25:02 cloudcephosd1033 smart_failure[1884652]: Device: /dev/sdg [SAT], 904 Offline uncorrectable sectors
Oct 03 02:25:02 cloudcephosd1033 smart_failure[1907235]: Device: /dev/sdd [SAT], 1272 Offline uncorrectable sectors
Oct 03 02:25:02 cloudcephosd1033 smart_failure[1907279]: Device: /dev/sdh [SAT], 1400 Offline uncorrectable sectors
Oct 03 06:25:02 cloudcephosd1033 smart_failure[1997297]: Device: /dev/sdb [SAT], 632 Offline uncorrectable sectors
Oct 03 07:25:02 cloudcephosd1033 smart_failure[2020077]: Device: /dev/sdi [SAT], 840 Offline uncorrectable sectors
Oct 03 07:55:02 cloudcephosd1033 smart_failure[2031006]: Device: /dev/sdj [SAT], 1952 Offline uncorrectable sectors
Oct 03 09:25:02 cloudcephosd1033 smart_failure[2064091]: Device: /dev/sde [SAT], 976 Offline uncorrectable sectors
Oct 03 16:25:02 cloudcephosd1033 smart_failure[2220836]: Device: /dev/sdf [SAT], 1008 Offline uncorrectable sectors
Oct 04 01:25:02 cloudcephosd1033 smart_failure[2422931]: Device: /dev/sdg [SAT], 904 Offline uncorrectable sectors
Oct 04 02:25:03 cloudcephosd1033 smart_failure[2445547]: Device: /dev/sdd [SAT], 1272 Offline uncorrectable sectors
Oct 04 02:25:03 cloudcephosd1033 smart_failure[2445596]: Device: /dev/sdh [SAT], 1408 Offline uncorrectable sectors
Oct 04 06:25:02 cloudcephosd1033 smart_failure[2535360]: Device: /dev/sdb [SAT], 632 Offline uncorrectable sectors
Oct 04 07:25:02 cloudcephosd1033 smart_failure[2558904]: Device: /dev/sdi [SAT], 848 Offline uncorrectable sectors
Oct 04 07:55:02 cloudcephosd1033 smart_failure[2569857]: Device: /dev/sdj [SAT], 1960 Offline uncorrectable sectors
Oct 04 09:25:02 cloudcephosd1033 smart_failure[2603814]: Device: /dev/sde [SAT], 976 Offline uncorrectable sectors
Oct 04 16:25:02 cloudcephosd1033 smart_failure[2761945]: Device: /dev/sdf [SAT], 1008 Offline uncorrectable sectors
Oct 05 01:55:01 cloudcephosd1033 smart_failure[2975550]: Device: /dev/sdg [SAT], 904 Offline uncorrectable sectors
Oct 05 02:55:01 cloudcephosd1033 smart_failure[2997860]: Device: /dev/sdd [SAT], 1272 Offline uncorrectable sectors
Oct 05 02:55:01 cloudcephosd1033 smart_failure[2997909]: Device: /dev/sdh [SAT], 1408 Offline uncorrectable sectors
Oct 05 06:55:01 cloudcephosd1033 smart_failure[3088061]: Device: /dev/sdb [SAT], 632 Offline uncorrectable sectors
Oct 05 07:55:01 cloudcephosd1033 smart_failure[3110400]: Device: /dev/sdi [SAT], 856 Offline uncorrectable sectors
Oct 05 08:25:01 cloudcephosd1033 smart_failure[3121876]: Device: /dev/sdj [SAT], 1968 Offline uncorrectable sectors
Oct 05 09:55:01 cloudcephosd1033 smart_failure[3155525]: Device: /dev/sde [SAT], 976 Offline uncorrectable sectors
Oct 05 16:55:01 cloudcephosd1033 smart_failure[3325461]: Device: /dev/sdf [SAT], 1008 Offline uncorrectable sectors
Oct 06 01:55:01 cloudcephosd1033 smart_failure[3527566]: Device: /dev/sdg [SAT], 904 Offline uncorrectable sectors
Oct 06 02:55:01 cloudcephosd1033 smart_failure[3550252]: Device: /dev/sdd [SAT], 1280 Offline uncorrectable sectors
Oct 06 02:55:01 cloudcephosd1033 smart_failure[3550271]: Device: /dev/sdh [SAT], 1408 Offline uncorrectable sectors
Oct 06 06:55:01 cloudcephosd1033 smart_failure[3640917]: Device: /dev/sdb [SAT], 632 Offline uncorrectable sectors
Oct 06 07:55:01 cloudcephosd1033 smart_failure[3663871]: Device: /dev/sdi [SAT], 856 Offline uncorrectable sectors
Oct 06 08:25:01 cloudcephosd1033 smart_failure[3675312]: Device: /dev/sdj [SAT], 1976 Offline uncorrectable sectors
Oct 06 09:55:01 cloudcephosd1033 smart_failure[3708949]: Device: /dev/sde [SAT], 976 Offline uncorrectable sectors
Oct 06 16:55:01 cloudcephosd1033 smart_failure[3865656]: Device: /dev/sdf [SAT], 1008 Offline uncorrectable sectors
Oct 07 01:55:01 cloudcephosd1033 smart_failure[4067652]: Device: /dev/sdg [SAT], 904 Offline uncorrectable sectors
Oct 07 02:55:01 cloudcephosd1033 smart_failure[4089988]: Device: /dev/sdd [SAT], 1280 Offline uncorrectable sectors
Oct 07 02:55:01 cloudcephosd1033 smart_failure[4090038]: Device: /dev/sdh [SAT], 1408 Offline uncorrectable sectors
Oct 07 06:55:01 cloudcephosd1033 smart_failure[4179888]: Device: /dev/sdb [SAT], 632 Offline uncorrectable sectors
Oct 07 07:55:01 cloudcephosd1033 smart_failure[8663]: Device: /dev/sdi [SAT], 864 Offline uncorrectable sectors
Oct 07 08:25:01 cloudcephosd1033 smart_failure[20047]: Device: /dev/sdj [SAT], 1976 Offline uncorrectable sectors
Oct 07 09:55:01 cloudcephosd1033 smart_failure[53683]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Oct 07 16:55:01 cloudcephosd1033 smart_failure[210845]: Device: /dev/sdf [SAT], 1008 Offline uncorrectable sectors
Oct 08 01:55:01 cloudcephosd1033 smart_failure[413319]: Device: /dev/sdg [SAT], 920 Offline uncorrectable sectors
Oct 08 02:55:01 cloudcephosd1033 smart_failure[436049]: Device: /dev/sdd [SAT], 1280 Offline uncorrectable sectors
Oct 08 02:55:01 cloudcephosd1033 smart_failure[436108]: Device: /dev/sdh [SAT], 1408 Offline uncorrectable sectors
Oct 08 06:55:01 cloudcephosd1033 smart_failure[526002]: Device: /dev/sdb [SAT], 632 Offline uncorrectable sectors
Oct 08 07:55:01 cloudcephosd1033 smart_failure[548460]: Device: /dev/sdi [SAT], 864 Offline uncorrectable sectors
Oct 08 08:25:01 cloudcephosd1033 smart_failure[559780]: Device: /dev/sdj [SAT], 1984 Offline uncorrectable sectors
Oct 08 09:55:01 cloudcephosd1033 smart_failure[593143]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Oct 08 16:55:01 cloudcephosd1033 smart_failure[750503]: Device: /dev/sdf [SAT], 1016 Offline uncorrectable sectors
Oct 09 01:55:01 cloudcephosd1033 smart_failure[953058]: Device: /dev/sdg [SAT], 920 Offline uncorrectable sectors
Oct 09 02:55:01 cloudcephosd1033 smart_failure[975661]: Device: /dev/sdd [SAT], 1280 Offline uncorrectable sectors
Oct 09 02:55:01 cloudcephosd1033 smart_failure[975710]: Device: /dev/sdh [SAT], 1408 Offline uncorrectable sectors
Oct 09 06:55:01 cloudcephosd1033 smart_failure[1065243]: Device: /dev/sdb [SAT], 640 Offline uncorrectable sectors
Oct 09 07:55:01 cloudcephosd1033 smart_failure[1087308]: Device: /dev/sdi [SAT], 864 Offline uncorrectable sectors
Oct 09 08:25:01 cloudcephosd1033 smart_failure[1098863]: Device: /dev/sdj [SAT], 1984 Offline uncorrectable sectors
Oct 09 09:55:01 cloudcephosd1033 smart_failure[1132309]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Oct 09 16:55:01 cloudcephosd1033 smart_failure[1289167]: Device: /dev/sdf [SAT], 1016 Offline uncorrectable sectors
Oct 10 01:55:01 cloudcephosd1033 smart_failure[1492573]: Device: /dev/sdg [SAT], 920 Offline uncorrectable sectors
Oct 10 02:55:01 cloudcephosd1033 smart_failure[1514898]: Device: /dev/sdd [SAT], 1296 Offline uncorrectable sectors
Oct 10 02:55:01 cloudcephosd1033 smart_failure[1514947]: Device: /dev/sdh [SAT], 1408 Offline uncorrectable sectors
Oct 10 06:55:01 cloudcephosd1033 smart_failure[1604766]: Device: /dev/sdb [SAT], 640 Offline uncorrectable sectors
Oct 10 07:55:01 cloudcephosd1033 smart_failure[1627398]: Device: /dev/sdi [SAT], 864 Offline uncorrectable sectors
Oct 10 08:25:01 cloudcephosd1033 smart_failure[1639086]: Device: /dev/sdj [SAT], 1992 Offline uncorrectable sectors
Oct 10 09:55:01 cloudcephosd1033 smart_failure[1672544]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Oct 10 16:55:01 cloudcephosd1033 smart_failure[1829843]: Device: /dev/sdf [SAT], 1024 Offline uncorrectable sectors
Oct 11 01:55:01 cloudcephosd1033 smart_failure[2032877]: Device: /dev/sdg [SAT], 928 Offline uncorrectable sectors
Oct 11 02:55:01 cloudcephosd1033 smart_failure[2055153]: Device: /dev/sdd [SAT], 1304 Offline uncorrectable sectors
Oct 11 02:55:01 cloudcephosd1033 smart_failure[2055204]: Device: /dev/sdh [SAT], 1408 Offline uncorrectable sectors
Oct 11 06:55:01 cloudcephosd1033 smart_failure[2145455]: Device: /dev/sdb [SAT], 656 Offline uncorrectable sectors
Oct 11 07:55:01 cloudcephosd1033 smart_failure[2167965]: Device: /dev/sdi [SAT], 864 Offline uncorrectable sectors
Oct 11 08:25:01 cloudcephosd1033 smart_failure[2179284]: Device: /dev/sdj [SAT], 2000 Offline uncorrectable sectors
Oct 11 09:55:01 cloudcephosd1033 smart_failure[2213336]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Sep 14 15:55:02 cloudcephosd1033 smart_failure[323250]: Device: /dev/sdf [SAT], 992 Offline uncorrectable sectors
Sep 15 00:25:02 cloudcephosd1033 smart_failure[515104]: Device: /dev/sdg [SAT], 840 Offline uncorrectable sectors
Sep 15 01:55:02 cloudcephosd1033 smart_failure[548913]: Device: /dev/sdd [SAT], 1176 Offline uncorrectable sectors
Sep 15 01:55:02 cloudcephosd1033 smart_failure[548962]: Device: /dev/sdh [SAT], 1368 Offline uncorrectable sectors
Sep 15 06:25:02 cloudcephosd1033 smart_failure[651273]: Device: /dev/sdb [SAT], 560 Offline uncorrectable sectors
Sep 15 07:25:02 cloudcephosd1033 smart_failure[673713]: Device: /dev/sdi [SAT], 816 Offline uncorrectable sectors
Sep 15 07:25:02 cloudcephosd1033 smart_failure[673761]: Device: /dev/sdj [SAT], 1712 Offline uncorrectable sectors
Sep 15 08:55:02 cloudcephosd1033 smart_failure[707287]: Device: /dev/sde [SAT], 896 Offline uncorrectable sectors
Sep 15 15:55:02 cloudcephosd1033 smart_failure[865992]: Device: /dev/sdf [SAT], 992 Offline uncorrectable sectors
Sep 16 00:25:02 cloudcephosd1033 smart_failure[1058928]: Device: /dev/sdg [SAT], 840 Offline uncorrectable sectors
Sep 16 01:55:02 cloudcephosd1033 smart_failure[1092631]: Device: /dev/sdd [SAT], 1184 Offline uncorrectable sectors
Sep 16 01:55:02 cloudcephosd1033 smart_failure[1092681]: Device: /dev/sdh [SAT], 1368 Offline uncorrectable sectors
Sep 16 06:25:02 cloudcephosd1033 smart_failure[1195011]: Device: /dev/sdb [SAT], 560 Offline uncorrectable sectors
Sep 16 07:25:03 cloudcephosd1033 smart_failure[1217646]: Device: /dev/sdi [SAT], 816 Offline uncorrectable sectors
Sep 16 07:25:03 cloudcephosd1033 smart_failure[1217688]: Device: /dev/sdj [SAT], 1712 Offline uncorrectable sectors
Sep 16 08:55:02 cloudcephosd1033 smart_failure[1251216]: Device: /dev/sde [SAT], 904 Offline uncorrectable sectors
Sep 16 15:55:02 cloudcephosd1033 smart_failure[1410025]: Device: /dev/sdf [SAT], 992 Offline uncorrectable sectors
Sep 17 00:25:03 cloudcephosd1033 smart_failure[1602858]: Device: /dev/sdg [SAT], 840 Offline uncorrectable sectors
Sep 17 01:55:02 cloudcephosd1033 smart_failure[1636707]: Device: /dev/sdd [SAT], 1184 Offline uncorrectable sectors
Sep 17 01:55:02 cloudcephosd1033 smart_failure[1636756]: Device: /dev/sdh [SAT], 1368 Offline uncorrectable sectors
Sep 17 06:25:02 cloudcephosd1033 smart_failure[1738885]: Device: /dev/sdb [SAT], 560 Offline uncorrectable sectors
Sep 17 07:25:02 cloudcephosd1033 smart_failure[1761486]: Device: /dev/sdi [SAT], 816 Offline uncorrectable sectors
Sep 17 07:55:02 cloudcephosd1033 smart_failure[1772813]: Device: /dev/sdj [SAT], 1736 Offline uncorrectable sectors
Sep 17 08:55:02 cloudcephosd1033 smart_failure[1795380]: Device: /dev/sde [SAT], 912 Offline uncorrectable sectors
Sep 17 15:55:02 cloudcephosd1033 smart_failure[1953505]: Device: /dev/sdf [SAT], 1000 Offline uncorrectable sectors (changed +8)
Sep 18 00:55:02 cloudcephosd1033 smart_failure[2157372]: Device: /dev/sdg [SAT], 840 Offline uncorrectable sectors
Sep 18 01:55:02 cloudcephosd1033 smart_failure[2179870]: Device: /dev/sdd [SAT], 1184 Offline uncorrectable sectors
Sep 18 01:55:02 cloudcephosd1033 smart_failure[2179919]: Device: /dev/sdh [SAT], 1368 Offline uncorrectable sectors
Sep 18 06:25:02 cloudcephosd1033 smart_failure[2281714]: Device: /dev/sdb [SAT], 560 Offline uncorrectable sectors
Sep 18 07:25:02 cloudcephosd1033 smart_failure[2304543]: Device: /dev/sdi [SAT], 824 Offline uncorrectable sectors
Sep 18 07:55:02 cloudcephosd1033 smart_failure[2315733]: Device: /dev/sdj [SAT], 1736 Offline uncorrectable sectors
Sep 18 08:55:03 cloudcephosd1033 smart_failure[2337979]: Device: /dev/sde [SAT], 928 Offline uncorrectable sectors
Sep 18 15:55:02 cloudcephosd1033 smart_failure[2496080]: Device: /dev/sdf [SAT], 1000 Offline uncorrectable sectors
Sep 19 00:55:02 cloudcephosd1033 smart_failure[2700761]: Device: /dev/sdg [SAT], 848 Offline uncorrectable sectors
Sep 19 01:55:02 cloudcephosd1033 smart_failure[2723450]: Device: /dev/sdd [SAT], 1192 Offline uncorrectable sectors
Sep 19 01:55:03 cloudcephosd1033 smart_failure[2723499]: Device: /dev/sdh [SAT], 1368 Offline uncorrectable sectors
Sep 19 06:25:02 cloudcephosd1033 smart_failure[2826033]: Device: /dev/sdb [SAT], 568 Offline uncorrectable sectors
Sep 19 07:25:02 cloudcephosd1033 smart_failure[2848898]: Device: /dev/sdi [SAT], 824 Offline uncorrectable sectors
Sep 19 07:55:02 cloudcephosd1033 smart_failure[2860173]: Device: /dev/sdj [SAT], 1744 Offline uncorrectable sectors
Sep 19 09:25:02 cloudcephosd1033 smart_failure[2894097]: Device: /dev/sde [SAT], 928 Offline uncorrectable sectors
Sep 19 15:55:02 cloudcephosd1033 smart_failure[3041263]: Device: /dev/sdf [SAT], 1000 Offline uncorrectable sectors
Sep 20 00:55:02 cloudcephosd1033 smart_failure[3246875]: Device: /dev/sdg [SAT], 848 Offline uncorrectable sectors
Sep 20 01:55:02 cloudcephosd1033 smart_failure[3269265]: Device: /dev/sdd [SAT], 1200 Offline uncorrectable sectors
Sep 20 01:55:02 cloudcephosd1033 smart_failure[3269314]: Device: /dev/sdh [SAT], 1368 Offline uncorrectable sectors
Sep 20 06:25:02 cloudcephosd1033 smart_failure[3370605]: Device: /dev/sdb [SAT], 568 Offline uncorrectable sectors
Sep 20 07:25:02 cloudcephosd1033 smart_failure[3393254]: Device: /dev/sdi [SAT], 824 Offline uncorrectable sectors
Sep 20 07:55:02 cloudcephosd1033 smart_failure[3404451]: Device: /dev/sdj [SAT], 1744 Offline uncorrectable sectors
Sep 20 09:25:02 cloudcephosd1033 smart_failure[3438451]: Device: /dev/sde [SAT], 944 Offline uncorrectable sectors
Sep 20 15:55:02 cloudcephosd1033 smart_failure[3585074]: Device: /dev/sdf [SAT], 1000 Offline uncorrectable sectors
Sep 21 00:55:02 cloudcephosd1033 smart_failure[3787202]: Device: /dev/sdg [SAT], 848 Offline uncorrectable sectors
Sep 21 01:55:02 cloudcephosd1033 smart_failure[3810023]: Device: /dev/sdd [SAT], 1200 Offline uncorrectable sectors
Sep 21 01:55:02 cloudcephosd1033 smart_failure[3810042]: Device: /dev/sdh [SAT], 1384 Offline uncorrectable sectors
Sep 21 06:25:02 cloudcephosd1033 smart_failure[3910607]: Device: /dev/sdb [SAT], 616 Offline uncorrectable sectors
Sep 21 07:25:02 cloudcephosd1033 smart_failure[3933134]: Device: /dev/sdi [SAT], 824 Offline uncorrectable sectors
Sep 21 07:55:02 cloudcephosd1033 smart_failure[3943984]: Device: /dev/sdj [SAT], 1752 Offline uncorrectable sectors
Sep 21 09:25:02 cloudcephosd1033 smart_failure[3977881]: Device: /dev/sde [SAT], 944 Offline uncorrectable sectors
Sep 21 15:55:02 cloudcephosd1033 smart_failure[4124739]: Device: /dev/sdf [SAT], 1000 Offline uncorrectable sectors
Sep 22 00:55:02 cloudcephosd1033 smart_failure[133164]: Device: /dev/sdg [SAT], 848 Offline uncorrectable sectors
Sep 22 01:55:02 cloudcephosd1033 smart_failure[155447]: Device: /dev/sdd [SAT], 1208 Offline uncorrectable sectors
Sep 22 01:55:02 cloudcephosd1033 smart_failure[155496]: Device: /dev/sdh [SAT], 1384 Offline uncorrectable sectors
Sep 22 06:25:02 cloudcephosd1033 smart_failure[256561]: Device: /dev/sdb [SAT], 616 Offline uncorrectable sectors
Sep 22 07:25:02 cloudcephosd1033 smart_failure[279095]: Device: /dev/sdi [SAT], 824 Offline uncorrectable sectors
Sep 22 07:55:02 cloudcephosd1033 smart_failure[290133]: Device: /dev/sdj [SAT], 1776 Offline uncorrectable sectors
Sep 22 09:25:02 cloudcephosd1033 smart_failure[324219]: Device: /dev/sde [SAT], 944 Offline uncorrectable sectors
Sep 22 15:55:02 cloudcephosd1033 smart_failure[469877]: Device: /dev/sdf [SAT], 1000 Offline uncorrectable sectors
Sep 23 00:55:02 cloudcephosd1033 smart_failure[673043]: Device: /dev/sdg [SAT], 856 Offline uncorrectable sectors
Sep 23 01:55:02 cloudcephosd1033 smart_failure[695606]: Device: /dev/sdd [SAT], 1208 Offline uncorrectable sectors
Sep 23 01:55:02 cloudcephosd1033 smart_failure[695625]: Device: /dev/sdh [SAT], 1384 Offline uncorrectable sectors
Sep 23 06:25:02 cloudcephosd1033 smart_failure[796684]: Device: /dev/sdb [SAT], 616 Offline uncorrectable sectors
Sep 23 07:25:02 cloudcephosd1033 smart_failure[819443]: Device: /dev/sdi [SAT], 824 Offline uncorrectable sectors
Sep 23 07:55:02 cloudcephosd1033 smart_failure[830876]: Device: /dev/sdj [SAT], 1776 Offline uncorrectable sectors
Sep 23 09:25:02 cloudcephosd1033 smart_failure[864463]: Device: /dev/sde [SAT], 944 Offline uncorrectable sectors
Sep 23 15:55:02 cloudcephosd1033 smart_failure[1010339]: Device: /dev/sdf [SAT], 1000 Offline uncorrectable sectors
Sep 24 00:55:02 cloudcephosd1033 smart_failure[1212090]: Device: /dev/sdg [SAT], 864 Offline uncorrectable sectors
Sep 24 01:55:02 cloudcephosd1033 smart_failure[1235114]: Device: /dev/sdd [SAT], 1208 Offline uncorrectable sectors
Sep 24 01:55:02 cloudcephosd1033 smart_failure[1235133]: Device: /dev/sdh [SAT], 1384 Offline uncorrectable sectors
Sep 24 06:25:02 cloudcephosd1033 smart_failure[1335975]: Device: /dev/sdb [SAT], 616 Offline uncorrectable sectors
Sep 24 07:25:02 cloudcephosd1033 smart_failure[1358711]: Device: /dev/sdi [SAT], 824 Offline uncorrectable sectors
Sep 24 07:55:02 cloudcephosd1033 smart_failure[1370715]: Device: /dev/sdj [SAT], 1776 Offline uncorrectable sectors
Sep 24 09:25:02 cloudcephosd1033 smart_failure[1404175]: Device: /dev/sde [SAT], 952 Offline uncorrectable sectors
Sep 24 15:55:02 cloudcephosd1033 smart_failure[1549854]: Device: /dev/sdf [SAT], 1000 Offline uncorrectable sectors
Sep 25 00:55:02 cloudcephosd1033 smart_failure[1752421]: Device: /dev/sdg [SAT], 864 Offline uncorrectable sectors
Sep 25 01:55:02 cloudcephosd1033 smart_failure[1774935]: Device: /dev/sdd [SAT], 1208 Offline uncorrectable sectors
Sep 25 01:55:02 cloudcephosd1033 smart_failure[1774954]: Device: /dev/sdh [SAT], 1392 Offline uncorrectable sectors
Sep 25 06:25:02 cloudcephosd1033 smart_failure[1875873]: Device: /dev/sdb [SAT], 616 Offline uncorrectable sectors
Sep 25 07:25:02 cloudcephosd1033 smart_failure[1898508]: Device: /dev/sdi [SAT], 824 Offline uncorrectable sectors
Sep 25 07:55:02 cloudcephosd1033 smart_failure[1909730]: Device: /dev/sdj [SAT], 1808 Offline uncorrectable sectors
Sep 25 09:25:02 cloudcephosd1033 smart_failure[1943546]: Device: /dev/sde [SAT], 952 Offline uncorrectable sectors
Sep 25 15:55:02 cloudcephosd1033 smart_failure[2089145]: Device: /dev/sdf [SAT], 1000 Offline uncorrectable sectors
Sep 26 00:55:02 cloudcephosd1033 smart_failure[2292066]: Device: /dev/sdg [SAT], 872 Offline uncorrectable sectors
Sep 26 01:55:02 cloudcephosd1033 smart_failure[2314794]: Device: /dev/sdd [SAT], 1216 Offline uncorrectable sectors
Sep 26 01:55:02 cloudcephosd1033 smart_failure[2314842]: Device: /dev/sdh [SAT], 1392 Offline uncorrectable sectors
Sep 26 06:25:02 cloudcephosd1033 smart_failure[2416678]: Device: /dev/sdb [SAT], 616 Offline uncorrectable sectors
Sep 26 07:25:02 cloudcephosd1033 smart_failure[2439331]: Device: /dev/sdi [SAT], 840 Offline uncorrectable sectors
Sep 26 07:55:02 cloudcephosd1033 smart_failure[2450146]: Device: /dev/sdj [SAT], 1816 Offline uncorrectable sectors
Sep 26 09:25:02 cloudcephosd1033 smart_failure[2484288]: Device: /dev/sde [SAT], 968 Offline uncorrectable sectors
Sep 26 15:55:02 cloudcephosd1033 smart_failure[2631805]: Device: /dev/sdf [SAT], 1000 Offline uncorrectable sectors
Sep 27 00:55:02 cloudcephosd1033 smart_failure[2835273]: Device: /dev/sdg [SAT], 880 Offline uncorrectable sectors
Sep 27 01:55:02 cloudcephosd1033 smart_failure[2857617]: Device: /dev/sdd [SAT], 1240 Offline uncorrectable sectors
Sep 27 01:55:02 cloudcephosd1033 smart_failure[2857670]: Device: /dev/sdh [SAT], 1400 Offline uncorrectable sectors (changed +8)
Sep 27 06:25:02 cloudcephosd1033 smart_failure[2959230]: Device: /dev/sdb [SAT], 624 Offline uncorrectable sectors
Sep 27 07:25:02 cloudcephosd1033 smart_failure[2981025]: Device: /dev/sdi [SAT], 840 Offline uncorrectable sectors
Sep 27 07:55:02 cloudcephosd1033 smart_failure[2992267]: Device: /dev/sdj [SAT], 1840 Offline uncorrectable sectors
Sep 27 09:25:02 cloudcephosd1033 smart_failure[3025957]: Device: /dev/sde [SAT], 968 Offline uncorrectable sectors
Sep 27 15:55:02 cloudcephosd1033 smart_failure[3172401]: Device: /dev/sdf [SAT], 1008 Offline uncorrectable sectors
Sep 28 00:55:02 cloudcephosd1033 smart_failure[3375359]: Device: /dev/sdg [SAT], 880 Offline uncorrectable sectors
Sep 28 01:55:02 cloudcephosd1033 smart_failure[3398050]: Device: /dev/sdd [SAT], 1240 Offline uncorrectable sectors
Sep 28 01:55:02 cloudcephosd1033 smart_failure[3398100]: Device: /dev/sdh [SAT], 1400 Offline uncorrectable sectors
Sep 28 06:25:02 cloudcephosd1033 smart_failure[3499355]: Device: /dev/sdb [SAT], 624 Offline uncorrectable sectors
Sep 28 07:25:02 cloudcephosd1033 smart_failure[3521859]: Device: /dev/sdi [SAT], 840 Offline uncorrectable sectors
Sep 28 07:55:02 cloudcephosd1033 smart_failure[3532809]: Device: /dev/sdj [SAT], 1848 Offline uncorrectable sectors
Sep 28 09:25:02 cloudcephosd1033 smart_failure[3566492]: Device: /dev/sde [SAT], 968 Offline uncorrectable sectors
Sep 28 15:55:03 cloudcephosd1033 smart_failure[3712859]: Device: /dev/sdf [SAT], 1008 Offline uncorrectable sectors
Sep 29 00:55:02 cloudcephosd1033 smart_failure[3915773]: Device: /dev/sdg [SAT], 880 Offline uncorrectable sectors
Sep 29 01:55:02 cloudcephosd1033 smart_failure[3938195]: Device: /dev/sdd [SAT], 1264 Offline uncorrectable sectors
Sep 29 01:55:02 cloudcephosd1033 smart_failure[3938244]: Device: /dev/sdh [SAT], 1400 Offline uncorrectable sectors
Sep 29 06:25:02 cloudcephosd1033 smart_failure[4039502]: Device: /dev/sdb [SAT], 624 Offline uncorrectable sectors
Sep 29 07:25:02 cloudcephosd1033 smart_failure[4062043]: Device: /dev/sdi [SAT], 840 Offline uncorrectable sectors
Sep 29 07:55:03 cloudcephosd1033 smart_failure[4073222]: Device: /dev/sdj [SAT], 1848 Offline uncorrectable sectors
Sep 29 09:25:02 cloudcephosd1033 smart_failure[4107169]: Device: /dev/sde [SAT], 968 Offline uncorrectable sectors
Sep 29 16:25:02 cloudcephosd1033 smart_failure[70229]: Device: /dev/sdf [SAT], 1008 Offline uncorrectable sectors
Sep 30 00:55:03 cloudcephosd1033 smart_failure[261832]: Device: /dev/sdg [SAT], 880 Offline uncorrectable sectors
Sep 30 01:55:02 cloudcephosd1033 smart_failure[284042]: Device: /dev/sdd [SAT], 1264 Offline uncorrectable sectors
Sep 30 01:55:02 cloudcephosd1033 smart_failure[284093]: Device: /dev/sdh [SAT], 1400 Offline uncorrectable sectors
Sep 30 06:25:02 cloudcephosd1033 smart_failure[385655]: Device: /dev/sdb [SAT], 624 Offline uncorrectable sectors
Sep 30 07:25:02 cloudcephosd1033 smart_failure[408439]: Device: /dev/sdi [SAT], 840 Offline uncorrectable sectors
Sep 30 07:55:02 cloudcephosd1033 smart_failure[419651]: Device: /dev/sdj [SAT], 1912 Offline uncorrectable sectors
Sep 30 09:25:02 cloudcephosd1033 smart_failure[453691]: Device: /dev/sde [SAT], 968 Offline uncorrectable sectors
Sep 30 16:25:03 cloudcephosd1033 smart_failure[611519]: Device: /dev/sdf [SAT], 1008 Offline uncorrectable sectors
===== NODE GROUP =====
(1) cloudcephosd1026.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 01 00:02:04 cloudcephosd1026 smart_failure[1394667]: Device: /dev/sdj [SAT], 1080 Offline uncorrectable sectors
Oct 01 12:02:04 cloudcephosd1026 smart_failure[1666741]: Device: /dev/sdi [SAT], 2000 Offline uncorrectable sectors
Oct 01 17:02:04 cloudcephosd1026 smart_failure[1780005]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Oct 01 18:32:04 cloudcephosd1026 smart_failure[1814575]: Device: /dev/sdd [SAT], 1368 Offline uncorrectable sectors
Oct 01 20:32:04 cloudcephosd1026 smart_failure[1859923]: Device: /dev/sdf [SAT], 688 Offline uncorrectable sectors
Oct 01 22:02:04 cloudcephosd1026 smart_failure[1893688]: Device: /dev/sde [SAT], 704 Offline uncorrectable sectors
Oct 01 22:02:04 cloudcephosd1026 smart_failure[1893707]: Device: /dev/sdg [SAT], 2160 Offline uncorrectable sectors
Oct 01 23:02:04 cloudcephosd1026 smart_failure[1916317]: Device: /dev/sdc [SAT], 1272 Offline uncorrectable sectors
Oct 02 00:02:04 cloudcephosd1026 smart_failure[1938917]: Device: /dev/sdj [SAT], 1088 Offline uncorrectable sectors
Oct 02 12:02:04 cloudcephosd1026 smart_failure[2209338]: Device: /dev/sdi [SAT], 2016 Offline uncorrectable sectors
Oct 02 17:02:04 cloudcephosd1026 smart_failure[2321953]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Oct 02 18:32:04 cloudcephosd1026 smart_failure[2355870]: Device: /dev/sdd [SAT], 1368 Offline uncorrectable sectors
Oct 02 20:32:04 cloudcephosd1026 smart_failure[2400856]: Device: /dev/sdf [SAT], 696 Offline uncorrectable sectors
Oct 02 22:02:04 cloudcephosd1026 smart_failure[2433286]: Device: /dev/sde [SAT], 704 Offline uncorrectable sectors
Oct 02 22:02:04 cloudcephosd1026 smart_failure[2433305]: Device: /dev/sdg [SAT], 2168 Offline uncorrectable sectors
Oct 02 23:02:04 cloudcephosd1026 smart_failure[2453196]: Device: /dev/sdc [SAT], 1272 Offline uncorrectable sectors
Oct 03 00:02:04 cloudcephosd1026 smart_failure[2473415]: Device: /dev/sdj [SAT], 1088 Offline uncorrectable sectors
Oct 03 12:02:04 cloudcephosd1026 smart_failure[2740858]: Device: /dev/sdi [SAT], 2016 Offline uncorrectable sectors
Oct 03 17:02:04 cloudcephosd1026 smart_failure[2853709]: Device: /dev/sdh [SAT], 888 Offline uncorrectable sectors
Oct 03 18:32:04 cloudcephosd1026 smart_failure[2887607]: Device: /dev/sdd [SAT], 1368 Offline uncorrectable sectors
Oct 03 20:32:04 cloudcephosd1026 smart_failure[2933005]: Device: /dev/sdf [SAT], 696 Offline uncorrectable sectors
Oct 03 22:02:04 cloudcephosd1026 smart_failure[2966956]: Device: /dev/sde [SAT], 704 Offline uncorrectable sectors
Oct 03 22:02:04 cloudcephosd1026 smart_failure[2966975]: Device: /dev/sdg [SAT], 2168 Offline uncorrectable sectors
Oct 03 23:02:04 cloudcephosd1026 smart_failure[2989473]: Device: /dev/sdc [SAT], 1272 Offline uncorrectable sectors
Oct 04 00:02:04 cloudcephosd1026 smart_failure[3012050]: Device: /dev/sdj [SAT], 1088 Offline uncorrectable sectors
Oct 04 12:02:04 cloudcephosd1026 smart_failure[3284036]: Device: /dev/sdi [SAT], 2024 Offline uncorrectable sectors
Oct 04 17:02:04 cloudcephosd1026 smart_failure[3398347]: Device: /dev/sdh [SAT], 888 Offline uncorrectable sectors
Oct 04 18:32:04 cloudcephosd1026 smart_failure[3432518]: Device: /dev/sdd [SAT], 1368 Offline uncorrectable sectors
Oct 04 20:32:04 cloudcephosd1026 smart_failure[3478086]: Device: /dev/sdf [SAT], 696 Offline uncorrectable sectors
Oct 04 22:02:04 cloudcephosd1026 smart_failure[3511580]: Device: /dev/sde [SAT], 704 Offline uncorrectable sectors
Oct 04 22:02:04 cloudcephosd1026 smart_failure[3511599]: Device: /dev/sdg [SAT], 2168 Offline uncorrectable sectors
Oct 04 23:02:04 cloudcephosd1026 smart_failure[3534144]: Device: /dev/sdc [SAT], 1272 Offline uncorrectable sectors
Oct 05 00:02:04 cloudcephosd1026 smart_failure[3556831]: Device: /dev/sdj [SAT], 1088 Offline uncorrectable sectors
Oct 05 12:02:04 cloudcephosd1026 smart_failure[3827077]: Device: /dev/sdi [SAT], 2032 Offline uncorrectable sectors
Oct 05 17:02:04 cloudcephosd1026 smart_failure[3951813]: Device: /dev/sdh [SAT], 888 Offline uncorrectable sectors
Oct 05 18:32:04 cloudcephosd1026 smart_failure[3985861]: Device: /dev/sdd [SAT], 1376 Offline uncorrectable sectors
Oct 05 20:32:04 cloudcephosd1026 smart_failure[4030844]: Device: /dev/sdf [SAT], 696 Offline uncorrectable sectors
Oct 05 22:02:04 cloudcephosd1026 smart_failure[4064936]: Device: /dev/sde [SAT], 704 Offline uncorrectable sectors
Oct 05 22:02:04 cloudcephosd1026 smart_failure[4064955]: Device: /dev/sdg [SAT], 2176 Offline uncorrectable sectors
Oct 05 23:02:04 cloudcephosd1026 smart_failure[4087552]: Device: /dev/sdc [SAT], 1280 Offline uncorrectable sectors
Oct 06 00:02:04 cloudcephosd1026 smart_failure[4110389]: Device: /dev/sdj [SAT], 1088 Offline uncorrectable sectors
Oct 06 12:02:04 cloudcephosd1026 smart_failure[186208]: Device: /dev/sdi [SAT], 2048 Offline uncorrectable sectors (changed +16)
Oct 06 17:02:04 cloudcephosd1026 smart_failure[299205]: Device: /dev/sdh [SAT], 888 Offline uncorrectable sectors
Oct 06 18:32:04 cloudcephosd1026 smart_failure[333070]: Device: /dev/sdd [SAT], 1432 Offline uncorrectable sectors
Oct 06 20:32:04 cloudcephosd1026 smart_failure[378347]: Device: /dev/sdf [SAT], 696 Offline uncorrectable sectors
Oct 06 22:02:04 cloudcephosd1026 smart_failure[411988]: Device: /dev/sde [SAT], 704 Offline uncorrectable sectors
Oct 06 22:02:04 cloudcephosd1026 smart_failure[412007]: Device: /dev/sdg [SAT], 2176 Offline uncorrectable sectors
Oct 06 23:02:05 cloudcephosd1026 smart_failure[434165]: Device: /dev/sdc [SAT], 1280 Offline uncorrectable sectors
Oct 07 00:02:04 cloudcephosd1026 smart_failure[456793]: Device: /dev/sdj [SAT], 1088 Offline uncorrectable sectors
Oct 07 12:02:04 cloudcephosd1026 smart_failure[727768]: Device: /dev/sdi [SAT], 2056 Offline uncorrectable sectors
Oct 07 17:02:04 cloudcephosd1026 smart_failure[840874]: Device: /dev/sdh [SAT], 896 Offline uncorrectable sectors
Oct 07 18:32:04 cloudcephosd1026 smart_failure[875037]: Device: /dev/sdd [SAT], 1432 Offline uncorrectable sectors
Oct 07 20:32:04 cloudcephosd1026 smart_failure[920104]: Device: /dev/sdf [SAT], 696 Offline uncorrectable sectors
Oct 07 22:02:04 cloudcephosd1026 smart_failure[953919]: Device: /dev/sde [SAT], 704 Offline uncorrectable sectors
Oct 07 22:02:04 cloudcephosd1026 smart_failure[953938]: Device: /dev/sdg [SAT], 2184 Offline uncorrectable sectors
Oct 07 23:02:04 cloudcephosd1026 smart_failure[976477]: Device: /dev/sdc [SAT], 1280 Offline uncorrectable sectors
Oct 08 00:02:04 cloudcephosd1026 smart_failure[999297]: Device: /dev/sdj [SAT], 1088 Offline uncorrectable sectors
Oct 08 12:02:04 cloudcephosd1026 smart_failure[1270632]: Device: /dev/sdi [SAT], 2056 Offline uncorrectable sectors
Oct 08 17:02:04 cloudcephosd1026 smart_failure[1383705]: Device: /dev/sdh [SAT], 896 Offline uncorrectable sectors
Oct 08 18:32:04 cloudcephosd1026 smart_failure[1417927]: Device: /dev/sdd [SAT], 1432 Offline uncorrectable sectors
Oct 08 20:32:04 cloudcephosd1026 smart_failure[1463203]: Device: /dev/sdf [SAT], 696 Offline uncorrectable sectors
Oct 08 22:02:04 cloudcephosd1026 smart_failure[1496760]: Device: /dev/sde [SAT], 704 Offline uncorrectable sectors
Oct 08 22:02:04 cloudcephosd1026 smart_failure[1496779]: Device: /dev/sdg [SAT], 2192 Offline uncorrectable sectors
Oct 08 23:02:04 cloudcephosd1026 smart_failure[1519289]: Device: /dev/sdc [SAT], 1280 Offline uncorrectable sectors
Oct 09 00:02:05 cloudcephosd1026 smart_failure[1542201]: Device: /dev/sdj [SAT], 1088 Offline uncorrectable sectors
Oct 09 12:02:04 cloudcephosd1026 smart_failure[1813779]: Device: /dev/sdi [SAT], 2056 Offline uncorrectable sectors
Oct 09 17:02:05 cloudcephosd1026 smart_failure[1926453]: Device: /dev/sdh [SAT], 896 Offline uncorrectable sectors
Oct 09 18:32:04 cloudcephosd1026 smart_failure[1960675]: Device: /dev/sdd [SAT], 1432 Offline uncorrectable sectors
Oct 09 20:32:04 cloudcephosd1026 smart_failure[2006090]: Device: /dev/sdf [SAT], 696 Offline uncorrectable sectors
Oct 09 22:02:04 cloudcephosd1026 smart_failure[2039929]: Device: /dev/sde [SAT], 704 Offline uncorrectable sectors
Oct 09 22:02:04 cloudcephosd1026 smart_failure[2039948]: Device: /dev/sdg [SAT], 2192 Offline uncorrectable sectors
Oct 09 23:02:04 cloudcephosd1026 smart_failure[2062454]: Device: /dev/sdc [SAT], 1280 Offline uncorrectable sectors
Oct 10 00:32:04 cloudcephosd1026 smart_failure[2096683]: Device: /dev/sdj [SAT], 1096 Offline uncorrectable sectors
Oct 10 12:02:04 cloudcephosd1026 smart_failure[2356724]: Device: /dev/sdi [SAT], 2064 Offline uncorrectable sectors
Oct 10 17:32:04 cloudcephosd1026 smart_failure[2481443]: Device: /dev/sdh [SAT], 896 Offline uncorrectable sectors
Oct 10 18:32:04 cloudcephosd1026 smart_failure[2504120]: Device: /dev/sdd [SAT], 1432 Offline uncorrectable sectors
Oct 10 20:32:04 cloudcephosd1026 smart_failure[2549717]: Device: /dev/sdf [SAT], 696 Offline uncorrectable sectors
Oct 10 22:02:04 cloudcephosd1026 smart_failure[2583758]: Device: /dev/sde [SAT], 704 Offline uncorrectable sectors
Oct 10 22:02:04 cloudcephosd1026 smart_failure[2583777]: Device: /dev/sdg [SAT], 2192 Offline uncorrectable sectors
Oct 10 23:02:04 cloudcephosd1026 smart_failure[2606546]: Device: /dev/sdc [SAT], 1280 Offline uncorrectable sectors
Oct 11 00:32:04 cloudcephosd1026 smart_failure[2640622]: Device: /dev/sdj [SAT], 1104 Offline uncorrectable sectors
Oct 11 12:02:04 cloudcephosd1026 smart_failure[2900519]: Device: /dev/sdi [SAT], 2064 Offline uncorrectable sectors
Sep 08 12:02:04 cloudcephosd1026 smart_failure[1753688]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Sep 08 17:02:04 cloudcephosd1026 smart_failure[1866905]: Device: /dev/sdh [SAT], 840 Offline uncorrectable sectors
Sep 08 18:32:04 cloudcephosd1026 smart_failure[1901153]: Device: /dev/sdd [SAT], 1328 Offline uncorrectable sectors
Sep 08 19:32:04 cloudcephosd1026 smart_failure[1923909]: Device: /dev/sdf [SAT], 656 Offline uncorrectable sectors
Sep 08 21:32:04 cloudcephosd1026 smart_failure[1969449]: Device: /dev/sde [SAT], 640 Offline uncorrectable sectors
Sep 08 21:32:04 cloudcephosd1026 smart_failure[1969468]: Device: /dev/sdg [SAT], 2032 Offline uncorrectable sectors
Sep 08 23:02:04 cloudcephosd1026 smart_failure[2003412]: Device: /dev/sdc [SAT], 1176 Offline uncorrectable sectors
Sep 09 00:02:04 cloudcephosd1026 smart_failure[2026238]: Device: /dev/sdj [SAT], 992 Offline uncorrectable sectors
Sep 09 12:02:04 cloudcephosd1026 smart_failure[2297805]: Device: /dev/sdi [SAT], 1792 Offline uncorrectable sectors
Sep 09 17:02:04 cloudcephosd1026 smart_failure[2410245]: Device: /dev/sdh [SAT], 840 Offline uncorrectable sectors
Sep 09 18:32:04 cloudcephosd1026 smart_failure[2444342]: Device: /dev/sdd [SAT], 1328 Offline uncorrectable sectors
Sep 09 19:32:04 cloudcephosd1026 smart_failure[2467044]: Device: /dev/sdf [SAT], 656 Offline uncorrectable sectors
Sep 09 21:32:04 cloudcephosd1026 smart_failure[2511887]: Device: /dev/sde [SAT], 640 Offline uncorrectable sectors
Sep 09 21:32:04 cloudcephosd1026 smart_failure[2511906]: Device: /dev/sdg [SAT], 2032 Offline uncorrectable sectors
Sep 09 23:02:04 cloudcephosd1026 smart_failure[2545914]: Device: /dev/sdc [SAT], 1184 Offline uncorrectable sectors
Sep 10 00:02:04 cloudcephosd1026 smart_failure[2568756]: Device: /dev/sdj [SAT], 992 Offline uncorrectable sectors
Sep 10 12:02:04 cloudcephosd1026 smart_failure[2840891]: Device: /dev/sdi [SAT], 1792 Offline uncorrectable sectors
Sep 10 17:02:04 cloudcephosd1026 smart_failure[2954183]: Device: /dev/sdh [SAT], 840 Offline uncorrectable sectors
Sep 10 18:32:04 cloudcephosd1026 smart_failure[2988265]: Device: /dev/sdd [SAT], 1328 Offline uncorrectable sectors
Sep 10 19:32:04 cloudcephosd1026 smart_failure[3010693]: Device: /dev/sdf [SAT], 656 Offline uncorrectable sectors
Sep 10 21:32:04 cloudcephosd1026 smart_failure[3055934]: Device: /dev/sde [SAT], 656 Offline uncorrectable sectors
Sep 10 21:32:04 cloudcephosd1026 smart_failure[3055953]: Device: /dev/sdg [SAT], 2040 Offline uncorrectable sectors
Sep 10 23:02:04 cloudcephosd1026 smart_failure[3089950]: Device: /dev/sdc [SAT], 1184 Offline uncorrectable sectors
Sep 11 00:02:04 cloudcephosd1026 smart_failure[3112777]: Device: /dev/sdj [SAT], 992 Offline uncorrectable sectors
Sep 11 12:02:04 cloudcephosd1026 smart_failure[3385414]: Device: /dev/sdi [SAT], 1800 Offline uncorrectable sectors
Sep 11 17:02:04 cloudcephosd1026 smart_failure[3498209]: Device: /dev/sdh [SAT], 848 Offline uncorrectable sectors
Sep 11 18:32:04 cloudcephosd1026 smart_failure[3532410]: Device: /dev/sdd [SAT], 1336 Offline uncorrectable sectors
Sep 11 19:32:04 cloudcephosd1026 smart_failure[3555301]: Device: /dev/sdf [SAT], 664 Offline uncorrectable sectors
Sep 11 21:32:04 cloudcephosd1026 smart_failure[3601044]: Device: /dev/sde [SAT], 656 Offline uncorrectable sectors
Sep 11 21:32:04 cloudcephosd1026 smart_failure[3601063]: Device: /dev/sdg [SAT], 2048 Offline uncorrectable sectors
Sep 11 23:02:04 cloudcephosd1026 smart_failure[3635143]: Device: /dev/sdc [SAT], 1192 Offline uncorrectable sectors
Sep 12 00:02:04 cloudcephosd1026 smart_failure[3658086]: Device: /dev/sdj [SAT], 992 Offline uncorrectable sectors
Sep 12 12:02:04 cloudcephosd1026 smart_failure[3929875]: Device: /dev/sdi [SAT], 1832 Offline uncorrectable sectors
Sep 12 17:02:04 cloudcephosd1026 smart_failure[4042508]: Device: /dev/sdh [SAT], 848 Offline uncorrectable sectors
Sep 12 18:32:04 cloudcephosd1026 smart_failure[4076610]: Device: /dev/sdd [SAT], 1336 Offline uncorrectable sectors
Sep 12 19:32:04 cloudcephosd1026 smart_failure[4099200]: Device: /dev/sdf [SAT], 664 Offline uncorrectable sectors
Sep 12 21:32:04 cloudcephosd1026 smart_failure[4144399]: Device: /dev/sde [SAT], 656 Offline uncorrectable sectors
Sep 12 21:32:04 cloudcephosd1026 smart_failure[4144418]: Device: /dev/sdg [SAT], 2048 Offline uncorrectable sectors
Sep 12 23:02:04 cloudcephosd1026 smart_failure[4178371]: Device: /dev/sdc [SAT], 1192 Offline uncorrectable sectors
Sep 13 00:02:04 cloudcephosd1026 smart_failure[7372]: Device: /dev/sdj [SAT], 992 Offline uncorrectable sectors
Sep 13 12:02:04 cloudcephosd1026 smart_failure[278784]: Device: /dev/sdi [SAT], 1848 Offline uncorrectable sectors
Sep 13 17:02:04 cloudcephosd1026 smart_failure[391768]: Device: /dev/sdh [SAT], 848 Offline uncorrectable sectors
Sep 13 18:32:04 cloudcephosd1026 smart_failure[425783]: Device: /dev/sdd [SAT], 1336 Offline uncorrectable sectors
Sep 13 19:32:04 cloudcephosd1026 smart_failure[448512]: Device: /dev/sdf [SAT], 664 Offline uncorrectable sectors
Sep 13 21:32:04 cloudcephosd1026 smart_failure[494119]: Device: /dev/sde [SAT], 656 Offline uncorrectable sectors
Sep 13 21:32:04 cloudcephosd1026 smart_failure[494138]: Device: /dev/sdg [SAT], 2048 Offline uncorrectable sectors
Sep 13 23:02:04 cloudcephosd1026 smart_failure[527613]: Device: /dev/sdc [SAT], 1200 Offline uncorrectable sectors
Sep 14 00:02:04 cloudcephosd1026 smart_failure[550294]: Device: /dev/sdj [SAT], 1000 Offline uncorrectable sectors
Sep 14 12:02:04 cloudcephosd1026 smart_failure[821083]: Device: /dev/sdi [SAT], 1872 Offline uncorrectable sectors
Sep 14 17:02:04 cloudcephosd1026 smart_failure[933566]: Device: /dev/sdh [SAT], 848 Offline uncorrectable sectors
Sep 14 18:32:04 cloudcephosd1026 smart_failure[967652]: Device: /dev/sdd [SAT], 1336 Offline uncorrectable sectors
Sep 14 19:32:04 cloudcephosd1026 smart_failure[990614]: Device: /dev/sdf [SAT], 664 Offline uncorrectable sectors
Sep 14 21:32:04 cloudcephosd1026 smart_failure[1036191]: Device: /dev/sde [SAT], 656 Offline uncorrectable sectors
Sep 14 21:32:04 cloudcephosd1026 smart_failure[1036210]: Device: /dev/sdg [SAT], 2048 Offline uncorrectable sectors
Sep 14 23:02:04 cloudcephosd1026 smart_failure[1069694]: Device: /dev/sdc [SAT], 1200 Offline uncorrectable sectors
Sep 15 00:02:04 cloudcephosd1026 smart_failure[1092061]: Device: /dev/sdj [SAT], 1000 Offline uncorrectable sectors
Sep 15 12:02:04 cloudcephosd1026 smart_failure[1364230]: Device: /dev/sdi [SAT], 1872 Offline uncorrectable sectors
Sep 15 17:02:04 cloudcephosd1026 smart_failure[1477248]: Device: /dev/sdh [SAT], 848 Offline uncorrectable sectors
Sep 15 18:32:04 cloudcephosd1026 smart_failure[1511667]: Device: /dev/sdd [SAT], 1336 Offline uncorrectable sectors
Sep 15 19:32:04 cloudcephosd1026 smart_failure[1534373]: Device: /dev/sdf [SAT], 664 Offline uncorrectable sectors
Sep 15 21:32:04 cloudcephosd1026 smart_failure[1579995]: Device: /dev/sde [SAT], 656 Offline uncorrectable sectors
Sep 15 21:32:04 cloudcephosd1026 smart_failure[1580014]: Device: /dev/sdg [SAT], 2056 Offline uncorrectable sectors
Sep 15 23:02:04 cloudcephosd1026 smart_failure[1614127]: Device: /dev/sdc [SAT], 1200 Offline uncorrectable sectors
Sep 16 00:02:04 cloudcephosd1026 smart_failure[1637048]: Device: /dev/sdj [SAT], 1008 Offline uncorrectable sectors
Sep 16 12:02:04 cloudcephosd1026 smart_failure[1910555]: Device: /dev/sdi [SAT], 1872 Offline uncorrectable sectors
Sep 16 17:02:04 cloudcephosd1026 smart_failure[2023880]: Device: /dev/sdh [SAT], 848 Offline uncorrectable sectors
Sep 16 18:32:04 cloudcephosd1026 smart_failure[2058187]: Device: /dev/sdd [SAT], 1344 Offline uncorrectable sectors
Sep 16 19:32:04 cloudcephosd1026 smart_failure[2080754]: Device: /dev/sdf [SAT], 664 Offline uncorrectable sectors
Sep 16 21:32:04 cloudcephosd1026 smart_failure[2126347]: Device: /dev/sde [SAT], 664 Offline uncorrectable sectors
Sep 16 21:32:04 cloudcephosd1026 smart_failure[2126366]: Device: /dev/sdg [SAT], 2064 Offline uncorrectable sectors
Sep 16 23:02:04 cloudcephosd1026 smart_failure[2160419]: Device: /dev/sdc [SAT], 1200 Offline uncorrectable sectors
Sep 17 00:02:04 cloudcephosd1026 smart_failure[2183283]: Device: /dev/sdj [SAT], 1008 Offline uncorrectable sectors
Sep 17 12:02:04 cloudcephosd1026 smart_failure[2455735]: Device: /dev/sdi [SAT], 1912 Offline uncorrectable sectors
Sep 17 17:02:04 cloudcephosd1026 smart_failure[2569082]: Device: /dev/sdh [SAT], 856 Offline uncorrectable sectors
Sep 17 18:32:04 cloudcephosd1026 smart_failure[2603094]: Device: /dev/sdd [SAT], 1344 Offline uncorrectable sectors
Sep 17 19:32:04 cloudcephosd1026 smart_failure[2625890]: Device: /dev/sdf [SAT], 664 Offline uncorrectable sectors
Sep 17 21:32:04 cloudcephosd1026 smart_failure[2671404]: Device: /dev/sde [SAT], 664 Offline uncorrectable sectors
Sep 17 21:32:04 cloudcephosd1026 smart_failure[2671423]: Device: /dev/sdg [SAT], 2064 Offline uncorrectable sectors
Sep 17 23:02:04 cloudcephosd1026 smart_failure[2705488]: Device: /dev/sdc [SAT], 1216 Offline uncorrectable sectors
Sep 18 00:02:04 cloudcephosd1026 smart_failure[2728375]: Device: /dev/sdj [SAT], 1008 Offline uncorrectable sectors
Sep 18 12:02:04 cloudcephosd1026 smart_failure[3000582]: Device: /dev/sdi [SAT], 1912 Offline uncorrectable sectors
Sep 18 17:02:04 cloudcephosd1026 smart_failure[3113015]: Device: /dev/sdh [SAT], 856 Offline uncorrectable sectors
Sep 18 18:32:04 cloudcephosd1026 smart_failure[3146934]: Device: /dev/sdd [SAT], 1344 Offline uncorrectable sectors
Sep 18 19:32:04 cloudcephosd1026 smart_failure[3169618]: Device: /dev/sdf [SAT], 664 Offline uncorrectable sectors
Sep 18 21:32:04 cloudcephosd1026 smart_failure[3214767]: Device: /dev/sde [SAT], 672 Offline uncorrectable sectors
Sep 18 21:32:04 cloudcephosd1026 smart_failure[3214786]: Device: /dev/sdg [SAT], 2064 Offline uncorrectable sectors
Sep 18 23:02:04 cloudcephosd1026 smart_failure[3248551]: Device: /dev/sdc [SAT], 1216 Offline uncorrectable sectors
Sep 19 00:02:04 cloudcephosd1026 smart_failure[3271329]: Device: /dev/sdj [SAT], 1008 Offline uncorrectable sectors
Sep 19 12:02:04 cloudcephosd1026 smart_failure[3543275]: Device: /dev/sdi [SAT], 1912 Offline uncorrectable sectors
Sep 19 17:02:04 cloudcephosd1026 smart_failure[3656719]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Sep 19 18:32:04 cloudcephosd1026 smart_failure[3691186]: Device: /dev/sdd [SAT], 1344 Offline uncorrectable sectors
Sep 19 19:32:04 cloudcephosd1026 smart_failure[3714156]: Device: /dev/sdf [SAT], 672 Offline uncorrectable sectors
Sep 19 21:32:04 cloudcephosd1026 smart_failure[3760011]: Device: /dev/sde [SAT], 672 Offline uncorrectable sectors
Sep 19 21:32:04 cloudcephosd1026 smart_failure[3760030]: Device: /dev/sdg [SAT], 2064 Offline uncorrectable sectors
Sep 19 23:02:04 cloudcephosd1026 smart_failure[3794487]: Device: /dev/sdc [SAT], 1224 Offline uncorrectable sectors (changed +8)
Sep 20 00:02:04 cloudcephosd1026 smart_failure[3816958]: Device: /dev/sdj [SAT], 1008 Offline uncorrectable sectors
Sep 20 12:02:04 cloudcephosd1026 smart_failure[4088273]: Device: /dev/sdi [SAT], 1912 Offline uncorrectable sectors
Sep 20 17:02:04 cloudcephosd1026 smart_failure[7259]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Sep 20 18:32:04 cloudcephosd1026 smart_failure[41262]: Device: /dev/sdd [SAT], 1344 Offline uncorrectable sectors
Sep 20 19:32:04 cloudcephosd1026 smart_failure[63748]: Device: /dev/sdf [SAT], 680 Offline uncorrectable sectors
Sep 20 21:32:04 cloudcephosd1026 smart_failure[109084]: Device: /dev/sde [SAT], 672 Offline uncorrectable sectors
Sep 20 21:32:04 cloudcephosd1026 smart_failure[109103]: Device: /dev/sdg [SAT], 2072 Offline uncorrectable sectors
Sep 20 23:02:04 cloudcephosd1026 smart_failure[143051]: Device: /dev/sdc [SAT], 1224 Offline uncorrectable sectors
Sep 21 00:02:04 cloudcephosd1026 smart_failure[165710]: Device: /dev/sdj [SAT], 1008 Offline uncorrectable sectors
Sep 21 12:02:04 cloudcephosd1026 smart_failure[436621]: Device: /dev/sdi [SAT], 1920 Offline uncorrectable sectors
Sep 21 17:02:04 cloudcephosd1026 smart_failure[549605]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Sep 21 18:32:04 cloudcephosd1026 smart_failure[583461]: Device: /dev/sdd [SAT], 1344 Offline uncorrectable sectors
Sep 21 19:32:04 cloudcephosd1026 smart_failure[606211]: Device: /dev/sdf [SAT], 680 Offline uncorrectable sectors
Sep 21 21:32:04 cloudcephosd1026 smart_failure[651302]: Device: /dev/sde [SAT], 672 Offline uncorrectable sectors
Sep 21 21:32:04 cloudcephosd1026 smart_failure[651321]: Device: /dev/sdg [SAT], 2072 Offline uncorrectable sectors
Sep 21 23:02:04 cloudcephosd1026 smart_failure[685198]: Device: /dev/sdc [SAT], 1232 Offline uncorrectable sectors
Sep 22 00:02:04 cloudcephosd1026 smart_failure[707712]: Device: /dev/sdj [SAT], 1016 Offline uncorrectable sectors
Sep 22 12:02:04 cloudcephosd1026 smart_failure[978502]: Device: /dev/sdi [SAT], 1920 Offline uncorrectable sectors
Sep 22 17:02:04 cloudcephosd1026 smart_failure[1091192]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Sep 22 18:32:04 cloudcephosd1026 smart_failure[1125204]: Device: /dev/sdd [SAT], 1344 Offline uncorrectable sectors
Sep 22 19:32:05 cloudcephosd1026 smart_failure[1147445]: Device: /dev/sdf [SAT], 680 Offline uncorrectable sectors
Sep 22 21:32:04 cloudcephosd1026 smart_failure[1192430]: Device: /dev/sde [SAT], 672 Offline uncorrectable sectors
Sep 22 21:32:04 cloudcephosd1026 smart_failure[1192449]: Device: /dev/sdg [SAT], 2072 Offline uncorrectable sectors
Sep 22 23:02:04 cloudcephosd1026 smart_failure[1225879]: Device: /dev/sdc [SAT], 1232 Offline uncorrectable sectors
Sep 23 00:02:04 cloudcephosd1026 smart_failure[1248231]: Device: /dev/sdj [SAT], 1016 Offline uncorrectable sectors
Sep 23 12:02:04 cloudcephosd1026 smart_failure[1518780]: Device: /dev/sdi [SAT], 1920 Offline uncorrectable sectors
Sep 23 17:02:04 cloudcephosd1026 smart_failure[1631481]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Sep 23 18:32:04 cloudcephosd1026 smart_failure[1665701]: Device: /dev/sdd [SAT], 1344 Offline uncorrectable sectors
Sep 23 20:02:04 cloudcephosd1026 smart_failure[1699333]: Device: /dev/sdf [SAT], 680 Offline uncorrectable sectors
Sep 23 21:32:04 cloudcephosd1026 smart_failure[1733197]: Device: /dev/sde [SAT], 680 Offline uncorrectable sectors
Sep 23 21:32:04 cloudcephosd1026 smart_failure[1733216]: Device: /dev/sdg [SAT], 2112 Offline uncorrectable sectors
Sep 23 23:02:04 cloudcephosd1026 smart_failure[1766549]: Device: /dev/sdc [SAT], 1232 Offline uncorrectable sectors
Sep 24 00:02:04 cloudcephosd1026 smart_failure[1789062]: Device: /dev/sdj [SAT], 1048 Offline uncorrectable sectors
Sep 24 12:02:04 cloudcephosd1026 smart_failure[2059678]: Device: /dev/sdi [SAT], 1928 Offline uncorrectable sectors
Sep 24 17:02:04 cloudcephosd1026 smart_failure[2172095]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Sep 24 18:32:04 cloudcephosd1026 smart_failure[2206135]: Device: /dev/sdd [SAT], 1344 Offline uncorrectable sectors
Sep 24 20:02:05 cloudcephosd1026 smart_failure[2239502]: Device: /dev/sdf [SAT], 680 Offline uncorrectable sectors
Sep 24 21:32:04 cloudcephosd1026 smart_failure[2273403]: Device: /dev/sde [SAT], 680 Offline uncorrectable sectors
Sep 24 21:32:04 cloudcephosd1026 smart_failure[2273422]: Device: /dev/sdg [SAT], 2120 Offline uncorrectable sectors
Sep 24 23:02:04 cloudcephosd1026 smart_failure[2307342]: Device: /dev/sdc [SAT], 1232 Offline uncorrectable sectors
Sep 25 00:02:04 cloudcephosd1026 smart_failure[2330340]: Device: /dev/sdj [SAT], 1064 Offline uncorrectable sectors
Sep 25 12:02:05 cloudcephosd1026 smart_failure[2600423]: Device: /dev/sdi [SAT], 1936 Offline uncorrectable sectors
Sep 25 17:02:04 cloudcephosd1026 smart_failure[2713350]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Sep 25 18:32:04 cloudcephosd1026 smart_failure[2747654]: Device: /dev/sdd [SAT], 1344 Offline uncorrectable sectors
Sep 25 20:32:04 cloudcephosd1026 smart_failure[2793040]: Device: /dev/sdf [SAT], 680 Offline uncorrectable sectors
Sep 25 21:32:04 cloudcephosd1026 smart_failure[2815867]: Device: /dev/sde [SAT], 680 Offline uncorrectable sectors
Sep 25 21:32:04 cloudcephosd1026 smart_failure[2815886]: Device: /dev/sdg [SAT], 2128 Offline uncorrectable sectors
Sep 25 23:02:04 cloudcephosd1026 smart_failure[2849737]: Device: /dev/sdc [SAT], 1240 Offline uncorrectable sectors
Sep 26 00:02:04 cloudcephosd1026 smart_failure[2872600]: Device: /dev/sdj [SAT], 1072 Offline uncorrectable sectors
Sep 26 12:02:04 cloudcephosd1026 smart_failure[3145377]: Device: /dev/sdi [SAT], 1944 Offline uncorrectable sectors
Sep 26 17:02:04 cloudcephosd1026 smart_failure[3258350]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Sep 26 18:32:04 cloudcephosd1026 smart_failure[3292473]: Device: /dev/sdd [SAT], 1344 Offline uncorrectable sectors
Sep 26 20:32:05 cloudcephosd1026 smart_failure[3337817]: Device: /dev/sdf [SAT], 680 Offline uncorrectable sectors
Sep 26 21:32:04 cloudcephosd1026 smart_failure[3360821]: Device: /dev/sde [SAT], 688 Offline uncorrectable sectors
Sep 26 21:32:04 cloudcephosd1026 smart_failure[3360840]: Device: /dev/sdg [SAT], 2144 Offline uncorrectable sectors
Sep 26 23:02:04 cloudcephosd1026 smart_failure[3394849]: Device: /dev/sdc [SAT], 1248 Offline uncorrectable sectors
Sep 27 00:02:04 cloudcephosd1026 smart_failure[3417580]: Device: /dev/sdj [SAT], 1080 Offline uncorrectable sectors
Sep 27 12:02:04 cloudcephosd1026 smart_failure[3687790]: Device: /dev/sdi [SAT], 1960 Offline uncorrectable sectors (changed +16)
Sep 27 17:02:04 cloudcephosd1026 smart_failure[3800417]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Sep 27 18:32:04 cloudcephosd1026 smart_failure[3834489]: Device: /dev/sdd [SAT], 1344 Offline uncorrectable sectors
Sep 27 20:32:04 cloudcephosd1026 smart_failure[3879287]: Device: /dev/sdf [SAT], 680 Offline uncorrectable sectors
Sep 27 21:32:04 cloudcephosd1026 smart_failure[3901693]: Device: /dev/sde [SAT], 688 Offline uncorrectable sectors
Sep 27 21:32:04 cloudcephosd1026 smart_failure[3901712]: Device: /dev/sdg [SAT], 2152 Offline uncorrectable sectors
Sep 27 23:02:04 cloudcephosd1026 smart_failure[3935629]: Device: /dev/sdc [SAT], 1256 Offline uncorrectable sectors
Sep 28 00:02:04 cloudcephosd1026 smart_failure[3958290]: Device: /dev/sdj [SAT], 1080 Offline uncorrectable sectors
Sep 28 12:02:04 cloudcephosd1026 smart_failure[35838]: Device: /dev/sdi [SAT], 1968 Offline uncorrectable sectors
Sep 28 17:02:04 cloudcephosd1026 smart_failure[147723]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Sep 28 18:32:04 cloudcephosd1026 smart_failure[181863]: Device: /dev/sdd [SAT], 1344 Offline uncorrectable sectors
Sep 28 20:32:04 cloudcephosd1026 smart_failure[226866]: Device: /dev/sdf [SAT], 680 Offline uncorrectable sectors
Sep 28 21:32:05 cloudcephosd1026 smart_failure[249269]: Device: /dev/sde [SAT], 704 Offline uncorrectable sectors
Sep 28 21:32:05 cloudcephosd1026 smart_failure[249288]: Device: /dev/sdg [SAT], 2160 Offline uncorrectable sectors
Sep 28 23:02:04 cloudcephosd1026 smart_failure[283232]: Device: /dev/sdc [SAT], 1264 Offline uncorrectable sectors
Sep 29 00:02:04 cloudcephosd1026 smart_failure[305975]: Device: /dev/sdj [SAT], 1080 Offline uncorrectable sectors
Sep 29 12:02:04 cloudcephosd1026 smart_failure[577359]: Device: /dev/sdi [SAT], 1976 Offline uncorrectable sectors
Sep 29 17:02:04 cloudcephosd1026 smart_failure[690453]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Sep 29 18:32:04 cloudcephosd1026 smart_failure[724601]: Device: /dev/sdd [SAT], 1368 Offline uncorrectable sectors
Sep 29 20:32:04 cloudcephosd1026 smart_failure[769913]: Device: /dev/sdf [SAT], 688 Offline uncorrectable sectors
Sep 29 22:02:04 cloudcephosd1026 smart_failure[803999]: Device: /dev/sde [SAT], 704 Offline uncorrectable sectors
Sep 29 22:02:04 cloudcephosd1026 smart_failure[804018]: Device: /dev/sdg [SAT], 2160 Offline uncorrectable sectors
Sep 29 23:02:04 cloudcephosd1026 smart_failure[826593]: Device: /dev/sdc [SAT], 1264 Offline uncorrectable sectors
Sep 30 00:02:04 cloudcephosd1026 smart_failure[849259]: Device: /dev/sdj [SAT], 1080 Offline uncorrectable sectors
Sep 30 12:02:04 cloudcephosd1026 smart_failure[1121896]: Device: /dev/sdi [SAT], 1984 Offline uncorrectable sectors
Sep 30 17:02:04 cloudcephosd1026 smart_failure[1235424]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Sep 30 18:32:04 cloudcephosd1026 smart_failure[1269472]: Device: /dev/sdd [SAT], 1368 Offline uncorrectable sectors
Sep 30 20:32:04 cloudcephosd1026 smart_failure[1315083]: Device: /dev/sdf [SAT], 688 Offline uncorrectable sectors
Sep 30 22:02:04 cloudcephosd1026 smart_failure[1349052]: Device: /dev/sde [SAT], 704 Offline uncorrectable sectors
Sep 30 22:02:04 cloudcephosd1026 smart_failure[1349071]: Device: /dev/sdg [SAT], 2160 Offline uncorrectable sectors
Sep 30 23:02:04 cloudcephosd1026 smart_failure[1371828]: Device: /dev/sdc [SAT], 1272 Offline uncorrectable sectors
===== NODE GROUP =====
(1) cloudcephosd1034.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 01 00:57:02 cloudcephosd1034 smart_failure[1437351]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Oct 01 01:27:03 cloudcephosd1034 smart_failure[1448698]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Oct 01 08:57:02 cloudcephosd1034 smart_failure[1619401]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Oct 01 10:57:02 cloudcephosd1034 smart_failure[1664812]: Device: /dev/sde [SAT], 1024 Offline uncorrectable sectors
Oct 01 11:57:02 cloudcephosd1034 smart_failure[1687596]: Device: /dev/sdf [SAT], 704 Offline uncorrectable sectors
Oct 01 11:57:02 cloudcephosd1034 smart_failure[1687615]: Device: /dev/sdi [SAT], 520 Offline uncorrectable sectors
Oct 01 16:57:02 cloudcephosd1034 smart_failure[1800886]: Device: /dev/sdc [SAT], 2640 Offline uncorrectable sectors
Oct 02 00:57:02 cloudcephosd1034 smart_failure[1981745]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Oct 02 01:57:02 cloudcephosd1034 smart_failure[2004347]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Oct 02 08:57:02 cloudcephosd1034 smart_failure[2163338]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Oct 02 10:57:02 cloudcephosd1034 smart_failure[2208102]: Device: /dev/sde [SAT], 1024 Offline uncorrectable sectors
Oct 02 11:57:02 cloudcephosd1034 smart_failure[2230942]: Device: /dev/sdf [SAT], 704 Offline uncorrectable sectors
Oct 02 11:57:02 cloudcephosd1034 smart_failure[2230961]: Device: /dev/sdi [SAT], 520 Offline uncorrectable sectors
Oct 02 16:57:02 cloudcephosd1034 smart_failure[2343752]: Device: /dev/sdc [SAT], 2656 Offline uncorrectable sectors
Oct 03 00:57:02 cloudcephosd1034 smart_failure[2517317]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Oct 03 01:57:02 cloudcephosd1034 smart_failure[2538830]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Oct 03 08:57:02 cloudcephosd1034 smart_failure[2697458]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Oct 03 10:57:02 cloudcephosd1034 smart_failure[2742954]: Device: /dev/sde [SAT], 1024 Offline uncorrectable sectors
Oct 03 11:57:02 cloudcephosd1034 smart_failure[2765321]: Device: /dev/sdf [SAT], 712 Offline uncorrectable sectors
Oct 03 11:57:02 cloudcephosd1034 smart_failure[2765340]: Device: /dev/sdi [SAT], 520 Offline uncorrectable sectors
Oct 03 16:57:02 cloudcephosd1034 smart_failure[2878246]: Device: /dev/sdc [SAT], 2664 Offline uncorrectable sectors
Oct 04 00:57:02 cloudcephosd1034 smart_failure[3059164]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Oct 04 01:57:02 cloudcephosd1034 smart_failure[3081956]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Oct 04 08:57:02 cloudcephosd1034 smart_failure[3241181]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Oct 04 10:57:02 cloudcephosd1034 smart_failure[3286259]: Device: /dev/sde [SAT], 1024 Offline uncorrectable sectors
Oct 04 11:57:02 cloudcephosd1034 smart_failure[3309058]: Device: /dev/sdf [SAT], 712 Offline uncorrectable sectors
Oct 04 11:57:02 cloudcephosd1034 smart_failure[3309106]: Device: /dev/sdi [SAT], 520 Offline uncorrectable sectors
Oct 04 16:57:02 cloudcephosd1034 smart_failure[3423609]: Device: /dev/sdc [SAT], 2664 Offline uncorrectable sectors
Oct 05 00:57:02 cloudcephosd1034 smart_failure[3604013]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Oct 05 01:57:02 cloudcephosd1034 smart_failure[3626619]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Oct 05 08:57:02 cloudcephosd1034 smart_failure[3784215]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Oct 05 10:57:02 cloudcephosd1034 smart_failure[3829658]: Device: /dev/sde [SAT], 1024 Offline uncorrectable sectors
Oct 05 11:57:02 cloudcephosd1034 smart_failure[3852216]: Device: /dev/sdf [SAT], 712 Offline uncorrectable sectors
Oct 05 11:57:02 cloudcephosd1034 smart_failure[3852235]: Device: /dev/sdi [SAT], 520 Offline uncorrectable sectors
Oct 05 16:57:02 cloudcephosd1034 smart_failure[3976565]: Device: /dev/sdc [SAT], 2672 Offline uncorrectable sectors
Oct 06 00:57:02 cloudcephosd1034 smart_failure[4158342]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Oct 06 01:57:02 cloudcephosd1034 smart_failure[4180737]: Device: /dev/sdj [SAT], 480 Offline uncorrectable sectors
Oct 06 08:57:02 cloudcephosd1034 smart_failure[144364]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Oct 06 10:57:02 cloudcephosd1034 smart_failure[189190]: Device: /dev/sde [SAT], 1024 Offline uncorrectable sectors
Oct 06 11:57:02 cloudcephosd1034 smart_failure[211762]: Device: /dev/sdf [SAT], 712 Offline uncorrectable sectors
Oct 06 11:57:02 cloudcephosd1034 smart_failure[211781]: Device: /dev/sdi [SAT], 520 Offline uncorrectable sectors
Oct 06 16:57:02 cloudcephosd1034 smart_failure[324591]: Device: /dev/sdc [SAT], 2688 Offline uncorrectable sectors
Oct 07 00:57:02 cloudcephosd1034 smart_failure[505819]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Oct 07 01:57:02 cloudcephosd1034 smart_failure[528340]: Device: /dev/sdj [SAT], 488 Offline uncorrectable sectors
Oct 07 08:57:02 cloudcephosd1034 smart_failure[686447]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Oct 07 10:57:02 cloudcephosd1034 smart_failure[731787]: Device: /dev/sde [SAT], 1024 Offline uncorrectable sectors
Oct 07 11:57:02 cloudcephosd1034 smart_failure[754465]: Device: /dev/sdf [SAT], 712 Offline uncorrectable sectors
Oct 07 11:57:02 cloudcephosd1034 smart_failure[754484]: Device: /dev/sdi [SAT], 520 Offline uncorrectable sectors
Oct 07 16:57:02 cloudcephosd1034 smart_failure[867585]: Device: /dev/sdc [SAT], 2696 Offline uncorrectable sectors
Oct 08 00:57:02 cloudcephosd1034 smart_failure[1048518]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Oct 08 01:57:02 cloudcephosd1034 smart_failure[1071474]: Device: /dev/sdj [SAT], 488 Offline uncorrectable sectors
Oct 08 08:57:02 cloudcephosd1034 smart_failure[1229981]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Oct 08 10:57:02 cloudcephosd1034 smart_failure[1275265]: Device: /dev/sde [SAT], 1032 Offline uncorrectable sectors
Oct 08 11:57:02 cloudcephosd1034 smart_failure[1297599]: Device: /dev/sdf [SAT], 720 Offline uncorrectable sectors
Oct 08 11:57:02 cloudcephosd1034 smart_failure[1297618]: Device: /dev/sdi [SAT], 520 Offline uncorrectable sectors
Oct 08 16:57:02 cloudcephosd1034 smart_failure[1410693]: Device: /dev/sdc [SAT], 2728 Offline uncorrectable sectors
Oct 09 00:57:02 cloudcephosd1034 smart_failure[1591946]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Oct 09 01:57:02 cloudcephosd1034 smart_failure[1614769]: Device: /dev/sdj [SAT], 488 Offline uncorrectable sectors
Oct 09 08:57:02 cloudcephosd1034 smart_failure[1772588]: Device: /dev/sdd [SAT], 320 Offline uncorrectable sectors
Oct 09 10:57:02 cloudcephosd1034 smart_failure[1818191]: Device: /dev/sde [SAT], 1032 Offline uncorrectable sectors
Oct 09 11:57:02 cloudcephosd1034 smart_failure[1840908]: Device: /dev/sdf [SAT], 720 Offline uncorrectable sectors
Oct 09 11:57:02 cloudcephosd1034 smart_failure[1840927]: Device: /dev/sdi [SAT], 520 Offline uncorrectable sectors
Oct 09 16:57:02 cloudcephosd1034 smart_failure[1953794]: Device: /dev/sdc [SAT], 2736 Offline uncorrectable sectors
Oct 10 00:57:02 cloudcephosd1034 smart_failure[2135262]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Oct 10 01:57:02 cloudcephosd1034 smart_failure[2157775]: Device: /dev/sdj [SAT], 488 Offline uncorrectable sectors
Oct 10 08:57:02 cloudcephosd1034 smart_failure[2316379]: Device: /dev/sdd [SAT], 320 Offline uncorrectable sectors
Oct 10 10:57:02 cloudcephosd1034 smart_failure[2361817]: Device: /dev/sde [SAT], 1032 Offline uncorrectable sectors
Oct 10 11:57:03 cloudcephosd1034 smart_failure[2384378]: Device: /dev/sdf [SAT], 720 Offline uncorrectable sectors
Oct 10 11:57:03 cloudcephosd1034 smart_failure[2384397]: Device: /dev/sdi [SAT], 520 Offline uncorrectable sectors
Oct 10 16:57:02 cloudcephosd1034 smart_failure[2498855]: Device: /dev/sdc [SAT], 2744 Offline uncorrectable sectors
Oct 11 00:57:02 cloudcephosd1034 smart_failure[2680188]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Oct 11 01:57:02 cloudcephosd1034 smart_failure[2702640]: Device: /dev/sdj [SAT], 488 Offline uncorrectable sectors
Oct 11 08:57:02 cloudcephosd1034 smart_failure[2860686]: Device: /dev/sdd [SAT], 320 Offline uncorrectable sectors
Oct 11 10:57:02 cloudcephosd1034 smart_failure[2906055]: Device: /dev/sde [SAT], 1040 Offline uncorrectable sectors
Oct 11 12:27:02 cloudcephosd1034 smart_failure[2940153]: Device: /dev/sdf [SAT], 720 Offline uncorrectable sectors
Oct 11 12:27:02 cloudcephosd1034 smart_failure[2940172]: Device: /dev/sdi [SAT], 520 Offline uncorrectable sectors
Sep 14 10:57:02 cloudcephosd1034 smart_failure[814509]: Device: /dev/sde [SAT], 976 Offline uncorrectable sectors
Sep 14 11:27:02 cloudcephosd1034 smart_failure[825923]: Device: /dev/sdf [SAT], 672 Offline uncorrectable sectors
Sep 14 11:27:02 cloudcephosd1034 smart_failure[825942]: Device: /dev/sdi [SAT], 488 Offline uncorrectable sectors
Sep 14 16:27:03 cloudcephosd1034 smart_failure[938747]: Device: /dev/sdc [SAT], 2424 Offline uncorrectable sectors
Sep 15 00:57:02 cloudcephosd1034 smart_failure[1130657]: Device: /dev/sdg [SAT], 1096 Offline uncorrectable sectors
Sep 15 00:57:02 cloudcephosd1034 smart_failure[1130676]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 15 08:57:02 cloudcephosd1034 smart_failure[1312030]: Device: /dev/sdd [SAT], 304 Offline uncorrectable sectors
Sep 15 10:57:02 cloudcephosd1034 smart_failure[1357654]: Device: /dev/sde [SAT], 976 Offline uncorrectable sectors
Sep 15 11:27:02 cloudcephosd1034 smart_failure[1369182]: Device: /dev/sdf [SAT], 672 Offline uncorrectable sectors
Sep 15 11:27:02 cloudcephosd1034 smart_failure[1369201]: Device: /dev/sdi [SAT], 488 Offline uncorrectable sectors
Sep 15 16:27:02 cloudcephosd1034 smart_failure[1482858]: Device: /dev/sdc [SAT], 2424 Offline uncorrectable sectors
Sep 16 00:57:02 cloudcephosd1034 smart_failure[1677199]: Device: /dev/sdg [SAT], 1096 Offline uncorrectable sectors
Sep 16 00:57:02 cloudcephosd1034 smart_failure[1677218]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 16 08:57:02 cloudcephosd1034 smart_failure[1859117]: Device: /dev/sdd [SAT], 304 Offline uncorrectable sectors
Sep 16 10:57:02 cloudcephosd1034 smart_failure[1904785]: Device: /dev/sde [SAT], 976 Offline uncorrectable sectors
Sep 16 11:27:02 cloudcephosd1034 smart_failure[1916269]: Device: /dev/sdf [SAT], 672 Offline uncorrectable sectors
Sep 16 11:27:02 cloudcephosd1034 smart_failure[1916288]: Device: /dev/sdi [SAT], 488 Offline uncorrectable sectors
Sep 16 16:27:02 cloudcephosd1034 smart_failure[2029508]: Device: /dev/sdc [SAT], 2432 Offline uncorrectable sectors
Sep 17 00:57:02 cloudcephosd1034 smart_failure[2222877]: Device: /dev/sdg [SAT], 1096 Offline uncorrectable sectors
Sep 17 00:57:02 cloudcephosd1034 smart_failure[2222897]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 17 08:57:02 cloudcephosd1034 smart_failure[2404987]: Device: /dev/sdd [SAT], 304 Offline uncorrectable sectors
Sep 17 10:57:02 cloudcephosd1034 smart_failure[2450350]: Device: /dev/sde [SAT], 984 Offline uncorrectable sectors
Sep 17 11:27:02 cloudcephosd1034 smart_failure[2461487]: Device: /dev/sdf [SAT], 672 Offline uncorrectable sectors
Sep 17 11:27:02 cloudcephosd1034 smart_failure[2461539]: Device: /dev/sdi [SAT], 488 Offline uncorrectable sectors
Sep 17 16:27:02 cloudcephosd1034 smart_failure[2575071]: Device: /dev/sdc [SAT], 2448 Offline uncorrectable sectors
Sep 18 00:57:02 cloudcephosd1034 smart_failure[2768525]: Device: /dev/sdg [SAT], 1096 Offline uncorrectable sectors
Sep 18 00:57:02 cloudcephosd1034 smart_failure[2768544]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 18 08:57:02 cloudcephosd1034 smart_failure[2949739]: Device: /dev/sdd [SAT], 304 Offline uncorrectable sectors
Sep 18 10:57:02 cloudcephosd1034 smart_failure[2994415]: Device: /dev/sde [SAT], 984 Offline uncorrectable sectors
Sep 18 11:27:02 cloudcephosd1034 smart_failure[3005889]: Device: /dev/sdf [SAT], 672 Offline uncorrectable sectors
Sep 18 11:27:02 cloudcephosd1034 smart_failure[3005908]: Device: /dev/sdi [SAT], 488 Offline uncorrectable sectors
Sep 18 16:27:02 cloudcephosd1034 smart_failure[3118473]: Device: /dev/sdc [SAT], 2456 Offline uncorrectable sectors
Sep 19 00:57:02 cloudcephosd1034 smart_failure[3310813]: Device: /dev/sdg [SAT], 1096 Offline uncorrectable sectors
Sep 19 00:57:02 cloudcephosd1034 smart_failure[3310863]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 19 08:57:02 cloudcephosd1034 smart_failure[3492430]: Device: /dev/sdd [SAT], 304 Offline uncorrectable sectors
Sep 19 10:57:02 cloudcephosd1034 smart_failure[3537574]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Sep 19 11:27:03 cloudcephosd1034 smart_failure[3549035]: Device: /dev/sdf [SAT], 672 Offline uncorrectable sectors
Sep 19 11:27:03 cloudcephosd1034 smart_failure[3549054]: Device: /dev/sdi [SAT], 488 Offline uncorrectable sectors
Sep 19 16:27:02 cloudcephosd1034 smart_failure[3662581]: Device: /dev/sdc [SAT], 2464 Offline uncorrectable sectors
Sep 20 00:57:02 cloudcephosd1034 smart_failure[3857022]: Device: /dev/sdg [SAT], 1104 Offline uncorrectable sectors
Sep 20 00:57:02 cloudcephosd1034 smart_failure[3857041]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 20 08:57:02 cloudcephosd1034 smart_failure[4037992]: Device: /dev/sdd [SAT], 304 Offline uncorrectable sectors
Sep 20 10:57:02 cloudcephosd1034 smart_failure[4082848]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Sep 20 11:57:02 cloudcephosd1034 smart_failure[4105585]: Device: /dev/sdf [SAT], 672 Offline uncorrectable sectors
Sep 20 11:57:02 cloudcephosd1034 smart_failure[4105604]: Device: /dev/sdi [SAT], 488 Offline uncorrectable sectors
Sep 20 16:27:02 cloudcephosd1034 smart_failure[13563]: Device: /dev/sdc [SAT], 2464 Offline uncorrectable sectors
Sep 21 00:57:02 cloudcephosd1034 smart_failure[205728]: Device: /dev/sdg [SAT], 1104 Offline uncorrectable sectors
Sep 21 00:57:02 cloudcephosd1034 smart_failure[205777]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 21 08:57:02 cloudcephosd1034 smart_failure[386198]: Device: /dev/sdd [SAT], 304 Offline uncorrectable sectors
Sep 21 10:57:02 cloudcephosd1034 smart_failure[431671]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Sep 21 11:57:02 cloudcephosd1034 smart_failure[454376]: Device: /dev/sdf [SAT], 680 Offline uncorrectable sectors
Sep 21 11:57:02 cloudcephosd1034 smart_failure[454395]: Device: /dev/sdi [SAT], 496 Offline uncorrectable sectors
Sep 21 16:27:02 cloudcephosd1034 smart_failure[556608]: Device: /dev/sdc [SAT], 2480 Offline uncorrectable sectors (changed +8)
Sep 22 00:57:02 cloudcephosd1034 smart_failure[748416]: Device: /dev/sdg [SAT], 1104 Offline uncorrectable sectors
Sep 22 00:57:02 cloudcephosd1034 smart_failure[748437]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 22 08:57:02 cloudcephosd1034 smart_failure[929441]: Device: /dev/sdd [SAT], 304 Offline uncorrectable sectors
Sep 22 10:57:02 cloudcephosd1034 smart_failure[974354]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Sep 22 11:57:02 cloudcephosd1034 smart_failure[996919]: Device: /dev/sdf [SAT], 688 Offline uncorrectable sectors
Sep 22 11:57:02 cloudcephosd1034 smart_failure[996968]: Device: /dev/sdi [SAT], 496 Offline uncorrectable sectors
Sep 22 16:27:02 cloudcephosd1034 smart_failure[1098581]: Device: /dev/sdc [SAT], 2496 Offline uncorrectable sectors
Sep 23 00:57:02 cloudcephosd1034 smart_failure[1288895]: Device: /dev/sdg [SAT], 1104 Offline uncorrectable sectors
Sep 23 00:57:02 cloudcephosd1034 smart_failure[1288944]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 23 08:57:02 cloudcephosd1034 smart_failure[1469200]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Sep 23 10:57:02 cloudcephosd1034 smart_failure[1514551]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Sep 23 11:57:02 cloudcephosd1034 smart_failure[1537175]: Device: /dev/sdf [SAT], 688 Offline uncorrectable sectors
Sep 23 11:57:02 cloudcephosd1034 smart_failure[1537194]: Device: /dev/sdi [SAT], 504 Offline uncorrectable sectors
Sep 23 16:27:02 cloudcephosd1034 smart_failure[1638980]: Device: /dev/sdc [SAT], 2520 Offline uncorrectable sectors
Sep 24 00:57:02 cloudcephosd1034 smart_failure[1830601]: Device: /dev/sdg [SAT], 1104 Offline uncorrectable sectors
Sep 24 00:57:02 cloudcephosd1034 smart_failure[1830620]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 24 08:57:02 cloudcephosd1034 smart_failure[2011186]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Sep 24 10:57:02 cloudcephosd1034 smart_failure[2056050]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Sep 24 11:57:02 cloudcephosd1034 smart_failure[2078362]: Device: /dev/sdf [SAT], 688 Offline uncorrectable sectors
Sep 24 11:57:02 cloudcephosd1034 smart_failure[2078417]: Device: /dev/sdi [SAT], 504 Offline uncorrectable sectors
Sep 24 16:27:02 cloudcephosd1034 smart_failure[2179508]: Device: /dev/sdc [SAT], 2552 Offline uncorrectable sectors
Sep 25 00:57:02 cloudcephosd1034 smart_failure[2370769]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Sep 25 00:57:02 cloudcephosd1034 smart_failure[2370817]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 25 08:57:02 cloudcephosd1034 smart_failure[2550952]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Sep 25 10:57:02 cloudcephosd1034 smart_failure[2596609]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Sep 25 11:57:02 cloudcephosd1034 smart_failure[2619250]: Device: /dev/sdf [SAT], 688 Offline uncorrectable sectors
Sep 25 11:57:02 cloudcephosd1034 smart_failure[2619269]: Device: /dev/sdi [SAT], 504 Offline uncorrectable sectors
Sep 25 16:27:02 cloudcephosd1034 smart_failure[2720500]: Device: /dev/sdc [SAT], 2560 Offline uncorrectable sectors
Sep 26 00:57:02 cloudcephosd1034 smart_failure[2914023]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Sep 26 00:57:02 cloudcephosd1034 smart_failure[2914042]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Sep 26 08:57:02 cloudcephosd1034 smart_failure[3094735]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Sep 26 10:57:02 cloudcephosd1034 smart_failure[3140238]: Device: /dev/sde [SAT], 1000 Offline uncorrectable sectors
Sep 26 11:57:02 cloudcephosd1034 smart_failure[3162879]: Device: /dev/sdf [SAT], 688 Offline uncorrectable sectors
Sep 26 11:57:02 cloudcephosd1034 smart_failure[3162928]: Device: /dev/sdi [SAT], 504 Offline uncorrectable sectors
Sep 26 16:27:02 cloudcephosd1034 smart_failure[3265104]: Device: /dev/sdc [SAT], 2560 Offline uncorrectable sectors
Sep 27 00:57:02 cloudcephosd1034 smart_failure[3457758]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Sep 27 00:57:02 cloudcephosd1034 smart_failure[3457807]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Sep 27 08:57:02 cloudcephosd1034 smart_failure[3637627]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Sep 27 10:57:02 cloudcephosd1034 smart_failure[3682565]: Device: /dev/sde [SAT], 1008 Offline uncorrectable sectors
Sep 27 11:57:02 cloudcephosd1034 smart_failure[3705570]: Device: /dev/sdf [SAT], 696 Offline uncorrectable sectors
Sep 27 11:57:02 cloudcephosd1034 smart_failure[3705589]: Device: /dev/sdi [SAT], 504 Offline uncorrectable sectors
Sep 27 16:27:03 cloudcephosd1034 smart_failure[3806971]: Device: /dev/sdc [SAT], 2584 Offline uncorrectable sectors
Sep 28 00:57:02 cloudcephosd1034 smart_failure[3999874]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Sep 28 00:57:02 cloudcephosd1034 smart_failure[3999893]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Sep 28 08:57:03 cloudcephosd1034 smart_failure[4181115]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Sep 28 10:57:02 cloudcephosd1034 smart_failure[32080]: Device: /dev/sde [SAT], 1008 Offline uncorrectable sectors
Sep 28 11:57:02 cloudcephosd1034 smart_failure[54981]: Device: /dev/sdf [SAT], 696 Offline uncorrectable sectors
Sep 28 11:57:02 cloudcephosd1034 smart_failure[55034]: Device: /dev/sdi [SAT], 512 Offline uncorrectable sectors
Sep 28 16:57:02 cloudcephosd1034 smart_failure[167331]: Device: /dev/sdc [SAT], 2616 Offline uncorrectable sectors
Sep 29 00:57:03 cloudcephosd1034 smart_failure[348374]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Sep 29 00:57:03 cloudcephosd1034 smart_failure[348393]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Sep 29 08:57:02 cloudcephosd1034 smart_failure[529356]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Sep 29 10:57:02 cloudcephosd1034 smart_failure[574466]: Device: /dev/sde [SAT], 1016 Offline uncorrectable sectors
Sep 29 11:57:02 cloudcephosd1034 smart_failure[596929]: Device: /dev/sdf [SAT], 696 Offline uncorrectable sectors
Sep 29 11:57:02 cloudcephosd1034 smart_failure[596948]: Device: /dev/sdi [SAT], 512 Offline uncorrectable sectors
Sep 29 16:57:02 cloudcephosd1034 smart_failure[710163]: Device: /dev/sdc [SAT], 2616 Offline uncorrectable sectors
Sep 30 00:57:02 cloudcephosd1034 smart_failure[891940]: Device: /dev/sdg [SAT], 1120 Offline uncorrectable sectors
Sep 30 01:27:02 cloudcephosd1034 smart_failure[903192]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Sep 30 08:57:02 cloudcephosd1034 smart_failure[1073826]: Device: /dev/sdd [SAT], 312 Offline uncorrectable sectors
Sep 30 10:57:02 cloudcephosd1034 smart_failure[1118986]: Device: /dev/sde [SAT], 1016 Offline uncorrectable sectors
Sep 30 11:57:02 cloudcephosd1034 smart_failure[1141756]: Device: /dev/sdf [SAT], 704 Offline uncorrectable sectors
Sep 30 11:57:02 cloudcephosd1034 smart_failure[1141805]: Device: /dev/sdi [SAT], 512 Offline uncorrectable sectors
Sep 30 16:57:02 cloudcephosd1034 smart_failure[1255456]: Device: /dev/sdc [SAT], 2624 Offline uncorrectable sectors
===== NODE GROUP =====
(1) cloudcephosd1031.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 01 01:16:04 cloudcephosd1031 smart_failure[1157501]: Device: /dev/sdd [SAT], 1520 Offline uncorrectable sectors
Oct 01 02:16:04 cloudcephosd1031 smart_failure[1180117]: Device: /dev/sde [SAT], 1408 Offline uncorrectable sectors
Oct 01 02:46:04 cloudcephosd1031 smart_failure[1191117]: Device: /dev/sdj [SAT], 2432 Offline uncorrectable sectors
Oct 01 10:16:04 cloudcephosd1031 smart_failure[1360906]: Device: /dev/sdf [SAT], 1872 Offline uncorrectable sectors
Oct 01 12:46:04 cloudcephosd1031 smart_failure[1417386]: Device: /dev/sdg [SAT], 1312 Offline uncorrectable sectors
Oct 01 16:46:04 cloudcephosd1031 smart_failure[1508121]: Device: /dev/sdh [SAT], 776 Offline uncorrectable sectors
Oct 01 17:16:05 cloudcephosd1031 smart_failure[1519660]: Device: /dev/sdi [SAT], 1792 Offline uncorrectable sectors
Oct 01 17:46:04 cloudcephosd1031 smart_failure[1530755]: Device: /dev/sdc [SAT], 1512 Offline uncorrectable sectors
Oct 02 01:16:04 cloudcephosd1031 smart_failure[1699751]: Device: /dev/sdd [SAT], 1520 Offline uncorrectable sectors
Oct 02 02:16:04 cloudcephosd1031 smart_failure[1722211]: Device: /dev/sde [SAT], 1408 Offline uncorrectable sectors
Oct 02 02:46:04 cloudcephosd1031 smart_failure[1733475]: Device: /dev/sdj [SAT], 2448 Offline uncorrectable sectors
Oct 02 10:16:04 cloudcephosd1031 smart_failure[1902268]: Device: /dev/sdf [SAT], 1872 Offline uncorrectable sectors
Oct 02 12:46:04 cloudcephosd1031 smart_failure[1958563]: Device: /dev/sdg [SAT], 1312 Offline uncorrectable sectors
Oct 02 16:46:04 cloudcephosd1031 smart_failure[2048606]: Device: /dev/sdh [SAT], 776 Offline uncorrectable sectors
Oct 02 17:16:04 cloudcephosd1031 smart_failure[2059764]: Device: /dev/sdi [SAT], 1792 Offline uncorrectable sectors
Oct 02 17:46:04 cloudcephosd1031 smart_failure[2071167]: Device: /dev/sdc [SAT], 1512 Offline uncorrectable sectors
Oct 03 01:16:04 cloudcephosd1031 smart_failure[2231429]: Device: /dev/sdd [SAT], 1536 Offline uncorrectable sectors
Oct 03 02:16:04 cloudcephosd1031 smart_failure[2254029]: Device: /dev/sde [SAT], 1408 Offline uncorrectable sectors
Oct 03 02:46:04 cloudcephosd1031 smart_failure[2265459]: Device: /dev/sdj [SAT], 2448 Offline uncorrectable sectors
Oct 03 10:16:04 cloudcephosd1031 smart_failure[2434643]: Device: /dev/sdf [SAT], 1880 Offline uncorrectable sectors
Oct 03 12:46:04 cloudcephosd1031 smart_failure[2490404]: Device: /dev/sdg [SAT], 1312 Offline uncorrectable sectors
Oct 03 16:46:04 cloudcephosd1031 smart_failure[2580257]: Device: /dev/sdh [SAT], 776 Offline uncorrectable sectors
Oct 03 17:16:05 cloudcephosd1031 smart_failure[2591549]: Device: /dev/sdi [SAT], 1800 Offline uncorrectable sectors
Oct 03 17:46:05 cloudcephosd1031 smart_failure[2602699]: Device: /dev/sdc [SAT], 1512 Offline uncorrectable sectors
Oct 04 01:16:04 cloudcephosd1031 smart_failure[2772311]: Device: /dev/sdd [SAT], 1536 Offline uncorrectable sectors
Oct 04 02:16:04 cloudcephosd1031 smart_failure[2794850]: Device: /dev/sde [SAT], 1408 Offline uncorrectable sectors
Oct 04 02:46:04 cloudcephosd1031 smart_failure[2806096]: Device: /dev/sdj [SAT], 2472 Offline uncorrectable sectors
Oct 04 10:16:04 cloudcephosd1031 smart_failure[2976317]: Device: /dev/sdf [SAT], 1880 Offline uncorrectable sectors
Oct 04 12:46:04 cloudcephosd1031 smart_failure[3032878]: Device: /dev/sdg [SAT], 1312 Offline uncorrectable sectors
Oct 04 16:46:04 cloudcephosd1031 smart_failure[3123971]: Device: /dev/sdh [SAT], 776 Offline uncorrectable sectors
Oct 04 17:16:04 cloudcephosd1031 smart_failure[3135602]: Device: /dev/sdi [SAT], 1824 Offline uncorrectable sectors
Oct 04 18:16:04 cloudcephosd1031 smart_failure[3158133]: Device: /dev/sdc [SAT], 1512 Offline uncorrectable sectors
Oct 05 01:16:04 cloudcephosd1031 smart_failure[3316049]: Device: /dev/sdd [SAT], 1536 Offline uncorrectable sectors
Oct 05 02:16:04 cloudcephosd1031 smart_failure[3338494]: Device: /dev/sde [SAT], 1408 Offline uncorrectable sectors
Oct 05 03:16:01 cloudcephosd1031 smart_failure[3361140]: Device: /dev/sdj [SAT], 2472 Offline uncorrectable sectors
Oct 05 10:46:01 cloudcephosd1031 smart_failure[3530565]: Device: /dev/sdf [SAT], 1904 Offline uncorrectable sectors
Oct 05 13:16:01 cloudcephosd1031 smart_failure[3598663]: Device: /dev/sdg [SAT], 1312 Offline uncorrectable sectors
Oct 05 17:16:01 cloudcephosd1031 smart_failure[3689232]: Device: /dev/sdh [SAT], 776 Offline uncorrectable sectors
Oct 05 17:46:02 cloudcephosd1031 smart_failure[3700453]: Device: /dev/sdi [SAT], 1824 Offline uncorrectable sectors
Oct 05 18:46:01 cloudcephosd1031 smart_failure[3722732]: Device: /dev/sdc [SAT], 1512 Offline uncorrectable sectors
Oct 06 01:46:01 cloudcephosd1031 smart_failure[3880529]: Device: /dev/sdd [SAT], 1536 Offline uncorrectable sectors
Oct 06 02:46:01 cloudcephosd1031 smart_failure[3902940]: Device: /dev/sde [SAT], 1408 Offline uncorrectable sectors
Oct 06 03:16:01 cloudcephosd1031 smart_failure[3914346]: Device: /dev/sdj [SAT], 2472 Offline uncorrectable sectors
Oct 06 10:46:01 cloudcephosd1031 smart_failure[4083359]: Device: /dev/sdf [SAT], 1904 Offline uncorrectable sectors
Oct 06 13:16:01 cloudcephosd1031 smart_failure[4140316]: Device: /dev/sdg [SAT], 1320 Offline uncorrectable sectors
Oct 06 17:16:01 cloudcephosd1031 smart_failure[36608]: Device: /dev/sdh [SAT], 776 Offline uncorrectable sectors
Oct 06 17:46:01 cloudcephosd1031 smart_failure[47933]: Device: /dev/sdi [SAT], 1824 Offline uncorrectable sectors
Oct 06 18:46:01 cloudcephosd1031 smart_failure[70048]: Device: /dev/sdc [SAT], 1512 Offline uncorrectable sectors
Oct 07 01:46:01 cloudcephosd1031 smart_failure[227299]: Device: /dev/sdd [SAT], 1544 Offline uncorrectable sectors (changed +8)
Oct 07 02:46:01 cloudcephosd1031 smart_failure[249584]: Device: /dev/sde [SAT], 1408 Offline uncorrectable sectors
Oct 07 03:16:01 cloudcephosd1031 smart_failure[261027]: Device: /dev/sdj [SAT], 2472 Offline uncorrectable sectors
Oct 07 10:46:01 cloudcephosd1031 smart_failure[428546]: Device: /dev/sdf [SAT], 1904 Offline uncorrectable sectors
Oct 07 13:16:01 cloudcephosd1031 smart_failure[484114]: Device: /dev/sdg [SAT], 1328 Offline uncorrectable sectors
Oct 07 17:16:01 cloudcephosd1031 smart_failure[573416]: Device: /dev/sdh [SAT], 776 Offline uncorrectable sectors
Oct 07 17:46:01 cloudcephosd1031 smart_failure[584622]: Device: /dev/sdi [SAT], 1824 Offline uncorrectable sectors
Oct 07 18:46:02 cloudcephosd1031 smart_failure[607065]: Device: /dev/sdc [SAT], 1520 Offline uncorrectable sectors
Oct 08 01:46:01 cloudcephosd1031 smart_failure[763684]: Device: /dev/sdd [SAT], 1544 Offline uncorrectable sectors
Oct 08 02:46:01 cloudcephosd1031 smart_failure[786121]: Device: /dev/sde [SAT], 1424 Offline uncorrectable sectors
Oct 08 03:16:01 cloudcephosd1031 smart_failure[797192]: Device: /dev/sdj [SAT], 2480 Offline uncorrectable sectors
Oct 08 10:46:02 cloudcephosd1031 smart_failure[964501]: Device: /dev/sdf [SAT], 1912 Offline uncorrectable sectors
Oct 08 13:16:01 cloudcephosd1031 smart_failure[1019934]: Device: /dev/sdg [SAT], 1336 Offline uncorrectable sectors
Oct 08 17:16:01 cloudcephosd1031 smart_failure[1109561]: Device: /dev/sdh [SAT], 784 Offline uncorrectable sectors
Oct 08 17:46:01 cloudcephosd1031 smart_failure[1120769]: Device: /dev/sdi [SAT], 1832 Offline uncorrectable sectors
Oct 08 19:16:01 cloudcephosd1031 smart_failure[1154562]: Device: /dev/sdc [SAT], 1520 Offline uncorrectable sectors
Oct 09 01:46:01 cloudcephosd1031 smart_failure[1299463]: Device: /dev/sdd [SAT], 1544 Offline uncorrectable sectors
Oct 09 02:46:02 cloudcephosd1031 smart_failure[1321894]: Device: /dev/sde [SAT], 1424 Offline uncorrectable sectors
Oct 09 03:16:01 cloudcephosd1031 smart_failure[1333086]: Device: /dev/sdj [SAT], 2504 Offline uncorrectable sectors
Oct 09 10:46:01 cloudcephosd1031 smart_failure[1500172]: Device: /dev/sdf [SAT], 1928 Offline uncorrectable sectors
Oct 09 13:16:01 cloudcephosd1031 smart_failure[1556129]: Device: /dev/sdg [SAT], 1336 Offline uncorrectable sectors
Oct 09 17:16:01 cloudcephosd1031 smart_failure[1645084]: Device: /dev/sdh [SAT], 784 Offline uncorrectable sectors
Oct 09 17:46:01 cloudcephosd1031 smart_failure[1656410]: Device: /dev/sdi [SAT], 1832 Offline uncorrectable sectors
Oct 09 19:16:02 cloudcephosd1031 smart_failure[1690308]: Device: /dev/sdc [SAT], 1520 Offline uncorrectable sectors
Oct 10 01:46:01 cloudcephosd1031 smart_failure[1835542]: Device: /dev/sdd [SAT], 1560 Offline uncorrectable sectors
Oct 10 02:46:01 cloudcephosd1031 smart_failure[1857734]: Device: /dev/sde [SAT], 1432 Offline uncorrectable sectors
Oct 10 03:16:01 cloudcephosd1031 smart_failure[1868910]: Device: /dev/sdj [SAT], 2504 Offline uncorrectable sectors
Oct 10 10:46:01 cloudcephosd1031 smart_failure[2036597]: Device: /dev/sdf [SAT], 1928 Offline uncorrectable sectors
Oct 10 13:16:01 cloudcephosd1031 smart_failure[2092859]: Device: /dev/sdg [SAT], 1336 Offline uncorrectable sectors
Oct 10 17:16:01 cloudcephosd1031 smart_failure[2182986]: Device: /dev/sdh [SAT], 784 Offline uncorrectable sectors
Oct 10 17:46:01 cloudcephosd1031 smart_failure[2194346]: Device: /dev/sdi [SAT], 1856 Offline uncorrectable sectors
Oct 10 19:46:01 cloudcephosd1031 smart_failure[2240190]: Device: /dev/sdc [SAT], 1520 Offline uncorrectable sectors
Oct 11 01:46:01 cloudcephosd1031 smart_failure[2375177]: Device: /dev/sdd [SAT], 1568 Offline uncorrectable sectors
Oct 11 02:46:01 cloudcephosd1031 smart_failure[2397785]: Device: /dev/sde [SAT], 1448 Offline uncorrectable sectors
Oct 11 03:16:02 cloudcephosd1031 smart_failure[2409139]: Device: /dev/sdj [SAT], 2504 Offline uncorrectable sectors
Oct 11 10:46:01 cloudcephosd1031 smart_failure[2578970]: Device: /dev/sdf [SAT], 1936 Offline uncorrectable sectors
Sep 15 00:46:04 cloudcephosd1031 smart_failure[871831]: Device: /dev/sdd [SAT], 1416 Offline uncorrectable sectors
Sep 15 02:16:04 cloudcephosd1031 smart_failure[905645]: Device: /dev/sde [SAT], 1280 Offline uncorrectable sectors
Sep 15 02:46:04 cloudcephosd1031 smart_failure[917059]: Device: /dev/sdj [SAT], 2280 Offline uncorrectable sectors
Sep 15 10:16:04 cloudcephosd1031 smart_failure[1086662]: Device: /dev/sdf [SAT], 1760 Offline uncorrectable sectors
Sep 15 12:46:04 cloudcephosd1031 smart_failure[1142920]: Device: /dev/sdg [SAT], 1272 Offline uncorrectable sectors
Sep 15 16:16:04 cloudcephosd1031 smart_failure[1221312]: Device: /dev/sdh [SAT], 728 Offline uncorrectable sectors
Sep 15 16:16:04 cloudcephosd1031 smart_failure[1221331]: Device: /dev/sdi [SAT], 1664 Offline uncorrectable sectors
Sep 15 17:46:04 cloudcephosd1031 smart_failure[1255528]: Device: /dev/sdc [SAT], 1480 Offline uncorrectable sectors
Sep 16 00:46:04 cloudcephosd1031 smart_failure[1413605]: Device: /dev/sdd [SAT], 1416 Offline uncorrectable sectors
Sep 16 02:16:04 cloudcephosd1031 smart_failure[1447409]: Device: /dev/sde [SAT], 1288 Offline uncorrectable sectors
Sep 16 02:46:05 cloudcephosd1031 smart_failure[1458664]: Device: /dev/sdj [SAT], 2288 Offline uncorrectable sectors
Sep 16 10:16:04 cloudcephosd1031 smart_failure[1627645]: Device: /dev/sdf [SAT], 1760 Offline uncorrectable sectors
Sep 16 12:46:04 cloudcephosd1031 smart_failure[1683657]: Device: /dev/sdg [SAT], 1272 Offline uncorrectable sectors
Sep 16 16:16:04 cloudcephosd1031 smart_failure[1761998]: Device: /dev/sdh [SAT], 728 Offline uncorrectable sectors
Sep 16 16:16:04 cloudcephosd1031 smart_failure[1762017]: Device: /dev/sdi [SAT], 1680 Offline uncorrectable sectors
Sep 16 17:46:04 cloudcephosd1031 smart_failure[1795813]: Device: /dev/sdc [SAT], 1480 Offline uncorrectable sectors
Sep 17 00:46:04 cloudcephosd1031 smart_failure[1953018]: Device: /dev/sdd [SAT], 1416 Offline uncorrectable sectors
Sep 17 02:16:04 cloudcephosd1031 smart_failure[1986858]: Device: /dev/sde [SAT], 1288 Offline uncorrectable sectors
Sep 17 02:46:04 cloudcephosd1031 smart_failure[1998111]: Device: /dev/sdj [SAT], 2296 Offline uncorrectable sectors
Sep 17 10:16:04 cloudcephosd1031 smart_failure[2166567]: Device: /dev/sdf [SAT], 1760 Offline uncorrectable sectors
Sep 17 12:46:04 cloudcephosd1031 smart_failure[2222897]: Device: /dev/sdg [SAT], 1272 Offline uncorrectable sectors
Sep 17 16:16:04 cloudcephosd1031 smart_failure[2301189]: Device: /dev/sdh [SAT], 736 Offline uncorrectable sectors
Sep 17 16:16:04 cloudcephosd1031 smart_failure[2301232]: Device: /dev/sdi [SAT], 1704 Offline uncorrectable sectors
Sep 17 17:46:04 cloudcephosd1031 smart_failure[2334804]: Device: /dev/sdc [SAT], 1496 Offline uncorrectable sectors
Sep 18 00:46:04 cloudcephosd1031 smart_failure[2492567]: Device: /dev/sdd [SAT], 1424 Offline uncorrectable sectors
Sep 18 02:16:04 cloudcephosd1031 smart_failure[2526240]: Device: /dev/sde [SAT], 1296 Offline uncorrectable sectors
Sep 18 02:46:04 cloudcephosd1031 smart_failure[2537617]: Device: /dev/sdj [SAT], 2296 Offline uncorrectable sectors
Sep 18 10:16:04 cloudcephosd1031 smart_failure[2705856]: Device: /dev/sdf [SAT], 1760 Offline uncorrectable sectors
Sep 18 12:46:04 cloudcephosd1031 smart_failure[2763351]: Device: /dev/sdg [SAT], 1280 Offline uncorrectable sectors
Sep 18 16:16:04 cloudcephosd1031 smart_failure[2843030]: Device: /dev/sdh [SAT], 736 Offline uncorrectable sectors
Sep 18 16:16:04 cloudcephosd1031 smart_failure[2843049]: Device: /dev/sdi [SAT], 1712 Offline uncorrectable sectors
Sep 18 17:46:04 cloudcephosd1031 smart_failure[2876652]: Device: /dev/sdc [SAT], 1496 Offline uncorrectable sectors
Sep 19 00:46:04 cloudcephosd1031 smart_failure[3034481]: Device: /dev/sdd [SAT], 1424 Offline uncorrectable sectors
Sep 19 02:16:04 cloudcephosd1031 smart_failure[3068352]: Device: /dev/sde [SAT], 1312 Offline uncorrectable sectors
Sep 19 02:46:04 cloudcephosd1031 smart_failure[3079632]: Device: /dev/sdj [SAT], 2320 Offline uncorrectable sectors
Sep 19 10:16:04 cloudcephosd1031 smart_failure[3249770]: Device: /dev/sdf [SAT], 1784 Offline uncorrectable sectors
Sep 19 12:46:05 cloudcephosd1031 smart_failure[3306246]: Device: /dev/sdg [SAT], 1280 Offline uncorrectable sectors
Sep 19 16:16:04 cloudcephosd1031 smart_failure[3385388]: Device: /dev/sdh [SAT], 736 Offline uncorrectable sectors
Sep 19 16:16:04 cloudcephosd1031 smart_failure[3385432]: Device: /dev/sdi [SAT], 1720 Offline uncorrectable sectors
Sep 19 17:46:04 cloudcephosd1031 smart_failure[3419473]: Device: /dev/sdc [SAT], 1496 Offline uncorrectable sectors
Sep 20 00:46:04 cloudcephosd1031 smart_failure[3579951]: Device: /dev/sdd [SAT], 1440 Offline uncorrectable sectors
Sep 20 02:16:04 cloudcephosd1031 smart_failure[3613853]: Device: /dev/sde [SAT], 1336 Offline uncorrectable sectors
Sep 20 02:46:04 cloudcephosd1031 smart_failure[3624975]: Device: /dev/sdj [SAT], 2328 Offline uncorrectable sectors
Sep 20 10:16:04 cloudcephosd1031 smart_failure[3794048]: Device: /dev/sdf [SAT], 1808 Offline uncorrectable sectors
Sep 20 12:46:04 cloudcephosd1031 smart_failure[3850180]: Device: /dev/sdg [SAT], 1288 Offline uncorrectable sectors
Sep 20 16:16:04 cloudcephosd1031 smart_failure[3929464]: Device: /dev/sdh [SAT], 744 Offline uncorrectable sectors
Sep 20 16:16:04 cloudcephosd1031 smart_failure[3929507]: Device: /dev/sdi [SAT], 1728 Offline uncorrectable sectors
Sep 20 17:46:04 cloudcephosd1031 smart_failure[3962943]: Device: /dev/sdc [SAT], 1496 Offline uncorrectable sectors
Sep 21 00:46:04 cloudcephosd1031 smart_failure[4120629]: Device: /dev/sdd [SAT], 1464 Offline uncorrectable sectors
Sep 21 02:16:04 cloudcephosd1031 smart_failure[4154328]: Device: /dev/sde [SAT], 1344 Offline uncorrectable sectors
Sep 21 02:46:04 cloudcephosd1031 smart_failure[4165493]: Device: /dev/sdj [SAT], 2344 Offline uncorrectable sectors
Sep 21 10:16:04 cloudcephosd1031 smart_failure[139911]: Device: /dev/sdf [SAT], 1808 Offline uncorrectable sectors
Sep 21 12:46:04 cloudcephosd1031 smart_failure[196170]: Device: /dev/sdg [SAT], 1296 Offline uncorrectable sectors
Sep 21 16:16:04 cloudcephosd1031 smart_failure[275190]: Device: /dev/sdh [SAT], 744 Offline uncorrectable sectors
Sep 21 16:16:04 cloudcephosd1031 smart_failure[275233]: Device: /dev/sdi [SAT], 1744 Offline uncorrectable sectors
Sep 21 17:46:04 cloudcephosd1031 smart_failure[309529]: Device: /dev/sdc [SAT], 1496 Offline uncorrectable sectors
Sep 22 00:46:04 cloudcephosd1031 smart_failure[466709]: Device: /dev/sdd [SAT], 1464 Offline uncorrectable sectors
Sep 22 02:16:04 cloudcephosd1031 smart_failure[500077]: Device: /dev/sde [SAT], 1352 Offline uncorrectable sectors
Sep 22 02:46:04 cloudcephosd1031 smart_failure[511586]: Device: /dev/sdj [SAT], 2344 Offline uncorrectable sectors
Sep 22 10:16:04 cloudcephosd1031 smart_failure[679912]: Device: /dev/sdf [SAT], 1808 Offline uncorrectable sectors
Sep 22 12:46:04 cloudcephosd1031 smart_failure[735628]: Device: /dev/sdg [SAT], 1296 Offline uncorrectable sectors
Sep 22 16:16:04 cloudcephosd1031 smart_failure[815107]: Device: /dev/sdh [SAT], 744 Offline uncorrectable sectors
Sep 22 16:16:04 cloudcephosd1031 smart_failure[815126]: Device: /dev/sdi [SAT], 1744 Offline uncorrectable sectors
Sep 22 17:46:04 cloudcephosd1031 smart_failure[848817]: Device: /dev/sdc [SAT], 1496 Offline uncorrectable sectors
Sep 23 00:46:04 cloudcephosd1031 smart_failure[1007220]: Device: /dev/sdd [SAT], 1464 Offline uncorrectable sectors
Sep 23 02:16:04 cloudcephosd1031 smart_failure[1040451]: Device: /dev/sde [SAT], 1360 Offline uncorrectable sectors
Sep 23 02:46:04 cloudcephosd1031 smart_failure[1051872]: Device: /dev/sdj [SAT], 2344 Offline uncorrectable sectors
Sep 23 10:16:04 cloudcephosd1031 smart_failure[1221176]: Device: /dev/sdf [SAT], 1808 Offline uncorrectable sectors
Sep 23 12:46:04 cloudcephosd1031 smart_failure[1277485]: Device: /dev/sdg [SAT], 1296 Offline uncorrectable sectors
Sep 23 16:16:04 cloudcephosd1031 smart_failure[1356045]: Device: /dev/sdh [SAT], 744 Offline uncorrectable sectors
Sep 23 16:16:04 cloudcephosd1031 smart_failure[1356088]: Device: /dev/sdi [SAT], 1744 Offline uncorrectable sectors
Sep 23 17:46:04 cloudcephosd1031 smart_failure[1389570]: Device: /dev/sdc [SAT], 1496 Offline uncorrectable sectors
Sep 24 00:46:04 cloudcephosd1031 smart_failure[1548091]: Device: /dev/sdd [SAT], 1464 Offline uncorrectable sectors
Sep 24 02:16:04 cloudcephosd1031 smart_failure[1582723]: Device: /dev/sde [SAT], 1368 Offline uncorrectable sectors
Sep 24 02:46:04 cloudcephosd1031 smart_failure[1593812]: Device: /dev/sdj [SAT], 2344 Offline uncorrectable sectors
Sep 24 10:16:04 cloudcephosd1031 smart_failure[1762469]: Device: /dev/sdf [SAT], 1816 Offline uncorrectable sectors
Sep 24 12:46:04 cloudcephosd1031 smart_failure[1818889]: Device: /dev/sdg [SAT], 1304 Offline uncorrectable sectors
Sep 24 16:16:04 cloudcephosd1031 smart_failure[1897773]: Device: /dev/sdh [SAT], 760 Offline uncorrectable sectors
Sep 24 16:16:04 cloudcephosd1031 smart_failure[1897815]: Device: /dev/sdi [SAT], 1760 Offline uncorrectable sectors
Sep 24 17:46:04 cloudcephosd1031 smart_failure[1931749]: Device: /dev/sdc [SAT], 1496 Offline uncorrectable sectors
Sep 25 00:46:04 cloudcephosd1031 smart_failure[2088955]: Device: /dev/sdd [SAT], 1464 Offline uncorrectable sectors
Sep 25 02:16:04 cloudcephosd1031 smart_failure[2122616]: Device: /dev/sde [SAT], 1384 Offline uncorrectable sectors
Sep 25 02:46:04 cloudcephosd1031 smart_failure[2133711]: Device: /dev/sdj [SAT], 2360 Offline uncorrectable sectors
Sep 25 10:16:04 cloudcephosd1031 smart_failure[2302247]: Device: /dev/sdf [SAT], 1856 Offline uncorrectable sectors
Sep 25 12:46:04 cloudcephosd1031 smart_failure[2359086]: Device: /dev/sdg [SAT], 1304 Offline uncorrectable sectors
Sep 25 16:16:04 cloudcephosd1031 smart_failure[2437319]: Device: /dev/sdh [SAT], 768 Offline uncorrectable sectors
Sep 25 16:16:04 cloudcephosd1031 smart_failure[2437361]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Sep 25 17:46:04 cloudcephosd1031 smart_failure[2471438]: Device: /dev/sdc [SAT], 1496 Offline uncorrectable sectors
Sep 26 00:46:04 cloudcephosd1031 smart_failure[2629866]: Device: /dev/sdd [SAT], 1464 Offline uncorrectable sectors
Sep 26 02:16:04 cloudcephosd1031 smart_failure[2664145]: Device: /dev/sde [SAT], 1392 Offline uncorrectable sectors
Sep 26 02:46:04 cloudcephosd1031 smart_failure[2675700]: Device: /dev/sdj [SAT], 2360 Offline uncorrectable sectors
Sep 26 10:16:04 cloudcephosd1031 smart_failure[2844884]: Device: /dev/sdf [SAT], 1856 Offline uncorrectable sectors
Sep 26 12:46:04 cloudcephosd1031 smart_failure[2901139]: Device: /dev/sdg [SAT], 1304 Offline uncorrectable sectors
Sep 26 16:16:04 cloudcephosd1031 smart_failure[2979774]: Device: /dev/sdh [SAT], 768 Offline uncorrectable sectors
Sep 26 16:16:04 cloudcephosd1031 smart_failure[2979820]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Sep 26 17:46:04 cloudcephosd1031 smart_failure[3013593]: Device: /dev/sdc [SAT], 1496 Offline uncorrectable sectors
Sep 27 00:46:04 cloudcephosd1031 smart_failure[3171921]: Device: /dev/sdd [SAT], 1496 Offline uncorrectable sectors
Sep 27 02:16:04 cloudcephosd1031 smart_failure[3206084]: Device: /dev/sde [SAT], 1400 Offline uncorrectable sectors
Sep 27 02:46:04 cloudcephosd1031 smart_failure[3217232]: Device: /dev/sdj [SAT], 2408 Offline uncorrectable sectors
Sep 27 10:16:04 cloudcephosd1031 smart_failure[3385373]: Device: /dev/sdf [SAT], 1864 Offline uncorrectable sectors
Sep 27 12:46:04 cloudcephosd1031 smart_failure[3441677]: Device: /dev/sdg [SAT], 1304 Offline uncorrectable sectors
Sep 27 16:16:05 cloudcephosd1031 smart_failure[3521131]: Device: /dev/sdh [SAT], 768 Offline uncorrectable sectors
Sep 27 16:16:05 cloudcephosd1031 smart_failure[3521174]: Device: /dev/sdi [SAT], 1776 Offline uncorrectable sectors
Sep 27 17:46:04 cloudcephosd1031 smart_failure[3554555]: Device: /dev/sdc [SAT], 1512 Offline uncorrectable sectors
Sep 28 00:46:04 cloudcephosd1031 smart_failure[3713102]: Device: /dev/sdd [SAT], 1504 Offline uncorrectable sectors
Sep 28 02:16:04 cloudcephosd1031 smart_failure[3747371]: Device: /dev/sde [SAT], 1400 Offline uncorrectable sectors
Sep 28 02:46:04 cloudcephosd1031 smart_failure[3758658]: Device: /dev/sdj [SAT], 2408 Offline uncorrectable sectors
Sep 28 10:16:04 cloudcephosd1031 smart_failure[3927431]: Device: /dev/sdf [SAT], 1872 Offline uncorrectable sectors
Sep 28 12:46:04 cloudcephosd1031 smart_failure[3983979]: Device: /dev/sdg [SAT], 1304 Offline uncorrectable sectors
Sep 28 16:46:04 cloudcephosd1031 smart_failure[4073762]: Device: /dev/sdh [SAT], 776 Offline uncorrectable sectors
Sep 28 16:46:04 cloudcephosd1031 smart_failure[4073781]: Device: /dev/sdi [SAT], 1784 Offline uncorrectable sectors
Sep 28 17:46:04 cloudcephosd1031 smart_failure[4096116]: Device: /dev/sdc [SAT], 1512 Offline uncorrectable sectors
Sep 29 00:46:05 cloudcephosd1031 smart_failure[60729]: Device: /dev/sdd [SAT], 1504 Offline uncorrectable sectors
Sep 29 02:16:04 cloudcephosd1031 smart_failure[94608]: Device: /dev/sde [SAT], 1408 Offline uncorrectable sectors
Sep 29 02:46:04 cloudcephosd1031 smart_failure[105793]: Device: /dev/sdj [SAT], 2424 Offline uncorrectable sectors
Sep 29 10:16:04 cloudcephosd1031 smart_failure[275322]: Device: /dev/sdf [SAT], 1872 Offline uncorrectable sectors
Sep 29 12:46:04 cloudcephosd1031 smart_failure[331972]: Device: /dev/sdg [SAT], 1304 Offline uncorrectable sectors
Sep 29 16:46:05 cloudcephosd1031 smart_failure[422088]: Device: /dev/sdh [SAT], 776 Offline uncorrectable sectors
Sep 29 16:46:05 cloudcephosd1031 smart_failure[422107]: Device: /dev/sdi [SAT], 1784 Offline uncorrectable sectors
Sep 29 17:46:04 cloudcephosd1031 smart_failure[444698]: Device: /dev/sdc [SAT], 1512 Offline uncorrectable sectors
Sep 30 01:16:04 cloudcephosd1031 smart_failure[614337]: Device: /dev/sdd [SAT], 1512 Offline uncorrectable sectors
Sep 30 02:16:04 cloudcephosd1031 smart_failure[636887]: Device: /dev/sde [SAT], 1408 Offline uncorrectable sectors
Sep 30 02:46:04 cloudcephosd1031 smart_failure[647952]: Device: /dev/sdj [SAT], 2424 Offline uncorrectable sectors
Sep 30 10:16:04 cloudcephosd1031 smart_failure[818099]: Device: /dev/sdf [SAT], 1872 Offline uncorrectable sectors
Sep 30 12:46:04 cloudcephosd1031 smart_failure[874291]: Device: /dev/sdg [SAT], 1304 Offline uncorrectable sectors
Sep 30 16:46:04 cloudcephosd1031 smart_failure[964886]: Device: /dev/sdh [SAT], 776 Offline uncorrectable sectors
Sep 30 17:16:04 cloudcephosd1031 smart_failure[976250]: Device: /dev/sdi [SAT], 1792 Offline uncorrectable sectors
Sep 30 17:46:04 cloudcephosd1031 smart_failure[987397]: Device: /dev/sdc [SAT], 1512 Offline uncorrectable sectors
===== NODE GROUP =====
(1) cloudcephosd1021.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 01 02:04:03 cloudcephosd1021 smart_failure[1679504]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Oct 01 09:34:03 cloudcephosd1021 smart_failure[1847836]: Device: /dev/sdh [SAT], 1416 Offline uncorrectable sectors
Oct 01 13:04:03 cloudcephosd1021 smart_failure[1926438]: Device: /dev/sdd [SAT], 544 Offline uncorrectable sectors
Oct 01 14:34:03 cloudcephosd1021 smart_failure[1960315]: Device: /dev/sdg [SAT], 1872 Offline uncorrectable sectors
Oct 01 18:04:03 cloudcephosd1021 smart_failure[2038573]: Device: /dev/sdc [SAT], 1272 Offline uncorrectable sectors
Oct 01 20:34:03 cloudcephosd1021 smart_failure[2095006]: Device: /dev/sdi [SAT], 1744 Offline uncorrectable sectors
Oct 01 21:34:03 cloudcephosd1021 smart_failure[2117002]: Device: /dev/sdf [SAT], 1808 Offline uncorrectable sectors
Oct 01 21:34:03 cloudcephosd1021 smart_failure[2117051]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Oct 02 02:04:03 cloudcephosd1021 smart_failure[2217395]: Device: /dev/sde [SAT], 1008 Offline uncorrectable sectors
Oct 02 09:34:03 cloudcephosd1021 smart_failure[2385796]: Device: /dev/sdh [SAT], 1432 Offline uncorrectable sectors
Oct 02 13:04:03 cloudcephosd1021 smart_failure[2464713]: Device: /dev/sdd [SAT], 544 Offline uncorrectable sectors
Oct 02 14:34:03 cloudcephosd1021 smart_failure[2498356]: Device: /dev/sdg [SAT], 1888 Offline uncorrectable sectors
Oct 02 18:04:03 cloudcephosd1021 smart_failure[2576952]: Device: /dev/sdc [SAT], 1280 Offline uncorrectable sectors
Oct 02 20:34:03 cloudcephosd1021 smart_failure[2633222]: Device: /dev/sdi [SAT], 1760 Offline uncorrectable sectors
Oct 02 21:34:03 cloudcephosd1021 smart_failure[2655596]: Device: /dev/sdf [SAT], 1816 Offline uncorrectable sectors
Oct 02 21:34:03 cloudcephosd1021 smart_failure[2655642]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Oct 03 02:04:03 cloudcephosd1021 smart_failure[2746639]: Device: /dev/sde [SAT], 1008 Offline uncorrectable sectors
Oct 03 09:34:03 cloudcephosd1021 smart_failure[2914790]: Device: /dev/sdh [SAT], 1432 Offline uncorrectable sectors
Oct 03 13:04:03 cloudcephosd1021 smart_failure[2993083]: Device: /dev/sdd [SAT], 544 Offline uncorrectable sectors
Oct 03 14:34:03 cloudcephosd1021 smart_failure[3026351]: Device: /dev/sdg [SAT], 1888 Offline uncorrectable sectors
Oct 03 18:04:03 cloudcephosd1021 smart_failure[3104438]: Device: /dev/sdc [SAT], 1304 Offline uncorrectable sectors
Oct 03 20:34:03 cloudcephosd1021 smart_failure[3160448]: Device: /dev/sdi [SAT], 1768 Offline uncorrectable sectors
Oct 03 21:34:03 cloudcephosd1021 smart_failure[3182921]: Device: /dev/sdf [SAT], 1816 Offline uncorrectable sectors
Oct 03 21:34:03 cloudcephosd1021 smart_failure[3182969]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Oct 04 02:04:03 cloudcephosd1021 smart_failure[3283458]: Device: /dev/sde [SAT], 1008 Offline uncorrectable sectors
Oct 04 09:34:03 cloudcephosd1021 smart_failure[3452553]: Device: /dev/sdh [SAT], 1448 Offline uncorrectable sectors
Oct 04 13:04:03 cloudcephosd1021 smart_failure[3530837]: Device: /dev/sdd [SAT], 552 Offline uncorrectable sectors
Oct 04 14:34:03 cloudcephosd1021 smart_failure[3564318]: Device: /dev/sdg [SAT], 1904 Offline uncorrectable sectors
Oct 04 18:04:03 cloudcephosd1021 smart_failure[3643542]: Device: /dev/sdc [SAT], 1320 Offline uncorrectable sectors
Oct 04 20:34:03 cloudcephosd1021 smart_failure[3699863]: Device: /dev/sdi [SAT], 1776 Offline uncorrectable sectors
Oct 04 21:34:03 cloudcephosd1021 smart_failure[3722308]: Device: /dev/sdf [SAT], 1816 Offline uncorrectable sectors
Oct 04 21:34:03 cloudcephosd1021 smart_failure[3722327]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Oct 05 02:04:03 cloudcephosd1021 smart_failure[3823593]: Device: /dev/sde [SAT], 1008 Offline uncorrectable sectors
Oct 05 09:34:03 cloudcephosd1021 smart_failure[3992200]: Device: /dev/sdh [SAT], 1448 Offline uncorrectable sectors
Oct 05 13:04:03 cloudcephosd1021 smart_failure[4083092]: Device: /dev/sdd [SAT], 552 Offline uncorrectable sectors
Oct 05 14:34:03 cloudcephosd1021 smart_failure[4116731]: Device: /dev/sdg [SAT], 1928 Offline uncorrectable sectors (changed +8)
Oct 05 18:04:03 cloudcephosd1021 smart_failure[1513]: Device: /dev/sdc [SAT], 1320 Offline uncorrectable sectors
Oct 05 20:34:03 cloudcephosd1021 smart_failure[57703]: Device: /dev/sdi [SAT], 1792 Offline uncorrectable sectors
Oct 05 21:34:03 cloudcephosd1021 smart_failure[80363]: Device: /dev/sdf [SAT], 1816 Offline uncorrectable sectors
Oct 05 21:34:03 cloudcephosd1021 smart_failure[80412]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Oct 06 02:04:03 cloudcephosd1021 smart_failure[180903]: Device: /dev/sde [SAT], 1008 Offline uncorrectable sectors
Oct 06 09:34:03 cloudcephosd1021 smart_failure[350201]: Device: /dev/sdh [SAT], 1448 Offline uncorrectable sectors
Oct 06 13:04:03 cloudcephosd1021 smart_failure[429018]: Device: /dev/sdd [SAT], 552 Offline uncorrectable sectors
Oct 06 14:34:03 cloudcephosd1021 smart_failure[462925]: Device: /dev/sdg [SAT], 1936 Offline uncorrectable sectors
Oct 06 18:04:03 cloudcephosd1021 smart_failure[541818]: Device: /dev/sdc [SAT], 1320 Offline uncorrectable sectors
Oct 06 20:34:03 cloudcephosd1021 smart_failure[598359]: Device: /dev/sdi [SAT], 1792 Offline uncorrectable sectors
Oct 06 21:34:03 cloudcephosd1021 smart_failure[621164]: Device: /dev/sdf [SAT], 1816 Offline uncorrectable sectors
Oct 06 21:34:03 cloudcephosd1021 smart_failure[621183]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Oct 07 02:04:03 cloudcephosd1021 smart_failure[722091]: Device: /dev/sde [SAT], 1016 Offline uncorrectable sectors
Oct 07 09:34:03 cloudcephosd1021 smart_failure[892344]: Device: /dev/sdh [SAT], 1448 Offline uncorrectable sectors
Oct 07 13:04:03 cloudcephosd1021 smart_failure[971143]: Device: /dev/sdd [SAT], 552 Offline uncorrectable sectors
Oct 07 14:34:03 cloudcephosd1021 smart_failure[1005223]: Device: /dev/sdg [SAT], 1944 Offline uncorrectable sectors
Oct 07 18:04:03 cloudcephosd1021 smart_failure[1084458]: Device: /dev/sdc [SAT], 1328 Offline uncorrectable sectors
Oct 07 20:34:03 cloudcephosd1021 smart_failure[1141025]: Device: /dev/sdi [SAT], 1792 Offline uncorrectable sectors
Oct 07 21:34:03 cloudcephosd1021 smart_failure[1163792]: Device: /dev/sdf [SAT], 1816 Offline uncorrectable sectors
Oct 07 21:34:03 cloudcephosd1021 smart_failure[1163841]: Device: /dev/sdj [SAT], 472 Offline uncorrectable sectors
Oct 08 02:04:03 cloudcephosd1021 smart_failure[1266183]: Device: /dev/sde [SAT], 1032 Offline uncorrectable sectors
Oct 08 09:34:03 cloudcephosd1021 smart_failure[1436139]: Device: /dev/sdh [SAT], 1456 Offline uncorrectable sectors
Oct 08 13:04:03 cloudcephosd1021 smart_failure[1514882]: Device: /dev/sdd [SAT], 552 Offline uncorrectable sectors
Oct 08 14:34:03 cloudcephosd1021 smart_failure[1548948]: Device: /dev/sdg [SAT], 1944 Offline uncorrectable sectors
Oct 08 18:04:04 cloudcephosd1021 smart_failure[1628759]: Device: /dev/sdc [SAT], 1328 Offline uncorrectable sectors
Oct 08 20:34:03 cloudcephosd1021 smart_failure[1685259]: Device: /dev/sdi [SAT], 1792 Offline uncorrectable sectors
Oct 08 21:34:03 cloudcephosd1021 smart_failure[1707790]: Device: /dev/sdf [SAT], 1832 Offline uncorrectable sectors
Oct 08 21:34:03 cloudcephosd1021 smart_failure[1707839]: Device: /dev/sdj [SAT], 480 Offline uncorrectable sectors
Oct 09 02:04:03 cloudcephosd1021 smart_failure[1810216]: Device: /dev/sde [SAT], 1032 Offline uncorrectable sectors
Oct 09 09:34:03 cloudcephosd1021 smart_failure[1979510]: Device: /dev/sdh [SAT], 1456 Offline uncorrectable sectors
Oct 09 13:04:03 cloudcephosd1021 smart_failure[2058846]: Device: /dev/sdd [SAT], 552 Offline uncorrectable sectors
Oct 09 14:34:03 cloudcephosd1021 smart_failure[2092771]: Device: /dev/sdg [SAT], 1944 Offline uncorrectable sectors
Oct 09 18:04:03 cloudcephosd1021 smart_failure[2171803]: Device: /dev/sdc [SAT], 1336 Offline uncorrectable sectors
Oct 09 20:34:03 cloudcephosd1021 smart_failure[2228702]: Device: /dev/sdi [SAT], 1792 Offline uncorrectable sectors
Oct 09 21:34:03 cloudcephosd1021 smart_failure[2251426]: Device: /dev/sdf [SAT], 1840 Offline uncorrectable sectors
Oct 09 21:34:03 cloudcephosd1021 smart_failure[2251480]: Device: /dev/sdj [SAT], 480 Offline uncorrectable sectors
Oct 10 02:04:03 cloudcephosd1021 smart_failure[2353473]: Device: /dev/sde [SAT], 1032 Offline uncorrectable sectors
Oct 10 09:34:03 cloudcephosd1021 smart_failure[2523603]: Device: /dev/sdh [SAT], 1472 Offline uncorrectable sectors
Oct 10 13:04:03 cloudcephosd1021 smart_failure[2602920]: Device: /dev/sdd [SAT], 552 Offline uncorrectable sectors
Oct 10 14:34:03 cloudcephosd1021 smart_failure[2636508]: Device: /dev/sdg [SAT], 1952 Offline uncorrectable sectors
Oct 10 18:04:03 cloudcephosd1021 smart_failure[2715512]: Device: /dev/sdc [SAT], 1336 Offline uncorrectable sectors
Oct 10 20:34:03 cloudcephosd1021 smart_failure[2772066]: Device: /dev/sdi [SAT], 1800 Offline uncorrectable sectors
Oct 10 21:34:03 cloudcephosd1021 smart_failure[2795067]: Device: /dev/sdf [SAT], 1840 Offline uncorrectable sectors
Oct 10 21:34:04 cloudcephosd1021 smart_failure[2795086]: Device: /dev/sdj [SAT], 480 Offline uncorrectable sectors
Oct 11 02:04:03 cloudcephosd1021 smart_failure[2896054]: Device: /dev/sde [SAT], 1032 Offline uncorrectable sectors
Oct 11 09:34:03 cloudcephosd1021 smart_failure[3065821]: Device: /dev/sdh [SAT], 1472 Offline uncorrectable sectors
Sep 08 09:34:03 cloudcephosd1021 smart_failure[1960550]: Device: /dev/sdh [SAT], 1336 Offline uncorrectable sectors
Sep 08 12:34:03 cloudcephosd1021 smart_failure[2028644]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 08 14:34:03 cloudcephosd1021 smart_failure[2074360]: Device: /dev/sdg [SAT], 1712 Offline uncorrectable sectors
Sep 08 17:34:04 cloudcephosd1021 smart_failure[2142441]: Device: /dev/sdc [SAT], 1160 Offline uncorrectable sectors
Sep 08 20:34:03 cloudcephosd1021 smart_failure[2210841]: Device: /dev/sdi [SAT], 1656 Offline uncorrectable sectors
Sep 08 21:04:03 cloudcephosd1021 smart_failure[2222243]: Device: /dev/sdj [SAT], 440 Offline uncorrectable sectors
Sep 08 21:34:03 cloudcephosd1021 smart_failure[2233744]: Device: /dev/sdf [SAT], 1656 Offline uncorrectable sectors
Sep 09 01:34:03 cloudcephosd1021 smart_failure[2325206]: Device: /dev/sde [SAT], 960 Offline uncorrectable sectors
Sep 09 09:34:03 cloudcephosd1021 smart_failure[2507500]: Device: /dev/sdh [SAT], 1336 Offline uncorrectable sectors
Sep 09 12:34:03 cloudcephosd1021 smart_failure[2575401]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 09 14:34:03 cloudcephosd1021 smart_failure[2620761]: Device: /dev/sdg [SAT], 1720 Offline uncorrectable sectors
Sep 09 18:04:03 cloudcephosd1021 smart_failure[2700241]: Device: /dev/sdc [SAT], 1184 Offline uncorrectable sectors
Sep 09 20:34:03 cloudcephosd1021 smart_failure[2756608]: Device: /dev/sdi [SAT], 1656 Offline uncorrectable sectors
Sep 09 21:04:04 cloudcephosd1021 smart_failure[2768169]: Device: /dev/sdj [SAT], 448 Offline uncorrectable sectors (changed +8)
Sep 09 21:34:03 cloudcephosd1021 smart_failure[2779471]: Device: /dev/sdf [SAT], 1672 Offline uncorrectable sectors
Sep 10 01:34:03 cloudcephosd1021 smart_failure[2870962]: Device: /dev/sde [SAT], 960 Offline uncorrectable sectors
Sep 10 09:34:03 cloudcephosd1021 smart_failure[3053152]: Device: /dev/sdh [SAT], 1336 Offline uncorrectable sectors
Sep 10 12:34:03 cloudcephosd1021 smart_failure[3121523]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 10 14:34:03 cloudcephosd1021 smart_failure[3167215]: Device: /dev/sdg [SAT], 1720 Offline uncorrectable sectors
Sep 10 18:04:03 cloudcephosd1021 smart_failure[3246855]: Device: /dev/sdc [SAT], 1184 Offline uncorrectable sectors
Sep 10 20:34:03 cloudcephosd1021 smart_failure[3303468]: Device: /dev/sdi [SAT], 1656 Offline uncorrectable sectors
Sep 10 21:34:03 cloudcephosd1021 smart_failure[3326080]: Device: /dev/sdf [SAT], 1680 Offline uncorrectable sectors
Sep 10 21:34:03 cloudcephosd1021 smart_failure[3326128]: Device: /dev/sdj [SAT], 448 Offline uncorrectable sectors
Sep 11 01:34:04 cloudcephosd1021 smart_failure[3417543]: Device: /dev/sde [SAT], 960 Offline uncorrectable sectors
Sep 11 09:34:03 cloudcephosd1021 smart_failure[3599091]: Device: /dev/sdh [SAT], 1336 Offline uncorrectable sectors
Sep 11 12:34:03 cloudcephosd1021 smart_failure[3667506]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 11 14:34:03 cloudcephosd1021 smart_failure[3712300]: Device: /dev/sdg [SAT], 1728 Offline uncorrectable sectors
Sep 11 18:04:03 cloudcephosd1021 smart_failure[3791387]: Device: /dev/sdc [SAT], 1184 Offline uncorrectable sectors
Sep 11 20:34:03 cloudcephosd1021 smart_failure[3848158]: Device: /dev/sdi [SAT], 1664 Offline uncorrectable sectors
Sep 11 21:34:03 cloudcephosd1021 smart_failure[3870891]: Device: /dev/sdf [SAT], 1688 Offline uncorrectable sectors
Sep 11 21:34:03 cloudcephosd1021 smart_failure[3870910]: Device: /dev/sdj [SAT], 456 Offline uncorrectable sectors
Sep 12 02:04:03 cloudcephosd1021 smart_failure[3972119]: Device: /dev/sde [SAT], 968 Offline uncorrectable sectors
Sep 12 09:34:03 cloudcephosd1021 smart_failure[4141434]: Device: /dev/sdh [SAT], 1336 Offline uncorrectable sectors
Sep 12 12:34:03 cloudcephosd1021 smart_failure[15413]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 12 14:34:03 cloudcephosd1021 smart_failure[60460]: Device: /dev/sdg [SAT], 1736 Offline uncorrectable sectors
Sep 12 18:04:03 cloudcephosd1021 smart_failure[139206]: Device: /dev/sdc [SAT], 1192 Offline uncorrectable sectors
Sep 12 20:34:03 cloudcephosd1021 smart_failure[195591]: Device: /dev/sdi [SAT], 1672 Offline uncorrectable sectors
Sep 12 21:34:03 cloudcephosd1021 smart_failure[217762]: Device: /dev/sdf [SAT], 1688 Offline uncorrectable sectors
Sep 12 21:34:03 cloudcephosd1021 smart_failure[217811]: Device: /dev/sdj [SAT], 456 Offline uncorrectable sectors
Sep 13 02:04:03 cloudcephosd1021 smart_failure[319545]: Device: /dev/sde [SAT], 968 Offline uncorrectable sectors
Sep 13 09:34:03 cloudcephosd1021 smart_failure[489269]: Device: /dev/sdh [SAT], 1344 Offline uncorrectable sectors
Sep 13 12:34:03 cloudcephosd1021 smart_failure[556523]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 13 14:34:03 cloudcephosd1021 smart_failure[601960]: Device: /dev/sdg [SAT], 1736 Offline uncorrectable sectors
Sep 13 18:04:03 cloudcephosd1021 smart_failure[680533]: Device: /dev/sdc [SAT], 1192 Offline uncorrectable sectors
Sep 13 20:34:03 cloudcephosd1021 smart_failure[736983]: Device: /dev/sdi [SAT], 1672 Offline uncorrectable sectors
Sep 13 21:34:03 cloudcephosd1021 smart_failure[759806]: Device: /dev/sdf [SAT], 1688 Offline uncorrectable sectors
Sep 13 21:34:03 cloudcephosd1021 smart_failure[759825]: Device: /dev/sdj [SAT], 456 Offline uncorrectable sectors
Sep 14 02:04:03 cloudcephosd1021 smart_failure[861395]: Device: /dev/sde [SAT], 968 Offline uncorrectable sectors
Sep 14 09:34:03 cloudcephosd1021 smart_failure[1031520]: Device: /dev/sdh [SAT], 1344 Offline uncorrectable sectors
Sep 14 12:34:04 cloudcephosd1021 smart_failure[1098890]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 14 14:34:03 cloudcephosd1021 smart_failure[1143747]: Device: /dev/sdg [SAT], 1744 Offline uncorrectable sectors
Sep 14 18:04:03 cloudcephosd1021 smart_failure[1223041]: Device: /dev/sdc [SAT], 1192 Offline uncorrectable sectors
Sep 14 20:34:03 cloudcephosd1021 smart_failure[1279555]: Device: /dev/sdi [SAT], 1680 Offline uncorrectable sectors
Sep 14 21:34:03 cloudcephosd1021 smart_failure[1302043]: Device: /dev/sdf [SAT], 1696 Offline uncorrectable sectors
Sep 14 21:34:03 cloudcephosd1021 smart_failure[1302092]: Device: /dev/sdj [SAT], 456 Offline uncorrectable sectors
Sep 15 02:04:03 cloudcephosd1021 smart_failure[1404485]: Device: /dev/sde [SAT], 968 Offline uncorrectable sectors
Sep 15 09:34:03 cloudcephosd1021 smart_failure[1573969]: Device: /dev/sdh [SAT], 1344 Offline uncorrectable sectors
Sep 15 13:04:03 cloudcephosd1021 smart_failure[1653175]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 15 14:34:03 cloudcephosd1021 smart_failure[1687152]: Device: /dev/sdg [SAT], 1744 Offline uncorrectable sectors
Sep 15 18:04:03 cloudcephosd1021 smart_failure[1766069]: Device: /dev/sdc [SAT], 1200 Offline uncorrectable sectors
Sep 15 20:34:03 cloudcephosd1021 smart_failure[1822967]: Device: /dev/sdi [SAT], 1688 Offline uncorrectable sectors
Sep 15 21:34:03 cloudcephosd1021 smart_failure[1845442]: Device: /dev/sdf [SAT], 1704 Offline uncorrectable sectors
Sep 15 21:34:03 cloudcephosd1021 smart_failure[1845490]: Device: /dev/sdj [SAT], 456 Offline uncorrectable sectors
Sep 16 02:04:03 cloudcephosd1021 smart_failure[1947719]: Device: /dev/sde [SAT], 968 Offline uncorrectable sectors
Sep 16 09:34:03 cloudcephosd1021 smart_failure[2117344]: Device: /dev/sdh [SAT], 1344 Offline uncorrectable sectors
Sep 16 13:04:03 cloudcephosd1021 smart_failure[2196151]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 16 14:34:03 cloudcephosd1021 smart_failure[2230325]: Device: /dev/sdg [SAT], 1752 Offline uncorrectable sectors
Sep 16 18:04:03 cloudcephosd1021 smart_failure[2309011]: Device: /dev/sdc [SAT], 1216 Offline uncorrectable sectors
Sep 16 20:34:03 cloudcephosd1021 smart_failure[2365668]: Device: /dev/sdi [SAT], 1688 Offline uncorrectable sectors
Sep 16 21:34:03 cloudcephosd1021 smart_failure[2388314]: Device: /dev/sdf [SAT], 1712 Offline uncorrectable sectors
Sep 16 21:34:03 cloudcephosd1021 smart_failure[2388372]: Device: /dev/sdj [SAT], 456 Offline uncorrectable sectors
Sep 17 02:04:03 cloudcephosd1021 smart_failure[2489931]: Device: /dev/sde [SAT], 976 Offline uncorrectable sectors
Sep 17 09:34:03 cloudcephosd1021 smart_failure[2659394]: Device: /dev/sdh [SAT], 1344 Offline uncorrectable sectors
Sep 17 13:04:03 cloudcephosd1021 smart_failure[2738313]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 17 14:34:03 cloudcephosd1021 smart_failure[2772308]: Device: /dev/sdg [SAT], 1776 Offline uncorrectable sectors
Sep 17 18:04:03 cloudcephosd1021 smart_failure[2851088]: Device: /dev/sdc [SAT], 1216 Offline uncorrectable sectors
Sep 17 20:34:03 cloudcephosd1021 smart_failure[2907659]: Device: /dev/sdi [SAT], 1688 Offline uncorrectable sectors
Sep 17 21:34:03 cloudcephosd1021 smart_failure[2930298]: Device: /dev/sdf [SAT], 1712 Offline uncorrectable sectors
Sep 17 21:34:03 cloudcephosd1021 smart_failure[2930347]: Device: /dev/sdj [SAT], 456 Offline uncorrectable sectors
Sep 18 02:04:03 cloudcephosd1021 smart_failure[3032190]: Device: /dev/sde [SAT], 976 Offline uncorrectable sectors
Sep 18 09:34:03 cloudcephosd1021 smart_failure[3201265]: Device: /dev/sdh [SAT], 1360 Offline uncorrectable sectors
Sep 18 13:04:03 cloudcephosd1021 smart_failure[3280457]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 18 14:34:03 cloudcephosd1021 smart_failure[3314482]: Device: /dev/sdg [SAT], 1792 Offline uncorrectable sectors
Sep 18 18:04:03 cloudcephosd1021 smart_failure[3393173]: Device: /dev/sdc [SAT], 1216 Offline uncorrectable sectors
Sep 18 20:34:03 cloudcephosd1021 smart_failure[3449225]: Device: /dev/sdi [SAT], 1688 Offline uncorrectable sectors
Sep 18 21:34:03 cloudcephosd1021 smart_failure[3471826]: Device: /dev/sdf [SAT], 1744 Offline uncorrectable sectors
Sep 18 21:34:03 cloudcephosd1021 smart_failure[3471876]: Device: /dev/sdj [SAT], 456 Offline uncorrectable sectors
Sep 19 02:04:03 cloudcephosd1021 smart_failure[3573520]: Device: /dev/sde [SAT], 976 Offline uncorrectable sectors
Sep 19 09:34:03 cloudcephosd1021 smart_failure[3742703]: Device: /dev/sdh [SAT], 1360 Offline uncorrectable sectors
Sep 19 13:04:03 cloudcephosd1021 smart_failure[3821469]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 19 14:34:03 cloudcephosd1021 smart_failure[3855830]: Device: /dev/sdg [SAT], 1792 Offline uncorrectable sectors
Sep 19 18:04:03 cloudcephosd1021 smart_failure[3935508]: Device: /dev/sdc [SAT], 1224 Offline uncorrectable sectors
Sep 19 20:34:03 cloudcephosd1021 smart_failure[3992848]: Device: /dev/sdi [SAT], 1704 Offline uncorrectable sectors
Sep 19 21:34:03 cloudcephosd1021 smart_failure[4015604]: Device: /dev/sdf [SAT], 1744 Offline uncorrectable sectors
Sep 19 21:34:03 cloudcephosd1021 smart_failure[4015654]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 20 02:04:03 cloudcephosd1021 smart_failure[4118602]: Device: /dev/sde [SAT], 976 Offline uncorrectable sectors
Sep 20 09:34:03 cloudcephosd1021 smart_failure[95337]: Device: /dev/sdh [SAT], 1368 Offline uncorrectable sectors
Sep 20 13:04:03 cloudcephosd1021 smart_failure[174307]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 20 14:34:03 cloudcephosd1021 smart_failure[208659]: Device: /dev/sdg [SAT], 1792 Offline uncorrectable sectors
Sep 20 18:04:03 cloudcephosd1021 smart_failure[287167]: Device: /dev/sdc [SAT], 1224 Offline uncorrectable sectors
Sep 20 20:34:03 cloudcephosd1021 smart_failure[343813]: Device: /dev/sdi [SAT], 1712 Offline uncorrectable sectors
Sep 20 21:34:03 cloudcephosd1021 smart_failure[366556]: Device: /dev/sdf [SAT], 1768 Offline uncorrectable sectors
Sep 20 21:34:03 cloudcephosd1021 smart_failure[366604]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 21 02:04:03 cloudcephosd1021 smart_failure[468749]: Device: /dev/sde [SAT], 984 Offline uncorrectable sectors
Sep 21 09:34:03 cloudcephosd1021 smart_failure[637805]: Device: /dev/sdh [SAT], 1368 Offline uncorrectable sectors
Sep 21 13:04:03 cloudcephosd1021 smart_failure[716714]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 21 14:34:03 cloudcephosd1021 smart_failure[750950]: Device: /dev/sdg [SAT], 1800 Offline uncorrectable sectors
Sep 21 18:04:03 cloudcephosd1021 smart_failure[830766]: Device: /dev/sdc [SAT], 1224 Offline uncorrectable sectors
Sep 21 20:34:03 cloudcephosd1021 smart_failure[886887]: Device: /dev/sdi [SAT], 1712 Offline uncorrectable sectors
Sep 21 21:34:03 cloudcephosd1021 smart_failure[909639]: Device: /dev/sdf [SAT], 1784 Offline uncorrectable sectors
Sep 21 21:34:03 cloudcephosd1021 smart_failure[909689]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 22 02:04:03 cloudcephosd1021 smart_failure[1011090]: Device: /dev/sde [SAT], 984 Offline uncorrectable sectors
Sep 22 09:34:03 cloudcephosd1021 smart_failure[1180956]: Device: /dev/sdh [SAT], 1368 Offline uncorrectable sectors
Sep 22 13:04:03 cloudcephosd1021 smart_failure[1259244]: Device: /dev/sdd [SAT], 528 Offline uncorrectable sectors
Sep 22 14:34:03 cloudcephosd1021 smart_failure[1293384]: Device: /dev/sdg [SAT], 1800 Offline uncorrectable sectors
Sep 22 18:04:03 cloudcephosd1021 smart_failure[1372707]: Device: /dev/sdc [SAT], 1224 Offline uncorrectable sectors
Sep 22 20:34:03 cloudcephosd1021 smart_failure[1429156]: Device: /dev/sdi [SAT], 1712 Offline uncorrectable sectors
Sep 22 21:34:03 cloudcephosd1021 smart_failure[1451622]: Device: /dev/sdf [SAT], 1784 Offline uncorrectable sectors
Sep 22 21:34:03 cloudcephosd1021 smart_failure[1451671]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 23 02:04:03 cloudcephosd1021 smart_failure[1553256]: Device: /dev/sde [SAT], 984 Offline uncorrectable sectors
Sep 23 09:34:03 cloudcephosd1021 smart_failure[1723149]: Device: /dev/sdh [SAT], 1384 Offline uncorrectable sectors
Sep 23 13:04:03 cloudcephosd1021 smart_failure[1801509]: Device: /dev/sdd [SAT], 536 Offline uncorrectable sectors
Sep 23 14:34:03 cloudcephosd1021 smart_failure[1835201]: Device: /dev/sdg [SAT], 1816 Offline uncorrectable sectors
Sep 23 18:04:03 cloudcephosd1021 smart_failure[1913894]: Device: /dev/sdc [SAT], 1240 Offline uncorrectable sectors
Sep 23 20:34:03 cloudcephosd1021 smart_failure[1970283]: Device: /dev/sdi [SAT], 1712 Offline uncorrectable sectors
Sep 23 21:34:03 cloudcephosd1021 smart_failure[1992640]: Device: /dev/sdf [SAT], 1792 Offline uncorrectable sectors
Sep 23 21:34:03 cloudcephosd1021 smart_failure[1992691]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 24 02:04:03 cloudcephosd1021 smart_failure[2094253]: Device: /dev/sde [SAT], 984 Offline uncorrectable sectors
Sep 24 09:34:03 cloudcephosd1021 smart_failure[2263675]: Device: /dev/sdh [SAT], 1392 Offline uncorrectable sectors
Sep 24 13:04:03 cloudcephosd1021 smart_failure[2341636]: Device: /dev/sdd [SAT], 536 Offline uncorrectable sectors
Sep 24 14:34:03 cloudcephosd1021 smart_failure[2375204]: Device: /dev/sdg [SAT], 1824 Offline uncorrectable sectors
Sep 24 18:04:03 cloudcephosd1021 smart_failure[2454057]: Device: /dev/sdc [SAT], 1248 Offline uncorrectable sectors
Sep 24 20:34:03 cloudcephosd1021 smart_failure[2510928]: Device: /dev/sdi [SAT], 1728 Offline uncorrectable sectors
Sep 24 21:34:03 cloudcephosd1021 smart_failure[2533281]: Device: /dev/sdf [SAT], 1800 Offline uncorrectable sectors
Sep 24 21:34:03 cloudcephosd1021 smart_failure[2533329]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 25 02:04:03 cloudcephosd1021 smart_failure[2634478]: Device: /dev/sde [SAT], 984 Offline uncorrectable sectors
Sep 25 09:34:03 cloudcephosd1021 smart_failure[2803647]: Device: /dev/sdh [SAT], 1392 Offline uncorrectable sectors
Sep 25 13:04:03 cloudcephosd1021 smart_failure[2882627]: Device: /dev/sdd [SAT], 544 Offline uncorrectable sectors
Sep 25 14:34:03 cloudcephosd1021 smart_failure[2916824]: Device: /dev/sdg [SAT], 1824 Offline uncorrectable sectors
Sep 25 18:04:03 cloudcephosd1021 smart_failure[2995613]: Device: /dev/sdc [SAT], 1248 Offline uncorrectable sectors
Sep 25 20:34:03 cloudcephosd1021 smart_failure[3051954]: Device: /dev/sdi [SAT], 1728 Offline uncorrectable sectors
Sep 25 21:34:03 cloudcephosd1021 smart_failure[3074595]: Device: /dev/sdf [SAT], 1800 Offline uncorrectable sectors
Sep 25 21:34:03 cloudcephosd1021 smart_failure[3074644]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 26 02:04:03 cloudcephosd1021 smart_failure[3175887]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Sep 26 09:34:03 cloudcephosd1021 smart_failure[3345170]: Device: /dev/sdh [SAT], 1400 Offline uncorrectable sectors
Sep 26 13:04:03 cloudcephosd1021 smart_failure[3424141]: Device: /dev/sdd [SAT], 544 Offline uncorrectable sectors
Sep 26 14:34:03 cloudcephosd1021 smart_failure[3458231]: Device: /dev/sdg [SAT], 1824 Offline uncorrectable sectors
Sep 26 18:04:03 cloudcephosd1021 smart_failure[3536571]: Device: /dev/sdc [SAT], 1272 Offline uncorrectable sectors
Sep 26 20:34:03 cloudcephosd1021 smart_failure[3592805]: Device: /dev/sdi [SAT], 1728 Offline uncorrectable sectors
Sep 26 21:34:03 cloudcephosd1021 smart_failure[3615396]: Device: /dev/sdf [SAT], 1800 Offline uncorrectable sectors
Sep 26 21:34:04 cloudcephosd1021 smart_failure[3615445]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 27 02:04:03 cloudcephosd1021 smart_failure[3716594]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Sep 27 09:34:03 cloudcephosd1021 smart_failure[3884550]: Device: /dev/sdh [SAT], 1400 Offline uncorrectable sectors
Sep 27 13:04:03 cloudcephosd1021 smart_failure[3963560]: Device: /dev/sdd [SAT], 544 Offline uncorrectable sectors
Sep 27 14:34:03 cloudcephosd1021 smart_failure[3997891]: Device: /dev/sdg [SAT], 1848 Offline uncorrectable sectors
Sep 27 18:04:03 cloudcephosd1021 smart_failure[4076830]: Device: /dev/sdc [SAT], 1272 Offline uncorrectable sectors
Sep 27 20:34:03 cloudcephosd1021 smart_failure[4132675]: Device: /dev/sdi [SAT], 1728 Offline uncorrectable sectors
Sep 27 21:34:03 cloudcephosd1021 smart_failure[4155379]: Device: /dev/sdf [SAT], 1800 Offline uncorrectable sectors
Sep 27 21:34:03 cloudcephosd1021 smart_failure[4155428]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 28 02:04:03 cloudcephosd1021 smart_failure[63196]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Sep 28 09:34:03 cloudcephosd1021 smart_failure[231713]: Device: /dev/sdh [SAT], 1408 Offline uncorrectable sectors
Sep 28 13:04:03 cloudcephosd1021 smart_failure[310861]: Device: /dev/sdd [SAT], 544 Offline uncorrectable sectors
Sep 28 14:34:03 cloudcephosd1021 smart_failure[344480]: Device: /dev/sdg [SAT], 1864 Offline uncorrectable sectors
Sep 28 18:04:03 cloudcephosd1021 smart_failure[423374]: Device: /dev/sdc [SAT], 1272 Offline uncorrectable sectors
Sep 28 20:34:03 cloudcephosd1021 smart_failure[479913]: Device: /dev/sdi [SAT], 1728 Offline uncorrectable sectors
Sep 28 21:34:03 cloudcephosd1021 smart_failure[502273]: Device: /dev/sdf [SAT], 1800 Offline uncorrectable sectors
Sep 28 21:34:03 cloudcephosd1021 smart_failure[502321]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 29 02:04:03 cloudcephosd1021 smart_failure[603266]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Sep 29 09:34:03 cloudcephosd1021 smart_failure[771657]: Device: /dev/sdh [SAT], 1416 Offline uncorrectable sectors
Sep 29 13:04:03 cloudcephosd1021 smart_failure[849010]: Device: /dev/sdd [SAT], 544 Offline uncorrectable sectors
Sep 29 14:34:03 cloudcephosd1021 smart_failure[882432]: Device: /dev/sdg [SAT], 1864 Offline uncorrectable sectors
Sep 29 18:04:03 cloudcephosd1021 smart_failure[960797]: Device: /dev/sdc [SAT], 1272 Offline uncorrectable sectors
Sep 29 20:34:03 cloudcephosd1021 smart_failure[1017186]: Device: /dev/sdi [SAT], 1728 Offline uncorrectable sectors
Sep 29 21:34:03 cloudcephosd1021 smart_failure[1039716]: Device: /dev/sdf [SAT], 1800 Offline uncorrectable sectors
Sep 29 21:34:03 cloudcephosd1021 smart_failure[1039764]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
Sep 30 02:04:03 cloudcephosd1021 smart_failure[1140323]: Device: /dev/sde [SAT], 992 Offline uncorrectable sectors
Sep 30 09:34:03 cloudcephosd1021 smart_failure[1309236]: Device: /dev/sdh [SAT], 1416 Offline uncorrectable sectors
Sep 30 13:04:03 cloudcephosd1021 smart_failure[1387478]: Device: /dev/sdd [SAT], 544 Offline uncorrectable sectors
Sep 30 14:34:03 cloudcephosd1021 smart_failure[1421444]: Device: /dev/sdg [SAT], 1872 Offline uncorrectable sectors (changed +8)
Sep 30 18:04:03 cloudcephosd1021 smart_failure[1499685]: Device: /dev/sdc [SAT], 1272 Offline uncorrectable sectors
Sep 30 20:34:03 cloudcephosd1021 smart_failure[1556241]: Device: /dev/sdi [SAT], 1728 Offline uncorrectable sectors
Sep 30 21:34:03 cloudcephosd1021 smart_failure[1578589]: Device: /dev/sdf [SAT], 1800 Offline uncorrectable sectors
Sep 30 21:34:03 cloudcephosd1021 smart_failure[1578638]: Device: /dev/sdj [SAT], 464 Offline uncorrectable sectors
===== NODE GROUP =====
(1) cloudcephosd1028.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 01 01:37:06 cloudcephosd1028 smart_failure[1397252]: Device: /dev/sde [SAT], 1816 Offline uncorrectable sectors
Oct 01 03:37:06 cloudcephosd1028 smart_failure[1441900]: Device: /dev/sdf [SAT], 5336 Offline uncorrectable sectors
Oct 01 06:07:06 cloudcephosd1028 smart_failure[1497664]: Device: /dev/sdi [SAT], 992 Offline uncorrectable sectors
Oct 01 09:37:06 cloudcephosd1028 smart_failure[1575638]: Device: /dev/sdh [SAT], 856 Offline uncorrectable sectors
Oct 01 17:37:06 cloudcephosd1028 smart_failure[1753963]: Device: /dev/sdg [SAT], 1864 Offline uncorrectable sectors
Oct 01 19:07:06 cloudcephosd1028 smart_failure[1787979]: Device: /dev/sdc [SAT], 1008 Offline uncorrectable sectors
Oct 01 19:07:06 cloudcephosd1028 smart_failure[1787998]: Device: /dev/sdd [SAT], 192 Offline uncorrectable sectors
Oct 01 22:37:06 cloudcephosd1028 smart_failure[1865509]: Device: /dev/sdj [SAT], 2920 Offline uncorrectable sectors
Oct 02 01:37:06 cloudcephosd1028 smart_failure[1932375]: Device: /dev/sde [SAT], 1824 Offline uncorrectable sectors
Oct 02 03:37:06 cloudcephosd1028 smart_failure[1976928]: Device: /dev/sdf [SAT], 5360 Offline uncorrectable sectors
Oct 02 06:07:06 cloudcephosd1028 smart_failure[2032407]: Device: /dev/sdi [SAT], 992 Offline uncorrectable sectors
Oct 02 09:37:06 cloudcephosd1028 smart_failure[2110215]: Device: /dev/sdh [SAT], 856 Offline uncorrectable sectors
Oct 02 17:37:06 cloudcephosd1028 smart_failure[2289792]: Device: /dev/sdg [SAT], 1872 Offline uncorrectable sectors
Oct 02 19:07:06 cloudcephosd1028 smart_failure[2323437]: Device: /dev/sdc [SAT], 1032 Offline uncorrectable sectors
Oct 02 19:07:06 cloudcephosd1028 smart_failure[2323482]: Device: /dev/sdd [SAT], 192 Offline uncorrectable sectors
Oct 02 22:37:06 cloudcephosd1028 smart_failure[2399442]: Device: /dev/sdj [SAT], 2936 Offline uncorrectable sectors
Oct 03 01:37:06 cloudcephosd1028 smart_failure[2459096]: Device: /dev/sde [SAT], 1824 Offline uncorrectable sectors
Oct 03 03:37:06 cloudcephosd1028 smart_failure[2503963]: Device: /dev/sdf [SAT], 5400 Offline uncorrectable sectors
Oct 03 06:07:06 cloudcephosd1028 smart_failure[2559517]: Device: /dev/sdi [SAT], 1000 Offline uncorrectable sectors
Oct 03 09:37:06 cloudcephosd1028 smart_failure[2637025]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Oct 03 17:37:06 cloudcephosd1028 smart_failure[2817100]: Device: /dev/sdg [SAT], 1872 Offline uncorrectable sectors
Oct 03 19:07:06 cloudcephosd1028 smart_failure[2850402]: Device: /dev/sdc [SAT], 1032 Offline uncorrectable sectors
Oct 03 19:07:06 cloudcephosd1028 smart_failure[2850421]: Device: /dev/sdd [SAT], 192 Offline uncorrectable sectors
Oct 03 22:37:06 cloudcephosd1028 smart_failure[2928677]: Device: /dev/sdj [SAT], 2968 Offline uncorrectable sectors
Oct 04 01:37:06 cloudcephosd1028 smart_failure[2995462]: Device: /dev/sde [SAT], 1824 Offline uncorrectable sectors
Oct 04 03:37:06 cloudcephosd1028 smart_failure[3039978]: Device: /dev/sdf [SAT], 5416 Offline uncorrectable sectors
Oct 04 06:07:06 cloudcephosd1028 smart_failure[3095525]: Device: /dev/sdi [SAT], 1008 Offline uncorrectable sectors
Oct 04 09:37:06 cloudcephosd1028 smart_failure[3174680]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Oct 04 17:37:06 cloudcephosd1028 smart_failure[3355165]: Device: /dev/sdg [SAT], 1880 Offline uncorrectable sectors
Oct 04 19:07:06 cloudcephosd1028 smart_failure[3388456]: Device: /dev/sdc [SAT], 1032 Offline uncorrectable sectors
Oct 04 19:07:06 cloudcephosd1028 smart_failure[3388475]: Device: /dev/sdd [SAT], 192 Offline uncorrectable sectors
Oct 04 22:37:07 cloudcephosd1028 smart_failure[3466964]: Device: /dev/sdj [SAT], 2968 Offline uncorrectable sectors
Oct 05 01:37:06 cloudcephosd1028 smart_failure[3534683]: Device: /dev/sde [SAT], 1832 Offline uncorrectable sectors
Oct 05 04:07:05 cloudcephosd1028 smart_failure[3590658]: Device: /dev/sdf [SAT], 5448 Offline uncorrectable sectors
Oct 05 06:37:05 cloudcephosd1028 smart_failure[3646964]: Device: /dev/sdi [SAT], 1016 Offline uncorrectable sectors
Oct 05 10:07:05 cloudcephosd1028 smart_failure[3725507]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Oct 05 18:07:05 cloudcephosd1028 smart_failure[3916793]: Device: /dev/sdg [SAT], 1888 Offline uncorrectable sectors
Oct 05 19:37:05 cloudcephosd1028 smart_failure[3950376]: Device: /dev/sdc [SAT], 1032 Offline uncorrectable sectors
Oct 05 19:37:05 cloudcephosd1028 smart_failure[3950424]: Device: /dev/sdd [SAT], 192 Offline uncorrectable sectors
Oct 05 23:07:05 cloudcephosd1028 smart_failure[4028413]: Device: /dev/sdj [SAT], 2976 Offline uncorrectable sectors
Oct 06 02:07:05 cloudcephosd1028 smart_failure[4095445]: Device: /dev/sde [SAT], 1832 Offline uncorrectable sectors
Oct 06 04:07:05 cloudcephosd1028 smart_failure[4140644]: Device: /dev/sdf [SAT], 5472 Offline uncorrectable sectors
Oct 06 06:37:05 cloudcephosd1028 smart_failure[3027]: Device: /dev/sdi [SAT], 1016 Offline uncorrectable sectors
Oct 06 10:07:05 cloudcephosd1028 smart_failure[81485]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Oct 06 18:07:05 cloudcephosd1028 smart_failure[262509]: Device: /dev/sdg [SAT], 1896 Offline uncorrectable sectors
Oct 06 19:37:05 cloudcephosd1028 smart_failure[296193]: Device: /dev/sdc [SAT], 1032 Offline uncorrectable sectors
Oct 06 19:37:05 cloudcephosd1028 smart_failure[296235]: Device: /dev/sdd [SAT], 192 Offline uncorrectable sectors
Oct 06 23:07:05 cloudcephosd1028 smart_failure[374563]: Device: /dev/sdj [SAT], 2976 Offline uncorrectable sectors
Oct 07 02:07:05 cloudcephosd1028 smart_failure[442435]: Device: /dev/sde [SAT], 1832 Offline uncorrectable sectors
Oct 07 04:07:05 cloudcephosd1028 smart_failure[487649]: Device: /dev/sdf [SAT], 5472 Offline uncorrectable sectors
Oct 07 06:37:05 cloudcephosd1028 smart_failure[543964]: Device: /dev/sdi [SAT], 1016 Offline uncorrectable sectors
Oct 07 10:07:05 cloudcephosd1028 smart_failure[623078]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Oct 07 18:07:05 cloudcephosd1028 smart_failure[803392]: Device: /dev/sdg [SAT], 1912 Offline uncorrectable sectors
Oct 07 19:37:05 cloudcephosd1028 smart_failure[837034]: Device: /dev/sdc [SAT], 1032 Offline uncorrectable sectors
Oct 07 19:37:05 cloudcephosd1028 smart_failure[837129]: Device: /dev/sdd [SAT], 192 Offline uncorrectable sectors
Oct 07 23:07:05 cloudcephosd1028 smart_failure[915848]: Device: /dev/sdj [SAT], 2976 Offline uncorrectable sectors
Oct 08 02:07:05 cloudcephosd1028 smart_failure[984036]: Device: /dev/sde [SAT], 1832 Offline uncorrectable sectors
Oct 08 04:07:05 cloudcephosd1028 smart_failure[1029015]: Device: /dev/sdf [SAT], 5504 Offline uncorrectable sectors
Oct 08 06:37:05 cloudcephosd1028 smart_failure[1085490]: Device: /dev/sdi [SAT], 1024 Offline uncorrectable sectors
Oct 08 10:07:05 cloudcephosd1028 smart_failure[1164335]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Oct 08 18:07:05 cloudcephosd1028 smart_failure[1344758]: Device: /dev/sdg [SAT], 1912 Offline uncorrectable sectors
Oct 08 19:37:05 cloudcephosd1028 smart_failure[1378522]: Device: /dev/sdc [SAT], 1032 Offline uncorrectable sectors
Oct 08 19:37:05 cloudcephosd1028 smart_failure[1378565]: Device: /dev/sdd [SAT], 192 Offline uncorrectable sectors
Oct 08 23:07:05 cloudcephosd1028 smart_failure[1457094]: Device: /dev/sdj [SAT], 2984 Offline uncorrectable sectors
Oct 09 02:07:05 cloudcephosd1028 smart_failure[1525223]: Device: /dev/sde [SAT], 1832 Offline uncorrectable sectors
Oct 09 04:07:05 cloudcephosd1028 smart_failure[1570438]: Device: /dev/sdf [SAT], 5520 Offline uncorrectable sectors
Oct 09 06:37:05 cloudcephosd1028 smart_failure[1626364]: Device: /dev/sdi [SAT], 1024 Offline uncorrectable sectors
Oct 09 10:07:05 cloudcephosd1028 smart_failure[1705039]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Oct 09 18:07:05 cloudcephosd1028 smart_failure[1885223]: Device: /dev/sdg [SAT], 1912 Offline uncorrectable sectors
Oct 09 19:37:05 cloudcephosd1028 smart_failure[1919210]: Device: /dev/sdc [SAT], 1032 Offline uncorrectable sectors
Oct 09 19:37:05 cloudcephosd1028 smart_failure[1919254]: Device: /dev/sdd [SAT], 192 Offline uncorrectable sectors
Oct 09 23:07:05 cloudcephosd1028 smart_failure[1998045]: Device: /dev/sdj [SAT], 2984 Offline uncorrectable sectors
Oct 10 02:07:05 cloudcephosd1028 smart_failure[2066106]: Device: /dev/sde [SAT], 1840 Offline uncorrectable sectors
Oct 10 04:07:05 cloudcephosd1028 smart_failure[2111139]: Device: /dev/sdf [SAT], 5528 Offline uncorrectable sectors
Oct 10 06:37:05 cloudcephosd1028 smart_failure[2167457]: Device: /dev/sdi [SAT], 1032 Offline uncorrectable sectors
Oct 10 10:07:05 cloudcephosd1028 smart_failure[2246590]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Oct 10 18:07:05 cloudcephosd1028 smart_failure[2427627]: Device: /dev/sdg [SAT], 1912 Offline uncorrectable sectors
Oct 10 19:37:05 cloudcephosd1028 smart_failure[2461710]: Device: /dev/sdc [SAT], 1032 Offline uncorrectable sectors
Oct 10 19:37:05 cloudcephosd1028 smart_failure[2461754]: Device: /dev/sdd [SAT], 192 Offline uncorrectable sectors
Oct 10 23:07:05 cloudcephosd1028 smart_failure[2541227]: Device: /dev/sdj [SAT], 2992 Offline uncorrectable sectors
Oct 11 02:07:05 cloudcephosd1028 smart_failure[2609238]: Device: /dev/sde [SAT], 1840 Offline uncorrectable sectors
Oct 11 04:07:05 cloudcephosd1028 smart_failure[2654675]: Device: /dev/sdf [SAT], 5528 Offline uncorrectable sectors
Oct 11 06:37:05 cloudcephosd1028 smart_failure[2711199]: Device: /dev/sdi [SAT], 1040 Offline uncorrectable sectors
Oct 11 10:07:05 cloudcephosd1028 smart_failure[2789769]: Device: /dev/sdh [SAT], 864 Offline uncorrectable sectors
Sep 09 09:37:06 cloudcephosd1028 smart_failure[2256452]: Device: /dev/sdh [SAT], 816 Offline uncorrectable sectors
Sep 09 17:37:06 cloudcephosd1028 smart_failure[2434897]: Device: /dev/sdg [SAT], 1704 Offline uncorrectable sectors
Sep 09 19:07:06 cloudcephosd1028 smart_failure[2468655]: Device: /dev/sdc [SAT], 968 Offline uncorrectable sectors
Sep 09 19:07:06 cloudcephosd1028 smart_failure[2468674]: Device: /dev/sdd [SAT], 176 Offline uncorrectable sectors
Sep 09 21:07:06 cloudcephosd1028 smart_failure[2512967]: Device: /dev/sdj [SAT], 2800 Offline uncorrectable sectors
Sep 10 00:37:07 cloudcephosd1028 smart_failure[2591710]: Device: /dev/sde [SAT], 1720 Offline uncorrectable sectors
Sep 10 03:37:06 cloudcephosd1028 smart_failure[2658745]: Device: /dev/sdf [SAT], 4936 Offline uncorrectable sectors (changed +8)
Sep 10 04:37:06 cloudcephosd1028 smart_failure[2681203]: Device: /dev/sdi [SAT], 888 Offline uncorrectable sectors
Sep 10 09:37:06 cloudcephosd1028 smart_failure[2793157]: Device: /dev/sdh [SAT], 816 Offline uncorrectable sectors
Sep 10 17:37:06 cloudcephosd1028 smart_failure[2972197]: Device: /dev/sdg [SAT], 1728 Offline uncorrectable sectors
Sep 10 19:07:06 cloudcephosd1028 smart_failure[3005477]: Device: /dev/sdc [SAT], 968 Offline uncorrectable sectors
Sep 10 19:07:06 cloudcephosd1028 smart_failure[3005520]: Device: /dev/sdd [SAT], 176 Offline uncorrectable sectors
Sep 10 21:07:06 cloudcephosd1028 smart_failure[3050267]: Device: /dev/sdj [SAT], 2808 Offline uncorrectable sectors
Sep 11 01:07:06 cloudcephosd1028 smart_failure[3139591]: Device: /dev/sde [SAT], 1720 Offline uncorrectable sectors
Sep 11 03:37:06 cloudcephosd1028 smart_failure[3195521]: Device: /dev/sdf [SAT], 4952 Offline uncorrectable sectors
Sep 11 04:37:06 cloudcephosd1028 smart_failure[3217960]: Device: /dev/sdi [SAT], 888 Offline uncorrectable sectors
Sep 11 09:37:06 cloudcephosd1028 smart_failure[3329791]: Device: /dev/sdh [SAT], 816 Offline uncorrectable sectors
Sep 11 17:37:06 cloudcephosd1028 smart_failure[3509951]: Device: /dev/sdg [SAT], 1760 Offline uncorrectable sectors
Sep 11 19:07:06 cloudcephosd1028 smart_failure[3543722]: Device: /dev/sdc [SAT], 968 Offline uncorrectable sectors
Sep 11 19:07:06 cloudcephosd1028 smart_failure[3543741]: Device: /dev/sdd [SAT], 176 Offline uncorrectable sectors
Sep 11 21:07:06 cloudcephosd1028 smart_failure[3588708]: Device: /dev/sdj [SAT], 2808 Offline uncorrectable sectors
Sep 12 01:07:07 cloudcephosd1028 smart_failure[3679073]: Device: /dev/sde [SAT], 1728 Offline uncorrectable sectors
Sep 12 03:37:06 cloudcephosd1028 smart_failure[3735468]: Device: /dev/sdf [SAT], 4968 Offline uncorrectable sectors
Sep 12 04:37:06 cloudcephosd1028 smart_failure[3758383]: Device: /dev/sdi [SAT], 888 Offline uncorrectable sectors
Sep 12 09:37:06 cloudcephosd1028 smart_failure[3871090]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 12 17:37:06 cloudcephosd1028 smart_failure[4052065]: Device: /dev/sdg [SAT], 1768 Offline uncorrectable sectors
Sep 12 19:07:06 cloudcephosd1028 smart_failure[4086157]: Device: /dev/sdc [SAT], 984 Offline uncorrectable sectors
Sep 12 19:07:06 cloudcephosd1028 smart_failure[4086176]: Device: /dev/sdd [SAT], 176 Offline uncorrectable sectors
Sep 12 21:07:06 cloudcephosd1028 smart_failure[4131651]: Device: /dev/sdj [SAT], 2816 Offline uncorrectable sectors
Sep 13 01:37:06 cloudcephosd1028 smart_failure[40447]: Device: /dev/sde [SAT], 1736 Offline uncorrectable sectors
Sep 13 03:37:06 cloudcephosd1028 smart_failure[86217]: Device: /dev/sdf [SAT], 4976 Offline uncorrectable sectors
Sep 13 04:37:06 cloudcephosd1028 smart_failure[109053]: Device: /dev/sdi [SAT], 888 Offline uncorrectable sectors
Sep 13 09:37:06 cloudcephosd1028 smart_failure[222427]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 13 17:37:06 cloudcephosd1028 smart_failure[402963]: Device: /dev/sdg [SAT], 1768 Offline uncorrectable sectors
Sep 13 19:07:06 cloudcephosd1028 smart_failure[436922]: Device: /dev/sdc [SAT], 984 Offline uncorrectable sectors
Sep 13 19:07:06 cloudcephosd1028 smart_failure[436966]: Device: /dev/sdd [SAT], 176 Offline uncorrectable sectors
Sep 13 21:07:06 cloudcephosd1028 smart_failure[482858]: Device: /dev/sdj [SAT], 2816 Offline uncorrectable sectors
Sep 14 01:37:07 cloudcephosd1028 smart_failure[584635]: Device: /dev/sde [SAT], 1736 Offline uncorrectable sectors
Sep 14 03:37:06 cloudcephosd1028 smart_failure[629213]: Device: /dev/sdf [SAT], 4984 Offline uncorrectable sectors
Sep 14 04:37:06 cloudcephosd1028 smart_failure[652066]: Device: /dev/sdi [SAT], 888 Offline uncorrectable sectors
Sep 14 09:37:06 cloudcephosd1028 smart_failure[765169]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 14 17:37:07 cloudcephosd1028 smart_failure[945825]: Device: /dev/sdg [SAT], 1768 Offline uncorrectable sectors
Sep 14 19:07:06 cloudcephosd1028 smart_failure[979857]: Device: /dev/sdc [SAT], 984 Offline uncorrectable sectors
Sep 14 19:07:06 cloudcephosd1028 smart_failure[979876]: Device: /dev/sdd [SAT], 176 Offline uncorrectable sectors
Sep 14 21:07:06 cloudcephosd1028 smart_failure[1025485]: Device: /dev/sdj [SAT], 2816 Offline uncorrectable sectors
Sep 15 01:37:06 cloudcephosd1028 smart_failure[1126160]: Device: /dev/sde [SAT], 1736 Offline uncorrectable sectors
Sep 15 03:37:06 cloudcephosd1028 smart_failure[1171649]: Device: /dev/sdf [SAT], 5024 Offline uncorrectable sectors
Sep 15 04:37:06 cloudcephosd1028 smart_failure[1194213]: Device: /dev/sdi [SAT], 888 Offline uncorrectable sectors
Sep 15 09:37:07 cloudcephosd1028 smart_failure[1307532]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 15 17:37:06 cloudcephosd1028 smart_failure[1488925]: Device: /dev/sdg [SAT], 1768 Offline uncorrectable sectors
Sep 15 19:07:06 cloudcephosd1028 smart_failure[1523318]: Device: /dev/sdc [SAT], 984 Offline uncorrectable sectors
Sep 15 19:07:06 cloudcephosd1028 smart_failure[1523337]: Device: /dev/sdd [SAT], 176 Offline uncorrectable sectors
Sep 15 21:07:06 cloudcephosd1028 smart_failure[1568726]: Device: /dev/sdj [SAT], 2816 Offline uncorrectable sectors
Sep 16 01:37:07 cloudcephosd1028 smart_failure[1671355]: Device: /dev/sde [SAT], 1736 Offline uncorrectable sectors
Sep 16 03:37:06 cloudcephosd1028 smart_failure[1716984]: Device: /dev/sdf [SAT], 5040 Offline uncorrectable sectors
Sep 16 04:37:06 cloudcephosd1028 smart_failure[1739782]: Device: /dev/sdi [SAT], 896 Offline uncorrectable sectors
Sep 16 09:37:06 cloudcephosd1028 smart_failure[1853787]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 16 17:37:06 cloudcephosd1028 smart_failure[2035101]: Device: /dev/sdg [SAT], 1768 Offline uncorrectable sectors
Sep 16 19:07:06 cloudcephosd1028 smart_failure[2069224]: Device: /dev/sdc [SAT], 992 Offline uncorrectable sectors
Sep 16 19:07:06 cloudcephosd1028 smart_failure[2069267]: Device: /dev/sdd [SAT], 176 Offline uncorrectable sectors
Sep 16 21:07:06 cloudcephosd1028 smart_failure[2114865]: Device: /dev/sdj [SAT], 2816 Offline uncorrectable sectors
Sep 17 01:37:06 cloudcephosd1028 smart_failure[2217200]: Device: /dev/sde [SAT], 1736 Offline uncorrectable sectors
Sep 17 03:37:06 cloudcephosd1028 smart_failure[2262780]: Device: /dev/sdf [SAT], 5064 Offline uncorrectable sectors
Sep 17 04:37:06 cloudcephosd1028 smart_failure[2285566]: Device: /dev/sdi [SAT], 896 Offline uncorrectable sectors
Sep 17 09:37:06 cloudcephosd1028 smart_failure[2398735]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 17 17:37:06 cloudcephosd1028 smart_failure[2580212]: Device: /dev/sdg [SAT], 1768 Offline uncorrectable sectors
Sep 17 19:07:06 cloudcephosd1028 smart_failure[2614336]: Device: /dev/sdc [SAT], 992 Offline uncorrectable sectors
Sep 17 19:07:06 cloudcephosd1028 smart_failure[2614355]: Device: /dev/sdd [SAT], 176 Offline uncorrectable sectors
Sep 17 21:07:06 cloudcephosd1028 smart_failure[2659940]: Device: /dev/sdj [SAT], 2816 Offline uncorrectable sectors
Sep 18 01:37:06 cloudcephosd1028 smart_failure[2762499]: Device: /dev/sde [SAT], 1752 Offline uncorrectable sectors
Sep 18 03:37:07 cloudcephosd1028 smart_failure[2808120]: Device: /dev/sdf [SAT], 5104 Offline uncorrectable sectors
Sep 18 04:37:06 cloudcephosd1028 smart_failure[2830894]: Device: /dev/sdi [SAT], 904 Offline uncorrectable sectors
Sep 18 09:37:06 cloudcephosd1028 smart_failure[2943846]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 18 17:37:06 cloudcephosd1028 smart_failure[3124221]: Device: /dev/sdg [SAT], 1768 Offline uncorrectable sectors
Sep 18 19:07:06 cloudcephosd1028 smart_failure[3158755]: Device: /dev/sdc [SAT], 992 Offline uncorrectable sectors
Sep 18 19:07:06 cloudcephosd1028 smart_failure[3158774]: Device: /dev/sdd [SAT], 176 Offline uncorrectable sectors
Sep 18 21:07:06 cloudcephosd1028 smart_failure[3204463]: Device: /dev/sdj [SAT], 2824 Offline uncorrectable sectors
Sep 19 01:37:06 cloudcephosd1028 smart_failure[3307200]: Device: /dev/sde [SAT], 1752 Offline uncorrectable sectors
Sep 19 03:37:06 cloudcephosd1028 smart_failure[3353195]: Device: /dev/sdf [SAT], 5120 Offline uncorrectable sectors
Sep 19 04:37:06 cloudcephosd1028 smart_failure[3376076]: Device: /dev/sdi [SAT], 904 Offline uncorrectable sectors
Sep 19 09:37:06 cloudcephosd1028 smart_failure[3489595]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 19 17:37:06 cloudcephosd1028 smart_failure[3671381]: Device: /dev/sdg [SAT], 1768 Offline uncorrectable sectors
Sep 19 19:07:06 cloudcephosd1028 smart_failure[3705647]: Device: /dev/sdc [SAT], 992 Offline uncorrectable sectors
Sep 19 19:07:06 cloudcephosd1028 smart_failure[3705689]: Device: /dev/sdd [SAT], 176 Offline uncorrectable sectors
Sep 19 21:07:06 cloudcephosd1028 smart_failure[3751579]: Device: /dev/sdj [SAT], 2840 Offline uncorrectable sectors
Sep 20 01:37:06 cloudcephosd1028 smart_failure[3854658]: Device: /dev/sde [SAT], 1752 Offline uncorrectable sectors
Sep 20 03:37:06 cloudcephosd1028 smart_failure[3899775]: Device: /dev/sdf [SAT], 5144 Offline uncorrectable sectors
Sep 20 04:37:07 cloudcephosd1028 smart_failure[3922615]: Device: /dev/sdi [SAT], 904 Offline uncorrectable sectors
Sep 20 09:37:06 cloudcephosd1028 smart_failure[4035795]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 20 17:37:06 cloudcephosd1028 smart_failure[21680]: Device: /dev/sdg [SAT], 1768 Offline uncorrectable sectors
Sep 20 19:07:06 cloudcephosd1028 smart_failure[55562]: Device: /dev/sdc [SAT], 992 Offline uncorrectable sectors
Sep 20 19:07:06 cloudcephosd1028 smart_failure[55581]: Device: /dev/sdd [SAT], 176 Offline uncorrectable sectors
Sep 20 21:07:07 cloudcephosd1028 smart_failure[100750]: Device: /dev/sdj [SAT], 2840 Offline uncorrectable sectors
Sep 21 01:37:06 cloudcephosd1028 smart_failure[202547]: Device: /dev/sde [SAT], 1752 Offline uncorrectable sectors
Sep 21 03:37:06 cloudcephosd1028 smart_failure[247415]: Device: /dev/sdf [SAT], 5160 Offline uncorrectable sectors
Sep 21 05:07:06 cloudcephosd1028 smart_failure[281256]: Device: /dev/sdi [SAT], 928 Offline uncorrectable sectors
Sep 21 09:37:06 cloudcephosd1028 smart_failure[382301]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 21 17:37:06 cloudcephosd1028 smart_failure[563719]: Device: /dev/sdg [SAT], 1784 Offline uncorrectable sectors
Sep 21 19:07:06 cloudcephosd1028 smart_failure[597543]: Device: /dev/sdc [SAT], 992 Offline uncorrectable sectors
Sep 21 19:07:06 cloudcephosd1028 smart_failure[597562]: Device: /dev/sdd [SAT], 184 Offline uncorrectable sectors
Sep 21 21:37:06 cloudcephosd1028 smart_failure[653743]: Device: /dev/sdj [SAT], 2848 Offline uncorrectable sectors
Sep 22 01:37:06 cloudcephosd1028 smart_failure[743680]: Device: /dev/sde [SAT], 1752 Offline uncorrectable sectors
Sep 22 03:37:06 cloudcephosd1028 smart_failure[788657]: Device: /dev/sdf [SAT], 5176 Offline uncorrectable sectors
Sep 22 05:07:07 cloudcephosd1028 smart_failure[822522]: Device: /dev/sdi [SAT], 928 Offline uncorrectable sectors
Sep 22 09:37:06 cloudcephosd1028 smart_failure[924253]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 22 17:37:06 cloudcephosd1028 smart_failure[1104208]: Device: /dev/sdg [SAT], 1784 Offline uncorrectable sectors
Sep 22 19:07:06 cloudcephosd1028 smart_failure[1137614]: Device: /dev/sdc [SAT], 992 Offline uncorrectable sectors
Sep 22 19:07:06 cloudcephosd1028 smart_failure[1137658]: Device: /dev/sdd [SAT], 184 Offline uncorrectable sectors
Sep 22 21:37:07 cloudcephosd1028 smart_failure[1193843]: Device: /dev/sdj [SAT], 2856 Offline uncorrectable sectors
Sep 23 01:37:06 cloudcephosd1028 smart_failure[1283984]: Device: /dev/sde [SAT], 1784 Offline uncorrectable sectors
Sep 23 03:37:06 cloudcephosd1028 smart_failure[1329127]: Device: /dev/sdf [SAT], 5208 Offline uncorrectable sectors
Sep 23 05:37:06 cloudcephosd1028 smart_failure[1374218]: Device: /dev/sdi [SAT], 936 Offline uncorrectable sectors
Sep 23 09:37:06 cloudcephosd1028 smart_failure[1463992]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 23 17:37:06 cloudcephosd1028 smart_failure[1644294]: Device: /dev/sdg [SAT], 1784 Offline uncorrectable sectors
Sep 23 19:07:06 cloudcephosd1028 smart_failure[1678405]: Device: /dev/sdc [SAT], 992 Offline uncorrectable sectors
Sep 23 19:07:06 cloudcephosd1028 smart_failure[1678448]: Device: /dev/sdd [SAT], 184 Offline uncorrectable sectors
Sep 23 22:07:06 cloudcephosd1028 smart_failure[1745577]: Device: /dev/sdj [SAT], 2864 Offline uncorrectable sectors
Sep 24 01:37:06 cloudcephosd1028 smart_failure[1824681]: Device: /dev/sde [SAT], 1792 Offline uncorrectable sectors
Sep 24 03:37:06 cloudcephosd1028 smart_failure[1869947]: Device: /dev/sdf [SAT], 5216 Offline uncorrectable sectors
Sep 24 05:37:07 cloudcephosd1028 smart_failure[1914952]: Device: /dev/sdi [SAT], 952 Offline uncorrectable sectors
Sep 24 09:37:06 cloudcephosd1028 smart_failure[2004804]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 24 17:37:06 cloudcephosd1028 smart_failure[2184274]: Device: /dev/sdg [SAT], 1816 Offline uncorrectable sectors
Sep 24 19:07:06 cloudcephosd1028 smart_failure[2217778]: Device: /dev/sdc [SAT], 992 Offline uncorrectable sectors
Sep 24 19:07:06 cloudcephosd1028 smart_failure[2217821]: Device: /dev/sdd [SAT], 184 Offline uncorrectable sectors
Sep 24 22:07:07 cloudcephosd1028 smart_failure[2285370]: Device: /dev/sdj [SAT], 2888 Offline uncorrectable sectors
Sep 25 01:37:06 cloudcephosd1028 smart_failure[2364451]: Device: /dev/sde [SAT], 1792 Offline uncorrectable sectors
Sep 25 03:37:06 cloudcephosd1028 smart_failure[2409261]: Device: /dev/sdf [SAT], 5248 Offline uncorrectable sectors
Sep 25 05:37:06 cloudcephosd1028 smart_failure[2454299]: Device: /dev/sdi [SAT], 952 Offline uncorrectable sectors
Sep 25 09:37:06 cloudcephosd1028 smart_failure[2544158]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 25 17:37:06 cloudcephosd1028 smart_failure[2724105]: Device: /dev/sdg [SAT], 1824 Offline uncorrectable sectors
Sep 25 19:07:06 cloudcephosd1028 smart_failure[2757832]: Device: /dev/sdc [SAT], 992 Offline uncorrectable sectors
Sep 25 19:07:06 cloudcephosd1028 smart_failure[2757851]: Device: /dev/sdd [SAT], 184 Offline uncorrectable sectors
Sep 25 22:37:06 cloudcephosd1028 smart_failure[2835751]: Device: /dev/sdj [SAT], 2896 Offline uncorrectable sectors
Sep 26 01:37:06 cloudcephosd1028 smart_failure[2903506]: Device: /dev/sde [SAT], 1792 Offline uncorrectable sectors
Sep 26 03:37:06 cloudcephosd1028 smart_failure[2948041]: Device: /dev/sdf [SAT], 5248 Offline uncorrectable sectors
Sep 26 05:37:06 cloudcephosd1028 smart_failure[2993234]: Device: /dev/sdi [SAT], 960 Offline uncorrectable sectors
Sep 26 09:37:06 cloudcephosd1028 smart_failure[3083378]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 26 17:37:06 cloudcephosd1028 smart_failure[3263762]: Device: /dev/sdg [SAT], 1832 Offline uncorrectable sectors
Sep 26 19:07:06 cloudcephosd1028 smart_failure[3297088]: Device: /dev/sdc [SAT], 1008 Offline uncorrectable sectors
Sep 26 19:07:06 cloudcephosd1028 smart_failure[3297131]: Device: /dev/sdd [SAT], 184 Offline uncorrectable sectors
Sep 26 22:37:06 cloudcephosd1028 smart_failure[3375603]: Device: /dev/sdj [SAT], 2896 Offline uncorrectable sectors
Sep 27 01:37:06 cloudcephosd1028 smart_failure[3442576]: Device: /dev/sde [SAT], 1792 Offline uncorrectable sectors
Sep 27 03:37:06 cloudcephosd1028 smart_failure[3487948]: Device: /dev/sdf [SAT], 5256 Offline uncorrectable sectors
Sep 27 05:37:06 cloudcephosd1028 smart_failure[3532474]: Device: /dev/sdi [SAT], 960 Offline uncorrectable sectors
Sep 27 09:37:06 cloudcephosd1028 smart_failure[3621933]: Device: /dev/sdh [SAT], 824 Offline uncorrectable sectors
Sep 27 17:37:06 cloudcephosd1028 smart_failure[3801663]: Device: /dev/sdg [SAT], 1840 Offline uncorrectable sectors
Sep 27 19:07:06 cloudcephosd1028 smart_failure[3834986]: Device: /dev/sdc [SAT], 1008 Offline uncorrectable sectors
Sep 27 19:07:06 cloudcephosd1028 smart_failure[3835030]: Device: /dev/sdd [SAT], 184 Offline uncorrectable sectors
Sep 27 22:37:06 cloudcephosd1028 smart_failure[3913493]: Device: /dev/sdj [SAT], 2912 Offline uncorrectable sectors
Sep 28 01:37:06 cloudcephosd1028 smart_failure[3981370]: Device: /dev/sde [SAT], 1792 Offline uncorrectable sectors
Sep 28 03:37:06 cloudcephosd1028 smart_failure[4026090]: Device: /dev/sdf [SAT], 5280 Offline uncorrectable sectors
Sep 28 05:37:06 cloudcephosd1028 smart_failure[4070942]: Device: /dev/sdi [SAT], 968 Offline uncorrectable sectors
Sep 28 09:37:06 cloudcephosd1028 smart_failure[4160836]: Device: /dev/sdh [SAT], 832 Offline uncorrectable sectors
Sep 28 17:37:06 cloudcephosd1028 smart_failure[146284]: Device: /dev/sdg [SAT], 1848 Offline uncorrectable sectors
Sep 28 19:07:06 cloudcephosd1028 smart_failure[180387]: Device: /dev/sdc [SAT], 1008 Offline uncorrectable sectors
Sep 28 19:07:06 cloudcephosd1028 smart_failure[180406]: Device: /dev/sdd [SAT], 184 Offline uncorrectable sectors
Sep 28 22:37:06 cloudcephosd1028 smart_failure[259064]: Device: /dev/sdj [SAT], 2912 Offline uncorrectable sectors
Sep 29 01:37:06 cloudcephosd1028 smart_failure[325838]: Device: /dev/sde [SAT], 1800 Offline uncorrectable sectors
Sep 29 03:37:06 cloudcephosd1028 smart_failure[370609]: Device: /dev/sdf [SAT], 5296 Offline uncorrectable sectors
Sep 29 05:37:06 cloudcephosd1028 smart_failure[414824]: Device: /dev/sdi [SAT], 976 Offline uncorrectable sectors
Sep 29 09:37:06 cloudcephosd1028 smart_failure[504304]: Device: /dev/sdh [SAT], 840 Offline uncorrectable sectors
Sep 29 17:37:06 cloudcephosd1028 smart_failure[682753]: Device: /dev/sdg [SAT], 1856 Offline uncorrectable sectors
Sep 29 19:07:06 cloudcephosd1028 smart_failure[716439]: Device: /dev/sdc [SAT], 1008 Offline uncorrectable sectors
Sep 29 19:07:06 cloudcephosd1028 smart_failure[716458]: Device: /dev/sdd [SAT], 184 Offline uncorrectable sectors
Sep 29 22:37:06 cloudcephosd1028 smart_failure[794618]: Device: /dev/sdj [SAT], 2912 Offline uncorrectable sectors
Sep 30 01:37:06 cloudcephosd1028 smart_failure[861246]: Device: /dev/sde [SAT], 1808 Offline uncorrectable sectors
Sep 30 03:37:06 cloudcephosd1028 smart_failure[906049]: Device: /dev/sdf [SAT], 5312 Offline uncorrectable sectors
Sep 30 05:37:07 cloudcephosd1028 smart_failure[950561]: Device: /dev/sdi [SAT], 984 Offline uncorrectable sectors
Sep 30 09:37:06 cloudcephosd1028 smart_failure[1040153]: Device: /dev/sdh [SAT], 856 Offline uncorrectable sectors
Sep 30 17:37:06 cloudcephosd1028 smart_failure[1218456]: Device: /dev/sdg [SAT], 1856 Offline uncorrectable sectors
Sep 30 19:07:06 cloudcephosd1028 smart_failure[1251971]: Device: /dev/sdc [SAT], 1008 Offline uncorrectable sectors
Sep 30 19:07:06 cloudcephosd1028 smart_failure[1252020]: Device: /dev/sdd [SAT], 184 Offline uncorrectable sectors
Sep 30 22:37:06 cloudcephosd1028 smart_failure[1330341]: Device: /dev/sdj [SAT], 2912 Offline uncorrectable sectors
===== NODE GROUP =====
(1) cloudcephosd1023.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 06 11:15:28 cloudcephosd1023 smart_failure[15043]: Device: /dev/sdd [SAT], 584 Offline uncorrectable sectors
Oct 06 11:45:28 cloudcephosd1023 smart_failure[27283]: Device: /dev/sdg [SAT], 1584 Offline uncorrectable sectors
Oct 06 14:15:28 cloudcephosd1023 smart_failure[38886]: Device: /dev/sdc [SAT], 1240 Offline uncorrectable sectors
Oct 06 14:45:28 cloudcephosd1023 smart_failure[1950]: Device: /dev/sdi [SAT], 2344 Offline uncorrectable sectors
Oct 06 18:45:29 cloudcephosd1023 smart_failure[978]: Device: /dev/sde [SAT], 1032 Offline uncorrectable sectors
Oct 06 20:15:28 cloudcephosd1023 smart_failure[37594]: Device: /dev/sdh [SAT], 1656 Offline uncorrectable sectors
Oct 06 23:45:28 cloudcephosd1023 smart_failure[24269]: Device: /dev/sdf [SAT], 1056 Offline uncorrectable sectors
Oct 07 03:45:28 cloudcephosd1023 smart_failure[22672]: Device: /dev/sdj [SAT], 480 Offline uncorrectable sectors
Oct 07 11:15:28 cloudcephosd1023 smart_failure[7072]: Device: /dev/sdd [SAT], 584 Offline uncorrectable sectors
Oct 07 11:45:28 cloudcephosd1023 smart_failure[19303]: Device: /dev/sdg [SAT], 1584 Offline uncorrectable sectors
Oct 07 14:15:28 cloudcephosd1023 smart_failure[30258]: Device: /dev/sdc [SAT], 1240 Offline uncorrectable sectors
Oct 07 14:45:28 cloudcephosd1023 smart_failure[42177]: Device: /dev/sdi [SAT], 2344 Offline uncorrectable sectors
Oct 07 18:45:28 cloudcephosd1023 smart_failure[40515]: Device: /dev/sde [SAT], 1032 Offline uncorrectable sectors
Oct 07 20:15:28 cloudcephosd1023 smart_failure[27683]: Device: /dev/sdh [SAT], 1656 Offline uncorrectable sectors
Oct 07 23:45:28 cloudcephosd1023 smart_failure[13790]: Device: /dev/sdf [SAT], 1056 Offline uncorrectable sectors
Oct 08 03:45:28 cloudcephosd1023 smart_failure[12283]: Device: /dev/sdj [SAT], 480 Offline uncorrectable sectors
Oct 08 11:15:28 cloudcephosd1023 smart_failure[45542]: Device: /dev/sdd [SAT], 584 Offline uncorrectable sectors
Oct 08 11:45:28 cloudcephosd1023 smart_failure[8761]: Device: /dev/sdg [SAT], 1584 Offline uncorrectable sectors
Oct 08 14:15:28 cloudcephosd1023 smart_failure[19888]: Device: /dev/sdc [SAT], 1240 Offline uncorrectable sectors
Oct 08 14:45:28 cloudcephosd1023 smart_failure[31738]: Device: /dev/sdi [SAT], 2344 Offline uncorrectable sectors
Oct 08 18:45:28 cloudcephosd1023 smart_failure[30327]: Device: /dev/sde [SAT], 1032 Offline uncorrectable sectors
Oct 08 20:15:28 cloudcephosd1023 smart_failure[17696]: Device: /dev/sdh [SAT], 1656 Offline uncorrectable sectors
Oct 08 23:45:28 cloudcephosd1023 smart_failure[3407]: Device: /dev/sdf [SAT], 1056 Offline uncorrectable sectors
Oct 09 03:45:28 cloudcephosd1023 smart_failure[1890]: Device: /dev/sdj [SAT], 480 Offline uncorrectable sectors
Oct 09 11:15:28 cloudcephosd1023 smart_failure[34776]: Device: /dev/sdd [SAT], 584 Offline uncorrectable sectors
Oct 09 11:45:28 cloudcephosd1023 smart_failure[46559]: Device: /dev/sdg [SAT], 1584 Offline uncorrectable sectors
Oct 09 14:15:28 cloudcephosd1023 smart_failure[9001]: Device: /dev/sdc [SAT], 1240 Offline uncorrectable sectors
Oct 09 14:45:28 cloudcephosd1023 smart_failure[21145]: Device: /dev/sdi [SAT], 2352 Offline uncorrectable sectors
Oct 09 18:45:28 cloudcephosd1023 smart_failure[19261]: Device: /dev/sde [SAT], 1032 Offline uncorrectable sectors
Oct 09 20:15:28 cloudcephosd1023 smart_failure[6279]: Device: /dev/sdh [SAT], 1656 Offline uncorrectable sectors
Oct 09 23:45:28 cloudcephosd1023 smart_failure[41206]: Device: /dev/sdf [SAT], 1056 Offline uncorrectable sectors
Oct 10 03:45:28 cloudcephosd1023 smart_failure[39611]: Device: /dev/sdj [SAT], 480 Offline uncorrectable sectors
Oct 10 11:15:28 cloudcephosd1023 smart_failure[24543]: Device: /dev/sdd [SAT], 584 Offline uncorrectable sectors
Oct 10 11:45:28 cloudcephosd1023 smart_failure[36566]: Device: /dev/sdg [SAT], 1584 Offline uncorrectable sectors
Oct 10 14:15:28 cloudcephosd1023 smart_failure[47516]: Device: /dev/sdc [SAT], 1240 Offline uncorrectable sectors
Oct 10 14:45:28 cloudcephosd1023 smart_failure[10901]: Device: /dev/sdi [SAT], 2352 Offline uncorrectable sectors
Oct 10 18:45:28 cloudcephosd1023 smart_failure[10354]: Device: /dev/sde [SAT], 1032 Offline uncorrectable sectors
Oct 10 20:15:28 cloudcephosd1023 smart_failure[46217]: Device: /dev/sdh [SAT], 1656 Offline uncorrectable sectors
Oct 10 23:45:28 cloudcephosd1023 smart_failure[33159]: Device: /dev/sdf [SAT], 1056 Offline uncorrectable sectors
Oct 11 03:45:28 cloudcephosd1023 smart_failure[32576]: Device: /dev/sdj [SAT], 480 Offline uncorrectable sectors
Oct 11 11:15:28 cloudcephosd1023 smart_failure[19577]: Device: /dev/sdd [SAT], 584 Offline uncorrectable sectors
Oct 11 11:45:28 cloudcephosd1023 smart_failure[31484]: Device: /dev/sdg [SAT], 1584 Offline uncorrectable sectors
===== NODE GROUP =====
(1) cloudcephosd1022.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 06 07:20:40 cloudcephosd1022 smart_failure[20906]: Device: /dev/sdh [SAT], 2064 Offline uncorrectable sectors
Oct 06 08:20:40 cloudcephosd1022 smart_failure[45298]: Device: /dev/sdd [SAT], 1568 Offline uncorrectable sectors
Oct 06 11:20:40 cloudcephosd1022 smart_failure[20084]: Device: /dev/sdc [SAT], 1800 Offline uncorrectable sectors
Oct 06 14:20:40 cloudcephosd1022 smart_failure[44033]: Device: /dev/sdj [SAT], 1296 Offline uncorrectable sectors
Oct 06 15:20:40 cloudcephosd1022 smart_failure[19294]: Device: /dev/sde [SAT], 824 Offline uncorrectable sectors
Oct 06 20:20:40 cloudcephosd1022 smart_failure[41929]: Device: /dev/sdi [SAT], 984 Offline uncorrectable sectors
Oct 07 01:20:40 cloudcephosd1022 smart_failure[17238]: Device: /dev/sdf [SAT], 944 Offline uncorrectable sectors
Oct 07 01:20:40 cloudcephosd1022 smart_failure[17258]: Device: /dev/sdg [SAT], 1296 Offline uncorrectable sectors
Oct 07 07:20:40 cloudcephosd1022 smart_failure[15786]: Device: /dev/sdh [SAT], 2080 Offline uncorrectable sectors
Oct 07 08:20:40 cloudcephosd1022 smart_failure[39640]: Device: /dev/sdd [SAT], 1568 Offline uncorrectable sectors
Oct 07 11:20:40 cloudcephosd1022 smart_failure[15011]: Device: /dev/sdc [SAT], 1800 Offline uncorrectable sectors
Oct 07 14:20:40 cloudcephosd1022 smart_failure[38439]: Device: /dev/sdj [SAT], 1296 Offline uncorrectable sectors
Oct 07 15:20:40 cloudcephosd1022 smart_failure[14131]: Device: /dev/sde [SAT], 824 Offline uncorrectable sectors
Oct 07 20:20:40 cloudcephosd1022 smart_failure[37089]: Device: /dev/sdi [SAT], 984 Offline uncorrectable sectors
Oct 08 01:20:40 cloudcephosd1022 smart_failure[12360]: Device: /dev/sdf [SAT], 944 Offline uncorrectable sectors
Oct 08 01:20:40 cloudcephosd1022 smart_failure[12380]: Device: /dev/sdg [SAT], 1296 Offline uncorrectable sectors
Oct 08 07:20:40 cloudcephosd1022 smart_failure[11206]: Device: /dev/sdh [SAT], 2080 Offline uncorrectable sectors
Oct 08 08:20:40 cloudcephosd1022 smart_failure[34995]: Device: /dev/sdd [SAT], 1584 Offline uncorrectable sectors
Oct 08 11:20:40 cloudcephosd1022 smart_failure[10164]: Device: /dev/sdc [SAT], 1800 Offline uncorrectable sectors
Oct 08 14:20:40 cloudcephosd1022 smart_failure[33281]: Device: /dev/sdj [SAT], 1296 Offline uncorrectable sectors
Oct 08 15:20:40 cloudcephosd1022 smart_failure[9081]: Device: /dev/sde [SAT], 824 Offline uncorrectable sectors
Oct 08 20:20:40 cloudcephosd1022 smart_failure[32300]: Device: /dev/sdi [SAT], 984 Offline uncorrectable sectors
Oct 09 01:20:40 cloudcephosd1022 smart_failure[7089]: Device: /dev/sdf [SAT], 944 Offline uncorrectable sectors
Oct 09 01:20:40 cloudcephosd1022 smart_failure[7109]: Device: /dev/sdg [SAT], 1296 Offline uncorrectable sectors
Oct 09 07:20:40 cloudcephosd1022 smart_failure[5541]: Device: /dev/sdh [SAT], 2088 Offline uncorrectable sectors
Oct 09 08:20:40 cloudcephosd1022 smart_failure[29335]: Device: /dev/sdd [SAT], 1616 Offline uncorrectable sectors
Oct 09 11:20:40 cloudcephosd1022 smart_failure[4459]: Device: /dev/sdc [SAT], 1800 Offline uncorrectable sectors
Oct 09 14:20:40 cloudcephosd1022 smart_failure[27851]: Device: /dev/sdj [SAT], 1296 Offline uncorrectable sectors
Oct 09 15:20:40 cloudcephosd1022 smart_failure[3435]: Device: /dev/sde [SAT], 824 Offline uncorrectable sectors
Oct 09 20:20:40 cloudcephosd1022 smart_failure[26537]: Device: /dev/sdi [SAT], 984 Offline uncorrectable sectors
Oct 10 01:20:40 cloudcephosd1022 smart_failure[1203]: Device: /dev/sdf [SAT], 944 Offline uncorrectable sectors
Oct 10 01:20:40 cloudcephosd1022 smart_failure[1224]: Device: /dev/sdg [SAT], 1304 Offline uncorrectable sectors
Oct 10 07:20:40 cloudcephosd1022 smart_failure[48454]: Device: /dev/sdh [SAT], 2088 Offline uncorrectable sectors
Oct 10 08:20:40 cloudcephosd1022 smart_failure[23893]: Device: /dev/sdd [SAT], 1616 Offline uncorrectable sectors
Oct 10 11:20:40 cloudcephosd1022 smart_failure[48356]: Device: /dev/sdc [SAT], 1800 Offline uncorrectable sectors
Oct 10 14:20:40 cloudcephosd1022 smart_failure[25299]: Device: /dev/sdj [SAT], 1296 Offline uncorrectable sectors
Oct 10 15:20:40 cloudcephosd1022 smart_failure[908]: Device: /dev/sde [SAT], 824 Offline uncorrectable sectors
Oct 10 20:20:40 cloudcephosd1022 smart_failure[25196]: Device: /dev/sdi [SAT], 984 Offline uncorrectable sectors
Oct 11 01:20:40 cloudcephosd1022 smart_failure[49123]: Device: /dev/sdf [SAT], 952 Offline uncorrectable sectors
Oct 11 01:20:40 cloudcephosd1022 smart_failure[49143]: Device: /dev/sdg [SAT], 1304 Offline uncorrectable sectors
Oct 11 07:20:40 cloudcephosd1022 smart_failure[48539]: Device: /dev/sdh [SAT], 2096 Offline uncorrectable sectors
Oct 11 08:20:40 cloudcephosd1022 smart_failure[23874]: Device: /dev/sdd [SAT], 1616 Offline uncorrectable sectors
Oct 11 11:20:40 cloudcephosd1022 smart_failure[47870]: Device: /dev/sdc [SAT], 1800 Offline uncorrectable sectors
===== NODE GROUP =====
(1) cloudcephosd1024.eqiad.wmnet
----- OUTPUT of 'journalctl | gre...}' | sort | uniq' -----
Oct 06 07:09:34 cloudcephosd1024 smart_failure[17946]: Device: /dev/sdf [SAT], 3208 Offline uncorrectable sectors
Oct 06 09:09:34 cloudcephosd1024 smart_failure[17730]: Device: /dev/sdj [SAT], 2832 Offline uncorrectable sectors
Oct 06 11:09:34 cloudcephosd1024 smart_failure[17393]: Device: /dev/sde [SAT], 1200 Offline uncorrectable sectors
Oct 06 15:09:34 cloudcephosd1024 smart_failure[16306]: Device: /dev/sdi [SAT], 968 Offline uncorrectable sectors
Oct 06 16:09:34 cloudcephosd1024 smart_failure[40200]: Device: /dev/sdh [SAT], 1360 Offline uncorrectable sectors
Oct 06 20:09:34 cloudcephosd1024 smart_failure[39046]: Device: /dev/sdc [SAT], 4984 Offline uncorrectable sectors
Oct 06 20:39:34 cloudcephosd1024 smart_failure[2328]: Device: /dev/sdd [SAT], 872 Offline uncorrectable sectors
Oct 07 01:39:34 cloudcephosd1024 smart_failure[25491]: Device: /dev/sdg [SAT], 1944 Offline uncorrectable sectors
Oct 07 07:09:34 cloudcephosd1024 smart_failure[11205]: Device: /dev/sdf [SAT], 3208 Offline uncorrectable sectors
Oct 07 09:09:34 cloudcephosd1024 smart_failure[10544]: Device: /dev/sdj [SAT], 2832 Offline uncorrectable sectors
Oct 07 11:09:34 cloudcephosd1024 smart_failure[9423]: Device: /dev/sde [SAT], 1200 Offline uncorrectable sectors
Oct 07 15:09:34 cloudcephosd1024 smart_failure[7900]: Device: /dev/sdi [SAT], 968 Offline uncorrectable sectors
Oct 07 16:09:34 cloudcephosd1024 smart_failure[31902]: Device: /dev/sdh [SAT], 1360 Offline uncorrectable sectors
Oct 07 20:09:34 cloudcephosd1024 smart_failure[30578]: Device: /dev/sdc [SAT], 4984 Offline uncorrectable sectors
Oct 07 20:39:34 cloudcephosd1024 smart_failure[42345]: Device: /dev/sdd [SAT], 872 Offline uncorrectable sectors
Oct 08 01:39:34 cloudcephosd1024 smart_failure[16905]: Device: /dev/sdg [SAT], 1952 Offline uncorrectable sectors
Oct 08 07:09:34 cloudcephosd1024 smart_failure[2703]: Device: /dev/sdf [SAT], 3208 Offline uncorrectable sectors
Oct 08 09:09:34 cloudcephosd1024 smart_failure[1633]: Device: /dev/sdj [SAT], 2832 Offline uncorrectable sectors
Oct 08 11:09:34 cloudcephosd1024 smart_failure[880]: Device: /dev/sde [SAT], 1200 Offline uncorrectable sectors
Oct 08 15:09:34 cloudcephosd1024 smart_failure[47862]: Device: /dev/sdi [SAT], 968 Offline uncorrectable sectors
Oct 08 16:09:34 cloudcephosd1024 smart_failure[23655]: Device: /dev/sdh [SAT], 1360 Offline uncorrectable sectors
Oct 08 20:09:34 cloudcephosd1024 smart_failure[22723]: Device: /dev/sdc [SAT], 4984 Offline uncorrectable sectors
Oct 08 20:39:34 cloudcephosd1024 smart_failure[34596]: Device: /dev/sdd [SAT], 872 Offline uncorrectable sectors
Oct 09 01:39:34 cloudcephosd1024 smart_failure[8511]: Device: /dev/sdg [SAT], 1952 Offline uncorrectable sectors
Oct 09 07:09:34 cloudcephosd1024 smart_failure[42712]: Device: /dev/sdf [SAT], 3208 Offline uncorrectable sectors
Oct 09 09:09:34 cloudcephosd1024 smart_failure[41776]: Device: /dev/sdj [SAT], 2832 Offline uncorrectable sectors
Oct 09 11:09:34 cloudcephosd1024 smart_failure[40801]: Device: /dev/sde [SAT], 1200 Offline uncorrectable sectors
Oct 09 15:09:34 cloudcephosd1024 smart_failure[39308]: Device: /dev/sdi [SAT], 968 Offline uncorrectable sectors
Oct 09 16:09:34 cloudcephosd1024 smart_failure[14664]: Device: /dev/sdh [SAT], 1360 Offline uncorrectable sectors
Oct 09 20:09:34 cloudcephosd1024 smart_failure[13480]: Device: /dev/sdc [SAT], 4984 Offline uncorrectable sectors
Oct 09 20:39:34 cloudcephosd1024 smart_failure[25520]: Device: /dev/sdd [SAT], 872 Offline uncorrectable sectors
Oct 10 01:39:34 cloudcephosd1024 smart_failure[47766]: Device: /dev/sdg [SAT], 1952 Offline uncorrectable sectors
Oct 10 07:09:34 cloudcephosd1024 smart_failure[33613]: Device: /dev/sdf [SAT], 3208 Offline uncorrectable sectors
Oct 10 09:09:34 cloudcephosd1024 smart_failure[33152]: Device: /dev/sdj [SAT], 2832 Offline uncorrectable sectors
Oct 10 11:09:34 cloudcephosd1024 smart_failure[32819]: Device: /dev/sde [SAT], 1200 Offline uncorrectable sectors
Oct 10 15:09:34 cloudcephosd1024 smart_failure[31852]: Device: /dev/sdi [SAT], 968 Offline uncorrectable sectors
Oct 10 16:09:34 cloudcephosd1024 smart_failure[7511]: Device: /dev/sdh [SAT], 1360 Offline uncorrectable sectors
Oct 10 20:09:34 cloudcephosd1024 smart_failure[7074]: Device: /dev/sdc [SAT], 4984 Offline uncorrectable sectors
Oct 10 20:39:34 cloudcephosd1024 smart_failure[19401]: Device: /dev/sdd [SAT], 872 Offline uncorrectable sectors
Oct 11 01:39:34 cloudcephosd1024 smart_failure[42955]: Device: /dev/sdg [SAT], 1952 Offline uncorrectable sectors
Oct 11 07:09:34 cloudcephosd1024 smart_failure[30474]: Device: /dev/sdf [SAT], 3208 Offline uncorrectable sectors
Oct 11 09:09:34 cloudcephosd1024 smart_failure[29918]: Device: /dev/sdj [SAT], 2832 Offline uncorrectable sectors
Oct 11 11:09:34 cloudcephosd1024 smart_failure[29987]: Device: /dev/sde [SAT], 1200 Offline uncorrectable sectors
================

Event Timeline

ProdPasteBot edited the content of this paste. (Show Details)Oct 11 2023, 12:31 PM
ProdPasteBot changed the title of this paste from untitled to Masterwork From Distant Lands.
dcaro mentioned this in T348643: cloudcephosd1021-1034: hard drive sector errors increasing.Oct 11 2023, 12:56 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL