(An Untitled Masterwork)
ActivePublic
Actions

Authored by fnegri on Oct 11 2023, 1:26 PM.

Tags

None

Referenced Files

	F38206281: raw-paste-data.txt
	Oct 11 2023, 1:45 PM

	F38206158: raw-paste-data.txt
	Oct 11 2023, 1:26 PM

Subscribers

None

	root@cloudcumin1001:~# cumin 'cloudcephosd1*' 'bash -c "for d in {a..j}; do echo -n \"sd\$d: \"; smartctl -A /dev/sd\$d \|grep Offline_Uncorrectable \|awk '"'"'{print \$10}'"'"'; done"'
	34 hosts will be targeted:
	cloudcephosd[1001-1034].eqiad.wmnet
	OK to proceed on 34 hosts? Enter the number of affected hosts to confirm or "q" to quit: 34
	===== NODE GROUP =====
	(1) cloudcephosd1025.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 1464
	sdc: 0
	sdd: 2272
	sde: 1440
	sdf: 1624
	sdg: 1592
	sdh: 1920
	sdi: 1600
	sdj: 928
	===== NODE GROUP =====
	(1) cloudcephosd1033.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 656
	sdc: 0
	sdd: 1304
	sde: 992
	sdf: 1024
	sdg: 928
	sdh: 1408
	sdi: 864
	sdj: 2000
	===== NODE GROUP =====
	(1) cloudcephosd1026.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 0
	sdc: 1280
	sdd: 1432
	sde: 704
	sdf: 696
	sdg: 2192
	sdh: 896
	sdi: 2064
	sdj: 1104
	===== NODE GROUP =====
	(1) cloudcephosd1024.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 0
	sdc: 4984
	sdd: 872
	sde: 1200
	sdf: 3208
	sdg: 1952
	sdh: 1360
	sdi: 968
	sdj: 2832
	===== NODE GROUP =====
	(1) cloudcephosd1023.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 0
	sdc: 1240
	sdd: 584
	sde: 1032
	sdf: 1056
	sdg: 1584
	sdh: 1656
	sdi: 2352
	sdj: 480
	===== NODE GROUP =====
	(1) cloudcephosd1022.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 0
	sdc: 1800
	sdd: 1616
	sde: 824
	sdf: 952
	sdg: 1304
	sdh: 2096
	sdi: 984
	sdj: 1296
	===== NODE GROUP =====
	(1) cloudcephosd1021.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 0
	sdc: 1336
	sdd: 552
	sde: 1032
	sdf: 1848
	sdg: 1952
	sdh: 1472
	sdi: 1800
	sdj: 480
	===== NODE GROUP =====
	(1) cloudcephosd1034.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 0
	sdc: 2744
	sdd: 320
	sde: 1040
	sdf: 720
	sdg: 1120
	sdh: 0
	sdi: 520
	sdj: 488
	===== NODE GROUP =====
	(1) cloudcephosd1032.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 0
	sdc: 1912
	sdd: 2664
	sde: 2512
	sdf: 1648
	sdg: 1368
	sdh: 2288
	sdi: 1456
	sdj: 1432
	===== NODE GROUP =====
	(1) cloudcephosd1031.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 0
	sdc: 1520
	sdd: 1584
	sde: 1456
	sdf: 1936
	sdg: 1336
	sdh: 784
	sdi: 1856
	sdj: 2504
	===== NODE GROUP =====
	(1) cloudcephosd1030.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 0
	sdc: 2280
	sdd: 720
	sde: 1952
	sdf: 3000
	sdg: 1464
	sdh: 2624
	sdi: 1824
	sdj: 1232
	===== NODE GROUP =====
	(1) cloudcephosd1028.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 0
	sdc: 1032
	sdd: 192
	sde: 1840
	sdf: 5536
	sdg: 1912
	sdh: 864
	sdi: 1040
	sdj: 2992
	===== NODE GROUP =====
	(1) cloudcephosd1029.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 0
	sdc: 1424
	sdd: 1952
	sde: 2984
	sdf: 1040
	sdg: 680
	sdh: 1064
	sdi: 968
	sdj: 2544
	===== NODE GROUP =====
	(1) cloudcephosd1027.eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 0
	sdc: 2192
	sdd: 2008
	sde: 864
	sdf: 2504
	sdg: 976
	sdh: 696
	sdi: 1080
	sdj: 912
	===== NODE GROUP =====
	(20) cloudcephosd[1001-1020].eqiad.wmnet
	----- OUTPUT of 'bash -c "for d i...nt \$10}'; done"' -----
	sda: 0
	sdb: 0
	sdc: 0
	sdd: 0
	sde: 0
	sdf: 0
	sdg: 0
	sdh: 0
	sdi: 0
	sdj: 0
	================
	PASS \|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████\| 100% (34/34) [00:01<00:00, 20.07hosts/s]
	FAIL \| \| 0% (0/34) [00:01<?, ?hosts/s]
	100.0% (34/34) success ratio (>= 100.0% threshold) for command: 'bash -c "for d i...nt \$10}'; done"'.
	100.0% (34/34) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.

Event Timeline

fnegri created this paste.Oct 11 2023, 1:26 PM

fnegri edited the content of this paste. (Show Details)Oct 11 2023, 1:45 PM

fnegri mentioned this in T348643: cloudcephosd1021-1034: hard drive sector errors increasing.Oct 11 2023, 1:48 PM

(An Untitled Masterwork)ActivePublicActions

Event Timeline

(An Untitled Masterwork)
ActivePublic
Actions