(An Untitled Masterwork)
ActivePublic
Actions

Authored by CDanis on Jun 10 2024, 3:40 PM.

Project Tags

None

Referenced Files

	F55177756: raw-paste-data.txt
	Jun 10 2024, 3:40 PM

Subscribers

None

	💔cdanis@cumin1002.eqiad.wmnet ~ 🕦☕ sudo cumin '*.eqiad.wmnet and C:geoip::data::puppet%fetch_ipinfo_dbs=true' 'sha512sum /usr/share/GeoIPInfo/GeoLite2-ASN.mmdb'
	220 hosts will be targeted:
	kubernetes[1007-1014,1017-1062].eqiad.wmnet,mw[1349-1357,1359-1371,1373-1399,1402-1409,1411-1425,1430-1435,1439-1442,1444,1447-1455,1457-1489,1491-1496].eqiad.wmnet,mwdebug[1001-1002].eqiad.wmnet,parse[1002-1024].eqiad.wmnet,wikikube-worker[1001-1004,1007-1012].eqiad.wmnet
	OK to proceed on 220 hosts? Enter the number of affected hosts to confirm or "q" to quit: 220
	===== NODE GROUP =====
	(220) kubernetes[1007-1014,1017-1062].eqiad.wmnet,mw[1349-1357,1359-1371,1373-1399,1402-1409,1411-1425,1430-1435,1439-1442,1444,1447-1455,1457-1489,1491-1496].eqiad.wmnet,mwdebug[1001-1002].eqiad.wmnet,parse[1002-1024].eqiad.wmnet,wikikube-worker[1001-1004,1007-1012].eqiad.wmnet
	----- OUTPUT of 'sha512sum /usr/s...eoLite2-ASN.mmdb' -----
	000ae941edae1dbdd8d1338ef647404ecbd5d69a2688e684d27698580f5784f1c14c5cbc60645b68563a6f0d69806be7ee0c2250700307a18bbacf2acd37fc13 /usr/share/GeoIPInfo/GeoLite2-ASN.mmdb
	================
	PASS \|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████\| 100% (220/220) [00:03<00:00, 67.92hosts/s]
	FAIL \| \| 0% (0/220) [00:03<?, ?hosts/s]
	100.0% (220/220) success ratio (>= 100.0% threshold) for command: 'sha512sum /usr/s...eoLite2-ASN.mmdb'.
	100.0% (220/220) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.
	💙cdanis@cumin1002.eqiad.wmnet ~ 🕦☕ sudo cumin '*.codfw.wmnet and C:geoip::data::puppet%fetch_ipinfo_dbs=true' 'sha512sum /usr/share/GeoIPInfo/GeoLite2-ASN.mmdb'
	242 hosts will be targeted:
	kubernetes[2007-2014,2017-2022,2024-2031,2033-2060].codfw.wmnet,mw[2260-2262,2267-2277,2282-2330,2332-2339,2350-2360,2362-2390,2392-2409,2412-2451].codfw.wmnet,mwdebug[2001-2002].codfw.wmnet,parse[2002-2020].codfw.wmnet,wikikube-worker[2001-2002].codfw.wmnet
	OK to proceed on 242 hosts? Enter the number of affected hosts to confirm or "q" to quit: 242
	===== NODE GROUP =====
	(56) mw[2261-2262,2268-2277,2283-2290,2298-2300,2306-2309,2323-2324,2326-2330,2339,2358,2360,2362-2365,2392-2393,2400,2403-2405,2408-2409,2432-2433,2438-2439,2441].codfw.wmnet,mwdebug[2001-2002].codfw.wmnet
	----- OUTPUT of 'sha512sum /usr/s...eoLite2-ASN.mmdb' -----
	000ae941edae1dbdd8d1338ef647404ecbd5d69a2688e684d27698580f5784f1c14c5cbc60645b68563a6f0d69806be7ee0c2250700307a18bbacf2acd37fc13 /usr/share/GeoIPInfo/GeoLite2-ASN.mmdb
	===== NODE GROUP =====
	(186) kubernetes[2007-2014,2017-2022,2024-2031,2033-2060].codfw.wmnet,mw[2260,2267,2282,2291-2297,2301-2305,2310-2322,2325,2332-2338,2350-2357,2359,2366-2390,2394-2399,2401-2402,2406-2407,2412-2431,2434-2437,2440,2442-2451].codfw.wmnet,parse[2002-2020].codfw.wmnet,wikikube-worker[2001-2002].codfw.wmnet
	----- OUTPUT of 'sha512sum /usr/s...eoLite2-ASN.mmdb' -----
	sha512sum: /usr/share/GeoIPInfo/GeoLite2-ASN.mmdb: No such file or directory
	================
	PASS \|███████████████████████████ \| 23% (56/242) [00:04<00:13, 13.71hosts/s]
	FAIL \|█████████████████████████████████████████████████████████████████████████████████████████▏ \| 77% (186/242) [00:04<00:01, 45.53hosts/s]
	76.9% (186/242) of nodes failed to execute command 'sha512sum /usr/s...eoLite2-ASN.mmdb': kubernetes[2007-2014,2017-2022,2024-2031,2033-2060].codfw.wmnet,mw[2260,2267,2282,2291-2297,2301-2305,2310-2322,2325,2332-2338,2350-2357,2359,2366-2390,2394-2399,2401-2402,2406-2407,2412-2431,2434-2437,2440,2442-2451].codfw.wmnet,parse[2002-2020].codfw.wmnet,wikikube-worker[2001-2002].codfw.wmnet
	23.1% (56/242) success ratio (< 100.0% threshold) for command: 'sha512sum /usr/s...eoLite2-ASN.mmdb'. Aborting.: mw[2261-2262,2268-2277,2283-2290,2298-2300,2306-2309,2323-2324,2326-2330,2339,2358,2360,2362-2365,2392-2393,2400,2403-2405,2408-2409,2432-2433,2438-2439,2441].codfw.wmnet,mwdebug[2001-2002].codfw.wmnet
	23.1% (56/242) success ratio (< 100.0% threshold) of nodes successfully executed all commands. Aborting.: mw[2261-2262,2268-2277,2283-2290,2298-2300,2306-2309,2323-2324,2326-2330,2339,2358,2360,2362-2365,2392-2393,2400,2403-2405,2408-2409,2432-2433,2438-2439,2441].codfw.wmnet,mwdebug[2001-2002].codfw.wmnet

Event Timeline

CDanis created this paste.Jun 10 2024, 3:40 PM

CDanis mentioned this in T367113: Puppetmaster volatile data not synced to all puppet frontends for a month and a half (2024-04-27 to 2024-06-10).Jun 10 2024, 8:17 PM

(An Untitled Masterwork)ActivePublicActions

Event Timeline

(An Untitled Masterwork)
ActivePublic
Actions