Page MenuHomePhabricator
Files F34737357

syslog
RLazarus (Reuven Lazarus) (rzl)
Actions

Authored By
RLazarus
Nov 8 2021, 6:23 AM
Size
822 KB
Referenced Files
None
Subscribers
None

syslog
View Options

This file is larger than 256 KB, so syntax highlighting was skipped.
Nov 7 06:25:14 wikitech-static liblogging-stdlog: [origin software="rsyslogd" swVersion="8.24.0" x-pid="2724" x-info="http://www.rsyslog.com"] rsyslogd was HUPed
Nov 7 06:26:01 wikitech-static CRON[1556]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:26:01 wikitech-static CRON[1558]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:26:02 wikitech-static check_icinga[1559]: 2021-11-07 06:26:02,331 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:26:02 wikitech-static check_icinga[1557]: 2021-11-07 06:26:02,347 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:26:05 wikitech-static check_icinga[1557]: 2021-11-07 06:26:05,305 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:26:05 wikitech-static check_icinga[1559]: 2021-11-07 06:26:05,685 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:28:01 wikitech-static CRON[1640]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:28:01 wikitech-static CRON[1641]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:28:02 wikitech-static check_icinga[1642]: 2021-11-07 06:28:02,804 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:28:02 wikitech-static check_icinga[1643]: 2021-11-07 06:28:02,811 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:28:06 wikitech-static check_icinga[1642]: 2021-11-07 06:28:06,067 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:28:06 wikitech-static check_icinga[1643]: 2021-11-07 06:28:06,126 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:30:01 wikitech-static CRON[1718]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:30:01 wikitech-static CRON[1720]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:30:02 wikitech-static check_icinga[1719]: 2021-11-07 06:30:02,334 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:30:02 wikitech-static check_icinga[1721]: 2021-11-07 06:30:02,344 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:30:05 wikitech-static check_icinga[1719]: 2021-11-07 06:30:05,478 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:30:05 wikitech-static check_icinga[1721]: 2021-11-07 06:30:05,524 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:32:01 wikitech-static CRON[1801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:32:01 wikitech-static CRON[1802]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:32:02 wikitech-static check_icinga[1804]: 2021-11-07 06:32:02,811 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:32:02 wikitech-static check_icinga[1803]: 2021-11-07 06:32:02,834 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:32:05 wikitech-static check_icinga[1803]: 2021-11-07 06:32:05,783 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:32:05 wikitech-static check_icinga[1804]: 2021-11-07 06:32:05,936 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:34:01 wikitech-static CRON[1876]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:34:01 wikitech-static CRON[1878]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:34:02 wikitech-static check_icinga[1877]: 2021-11-07 06:34:02,094 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:34:02 wikitech-static check_icinga[1879]: 2021-11-07 06:34:02,103 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:34:03 wikitech-static check_icinga[1877]: 2021-11-07 06:34:03,495 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)']
Nov 7 06:34:05 wikitech-static check_icinga[1879]: 2021-11-07 06:34:05,299 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:34:13 wikitech-static check_icinga[1877]: 2021-11-07 06:34:13,505 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:34:16 wikitech-static check_icinga[1877]: 2021-11-07 06:34:16,411 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:36:01 wikitech-static CRON[1965]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:36:01 wikitech-static CRON[1967]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:36:02 wikitech-static check_icinga[1966]: 2021-11-07 06:36:02,560 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:36:02 wikitech-static check_icinga[1968]: 2021-11-07 06:36:02,567 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:36:05 wikitech-static check_icinga[1966]: 2021-11-07 06:36:05,225 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:36:05 wikitech-static check_icinga[1968]: 2021-11-07 06:36:05,752 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:38:01 wikitech-static CRON[2147]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:38:01 wikitech-static CRON[2148]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:38:02 wikitech-static check_icinga[2149]: 2021-11-07 06:38:02,881 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:38:02 wikitech-static check_icinga[2150]: 2021-11-07 06:38:02,883 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:38:05 wikitech-static check_icinga[2149]: 2021-11-07 06:38:05,749 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:38:06 wikitech-static check_icinga[2150]: 2021-11-07 06:38:06,183 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:39:01 wikitech-static CRON[2201]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 06:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 06:39:06 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 06:40:01 wikitech-static CRON[2331]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:40:01 wikitech-static CRON[2333]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:40:02 wikitech-static check_icinga[2332]: 2021-11-07 06:40:02,363 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:40:02 wikitech-static check_icinga[2334]: 2021-11-07 06:40:02,375 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:40:05 wikitech-static check_icinga[2332]: 2021-11-07 06:40:05,118 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:40:05 wikitech-static check_icinga[2334]: 2021-11-07 06:40:05,474 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:42:01 wikitech-static CRON[2406]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:42:01 wikitech-static CRON[2407]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:42:03 wikitech-static check_icinga[2409]: 2021-11-07 06:42:03,082 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:42:03 wikitech-static check_icinga[2408]: 2021-11-07 06:42:03,131 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:42:06 wikitech-static check_icinga[2408]: 2021-11-07 06:42:06,048 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:42:06 wikitech-static check_icinga[2409]: 2021-11-07 06:42:06,119 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:44:01 wikitech-static CRON[2507]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:44:01 wikitech-static CRON[2508]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:44:02 wikitech-static check_icinga[2509]: 2021-11-07 06:44:02,258 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:44:02 wikitech-static check_icinga[2510]: 2021-11-07 06:44:02,354 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:44:05 wikitech-static check_icinga[2509]: 2021-11-07 06:44:05,029 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:44:05 wikitech-static check_icinga[2510]: 2021-11-07 06:44:05,591 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:46:01 wikitech-static CRON[2587]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:46:01 wikitech-static CRON[2588]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:46:02 wikitech-static check_icinga[2589]: 2021-11-07 06:46:02,715 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:46:02 wikitech-static check_icinga[2590]: 2021-11-07 06:46:02,750 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:46:05 wikitech-static check_icinga[2589]: 2021-11-07 06:46:05,569 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:46:06 wikitech-static check_icinga[2590]: 2021-11-07 06:46:06,004 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:47:01 wikitech-static CRON[2634]: (root) CMD (test -x /usr/sbin/anacron || ( cd / && run-parts --report /etc/cron.weekly ))
Nov 7 06:48:01 wikitech-static CRON[2672]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:48:01 wikitech-static CRON[2673]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:48:02 wikitech-static check_icinga[2675]: 2021-11-07 06:48:02,422 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:48:02 wikitech-static check_icinga[2674]: 2021-11-07 06:48:02,449 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:48:05 wikitech-static check_icinga[2674]: 2021-11-07 06:48:05,549 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:48:05 wikitech-static check_icinga[2675]: 2021-11-07 06:48:05,678 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:50:01 wikitech-static CRON[2761]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:50:01 wikitech-static CRON[2763]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:50:02 wikitech-static check_icinga[2762]: 2021-11-07 06:50:02,814 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:50:02 wikitech-static check_icinga[2764]: 2021-11-07 06:50:02,831 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:50:05 wikitech-static check_icinga[2762]: 2021-11-07 06:50:05,989 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:50:06 wikitech-static check_icinga[2764]: 2021-11-07 06:50:06,123 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:52:01 wikitech-static CRON[2864]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:52:01 wikitech-static CRON[2865]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:52:02 wikitech-static check_icinga[2866]: 2021-11-07 06:52:02,244 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:52:02 wikitech-static check_icinga[2867]: 2021-11-07 06:52:02,275 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:52:05 wikitech-static check_icinga[2867]: 2021-11-07 06:52:05,324 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:52:05 wikitech-static check_icinga[2866]: 2021-11-07 06:52:05,345 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:54:01 wikitech-static CRON[2941]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:54:01 wikitech-static CRON[2942]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:54:02 wikitech-static check_icinga[2944]: 2021-11-07 06:54:02,585 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:54:02 wikitech-static check_icinga[2943]: 2021-11-07 06:54:02,589 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:54:05 wikitech-static check_icinga[2944]: 2021-11-07 06:54:05,828 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:54:05 wikitech-static check_icinga[2943]: 2021-11-07 06:54:05,880 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:56:02 wikitech-static CRON[3016]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:56:02 wikitech-static CRON[3017]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:56:03 wikitech-static check_icinga[3019]: 2021-11-07 06:56:03,037 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:56:03 wikitech-static check_icinga[3018]: 2021-11-07 06:56:03,072 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:56:06 wikitech-static check_icinga[3018]: 2021-11-07 06:56:06,194 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 06:56:06 wikitech-static check_icinga[3019]: 2021-11-07 06:56:06,243 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:58:01 wikitech-static CRON[3208]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 06:58:01 wikitech-static CRON[3209]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 06:58:02 wikitech-static check_icinga[3211]: 2021-11-07 06:58:02,466 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 06:58:02 wikitech-static check_icinga[3210]: 2021-11-07 06:58:02,486 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 06:58:05 wikitech-static check_icinga[3210]: 2021-11-07 06:58:05,642 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 06:58:05 wikitech-static check_icinga[3211]: 2021-11-07 06:58:05,736 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:00:01 wikitech-static CRON[3313]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:00:01 wikitech-static CRON[3314]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:00:02 wikitech-static check_icinga[3315]: 2021-11-07 07:00:02,866 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:00:02 wikitech-static check_icinga[3316]: 2021-11-07 07:00:02,896 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:00:06 wikitech-static check_icinga[3316]: 2021-11-07 07:00:06,066 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:00:06 wikitech-static check_icinga[3315]: 2021-11-07 07:00:06,102 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:02:01 wikitech-static CRON[3395]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:02:01 wikitech-static CRON[3396]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:02:02 wikitech-static check_icinga[3398]: 2021-11-07 07:02:02,545 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:02:02 wikitech-static check_icinga[3397]: 2021-11-07 07:02:02,571 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:02:05 wikitech-static check_icinga[3397]: 2021-11-07 07:02:05,567 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:02:05 wikitech-static check_icinga[3398]: 2021-11-07 07:02:05,771 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:04:01 wikitech-static CRON[3472]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:04:01 wikitech-static CRON[3473]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:04:02 wikitech-static check_icinga[3475]: 2021-11-07 07:04:02,878 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:04:02 wikitech-static check_icinga[3474]: 2021-11-07 07:04:02,907 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:04:06 wikitech-static check_icinga[3474]: 2021-11-07 07:04:06,035 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:04:06 wikitech-static check_icinga[3475]: 2021-11-07 07:04:06,237 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:06:01 wikitech-static CRON[3574]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:06:01 wikitech-static CRON[3575]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:06:02 wikitech-static check_icinga[3576]: 2021-11-07 07:06:02,385 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:06:02 wikitech-static check_icinga[3577]: 2021-11-07 07:06:02,453 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:06:05 wikitech-static check_icinga[3576]: 2021-11-07 07:06:05,645 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:06:05 wikitech-static check_icinga[3577]: 2021-11-07 07:06:05,804 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:08:01 wikitech-static CRON[3655]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:08:01 wikitech-static CRON[3656]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:08:02 wikitech-static check_icinga[3658]: 2021-11-07 07:08:02,903 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:08:02 wikitech-static check_icinga[3657]: 2021-11-07 07:08:02,905 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:08:06 wikitech-static check_icinga[3657]: 2021-11-07 07:08:06,021 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:08:06 wikitech-static check_icinga[3658]: 2021-11-07 07:08:06,074 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:09:01 wikitech-static CRON[3706]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 07:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 07:09:06 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 07:10:01 wikitech-static CRON[3823]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:10:01 wikitech-static CRON[3825]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:10:02 wikitech-static check_icinga[3824]: 2021-11-07 07:10:02,303 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:10:02 wikitech-static check_icinga[3826]: 2021-11-07 07:10:02,340 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:10:05 wikitech-static check_icinga[3826]: 2021-11-07 07:10:05,565 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:10:05 wikitech-static check_icinga[3824]: 2021-11-07 07:10:05,767 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:12:01 wikitech-static CRON[3915]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:12:01 wikitech-static CRON[3916]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:12:02 wikitech-static check_icinga[3917]: 2021-11-07 07:12:02,898 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:12:02 wikitech-static check_icinga[3918]: 2021-11-07 07:12:02,989 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:12:06 wikitech-static check_icinga[3917]: 2021-11-07 07:12:06,018 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:12:06 wikitech-static check_icinga[3918]: 2021-11-07 07:12:06,153 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:14:01 wikitech-static CRON[4078]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:14:01 wikitech-static CRON[4079]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:14:02 wikitech-static check_icinga[4081]: 2021-11-07 07:14:02,314 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:14:02 wikitech-static check_icinga[4080]: 2021-11-07 07:14:02,317 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:14:05 wikitech-static check_icinga[4080]: 2021-11-07 07:14:05,474 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:14:05 wikitech-static check_icinga[4081]: 2021-11-07 07:14:05,591 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:16:01 wikitech-static CRON[4153]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:16:01 wikitech-static CRON[4154]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:16:02 wikitech-static check_icinga[4155]: 2021-11-07 07:16:02,726 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:16:02 wikitech-static check_icinga[4156]: 2021-11-07 07:16:02,753 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:16:05 wikitech-static check_icinga[4156]: 2021-11-07 07:16:05,892 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:16:05 wikitech-static check_icinga[4155]: 2021-11-07 07:16:05,923 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:17:01 wikitech-static CRON[4202]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 07:18:01 wikitech-static CRON[4257]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:18:01 wikitech-static CRON[4258]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:18:02 wikitech-static check_icinga[4259]: 2021-11-07 07:18:02,167 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:18:02 wikitech-static check_icinga[4260]: 2021-11-07 07:18:02,170 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:18:05 wikitech-static check_icinga[4259]: 2021-11-07 07:18:05,344 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:18:05 wikitech-static check_icinga[4260]: 2021-11-07 07:18:05,514 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:20:01 wikitech-static CRON[4335]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:20:01 wikitech-static CRON[4336]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:20:02 wikitech-static check_icinga[4338]: 2021-11-07 07:20:02,665 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:20:02 wikitech-static check_icinga[4337]: 2021-11-07 07:20:02,669 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:20:05 wikitech-static check_icinga[4337]: 2021-11-07 07:20:05,865 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:20:06 wikitech-static check_icinga[4338]: 2021-11-07 07:20:06,014 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:22:01 wikitech-static CRON[4431]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:22:01 wikitech-static CRON[4433]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:22:02 wikitech-static check_icinga[4432]: 2021-11-07 07:22:02,172 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:22:02 wikitech-static check_icinga[4434]: 2021-11-07 07:22:02,186 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:22:05 wikitech-static check_icinga[4432]: 2021-11-07 07:22:05,233 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:22:05 wikitech-static check_icinga[4434]: 2021-11-07 07:22:05,416 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:24:01 wikitech-static CRON[4506]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:24:01 wikitech-static CRON[4507]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:24:02 wikitech-static check_icinga[4508]: 2021-11-07 07:24:02,554 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:24:02 wikitech-static check_icinga[4509]: 2021-11-07 07:24:02,558 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:24:05 wikitech-static check_icinga[4508]: 2021-11-07 07:24:05,654 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:24:05 wikitech-static check_icinga[4509]: 2021-11-07 07:24:05,716 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:26:01 wikitech-static CRON[4581]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:26:01 wikitech-static CRON[4582]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:26:02 wikitech-static check_icinga[4584]: 2021-11-07 07:26:02,889 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:26:02 wikitech-static check_icinga[4583]: 2021-11-07 07:26:02,916 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:26:06 wikitech-static check_icinga[4584]: 2021-11-07 07:26:06,080 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:26:06 wikitech-static check_icinga[4583]: 2021-11-07 07:26:06,154 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:28:01 wikitech-static CRON[4656]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:28:01 wikitech-static CRON[4657]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:28:02 wikitech-static check_icinga[4658]: 2021-11-07 07:28:02,536 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:28:02 wikitech-static check_icinga[4659]: 2021-11-07 07:28:02,566 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:28:05 wikitech-static check_icinga[4658]: 2021-11-07 07:28:05,676 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:28:05 wikitech-static check_icinga[4659]: 2021-11-07 07:28:05,954 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:30:01 wikitech-static CRON[4736]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:30:01 wikitech-static CRON[4738]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:30:02 wikitech-static check_icinga[4737]: 2021-11-07 07:30:02,132 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:30:02 wikitech-static check_icinga[4739]: 2021-11-07 07:30:02,137 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:30:05 wikitech-static check_icinga[4739]: 2021-11-07 07:30:05,277 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:30:05 wikitech-static check_icinga[4737]: 2021-11-07 07:30:05,358 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:32:01 wikitech-static CRON[4811]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:32:01 wikitech-static CRON[4812]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:32:02 wikitech-static check_icinga[4813]: 2021-11-07 07:32:02,474 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:32:02 wikitech-static check_icinga[4814]: 2021-11-07 07:32:02,477 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:32:05 wikitech-static check_icinga[4813]: 2021-11-07 07:32:05,522 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:32:05 wikitech-static check_icinga[4814]: 2021-11-07 07:32:05,687 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:34:01 wikitech-static CRON[4946]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:34:01 wikitech-static CRON[4947]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:34:02 wikitech-static check_icinga[4949]: 2021-11-07 07:34:02,810 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:34:02 wikitech-static check_icinga[4948]: 2021-11-07 07:34:02,813 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:34:04 wikitech-static check_icinga[4948]: 2021-11-07 07:34:04,259 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)']
Nov 7 07:34:05 wikitech-static check_icinga[4949]: 2021-11-07 07:34:05,879 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:34:14 wikitech-static check_icinga[4948]: 2021-11-07 07:34:14,298 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:34:16 wikitech-static check_icinga[4948]: 2021-11-07 07:34:16,863 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:36:01 wikitech-static CRON[5027]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:36:01 wikitech-static CRON[5028]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:36:03 wikitech-static check_icinga[5030]: 2021-11-07 07:36:03,001 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:36:03 wikitech-static check_icinga[5029]: 2021-11-07 07:36:03,039 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:36:05 wikitech-static check_icinga[5030]: 2021-11-07 07:36:05,823 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:36:06 wikitech-static check_icinga[5029]: 2021-11-07 07:36:06,189 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:38:01 wikitech-static CRON[5102]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:38:01 wikitech-static CRON[5103]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:38:02 wikitech-static check_icinga[5104]: 2021-11-07 07:38:02,342 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:38:02 wikitech-static check_icinga[5105]: 2021-11-07 07:38:02,373 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:38:05 wikitech-static check_icinga[5104]: 2021-11-07 07:38:05,062 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:38:05 wikitech-static check_icinga[5105]: 2021-11-07 07:38:05,578 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:39:01 wikitech-static CRON[5154]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 07:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 07:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 07:40:01 wikitech-static CRON[5280]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:40:01 wikitech-static CRON[5281]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:40:02 wikitech-static check_icinga[5283]: 2021-11-07 07:40:02,759 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:40:02 wikitech-static check_icinga[5282]: 2021-11-07 07:40:02,760 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:40:05 wikitech-static check_icinga[5282]: 2021-11-07 07:40:05,572 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:40:05 wikitech-static check_icinga[5283]: 2021-11-07 07:40:05,859 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:42:01 wikitech-static CRON[5364]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:42:01 wikitech-static CRON[5365]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:42:03 wikitech-static check_icinga[5366]: 2021-11-07 07:42:03,015 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:42:03 wikitech-static check_icinga[5367]: 2021-11-07 07:42:03,022 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:42:05 wikitech-static check_icinga[5366]: 2021-11-07 07:42:05,791 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:42:06 wikitech-static check_icinga[5367]: 2021-11-07 07:42:06,398 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:44:01 wikitech-static CRON[5439]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:44:01 wikitech-static CRON[5440]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:44:02 wikitech-static check_icinga[5441]: 2021-11-07 07:44:02,778 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:44:02 wikitech-static check_icinga[5442]: 2021-11-07 07:44:02,782 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:44:05 wikitech-static check_icinga[5442]: 2021-11-07 07:44:05,877 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:44:05 wikitech-static check_icinga[5441]: 2021-11-07 07:44:05,892 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:46:01 wikitech-static CRON[5520]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:46:01 wikitech-static CRON[5521]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:46:02 wikitech-static check_icinga[5522]: 2021-11-07 07:46:02,137 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:46:02 wikitech-static check_icinga[5523]: 2021-11-07 07:46:02,144 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:46:05 wikitech-static check_icinga[5522]: 2021-11-07 07:46:05,041 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:46:05 wikitech-static check_icinga[5523]: 2021-11-07 07:46:05,300 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:48:01 wikitech-static CRON[5604]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:48:01 wikitech-static CRON[5605]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:48:02 wikitech-static check_icinga[5606]: 2021-11-07 07:48:02,409 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:48:02 wikitech-static check_icinga[5607]: 2021-11-07 07:48:02,438 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:48:05 wikitech-static check_icinga[5606]: 2021-11-07 07:48:05,465 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:48:05 wikitech-static check_icinga[5607]: 2021-11-07 07:48:05,555 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:50:01 wikitech-static CRON[5697]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:50:01 wikitech-static CRON[5698]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:50:02 wikitech-static check_icinga[5700]: 2021-11-07 07:50:02,656 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:50:02 wikitech-static check_icinga[5699]: 2021-11-07 07:50:02,679 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:50:05 wikitech-static check_icinga[5700]: 2021-11-07 07:50:05,731 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:50:05 wikitech-static check_icinga[5699]: 2021-11-07 07:50:05,879 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:52:01 wikitech-static CRON[5778]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:52:01 wikitech-static CRON[5779]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:52:03 wikitech-static check_icinga[5781]: 2021-11-07 07:52:03,030 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:52:03 wikitech-static check_icinga[5780]: 2021-11-07 07:52:03,035 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:52:06 wikitech-static check_icinga[5780]: 2021-11-07 07:52:06,153 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:52:06 wikitech-static check_icinga[5781]: 2021-11-07 07:52:06,250 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:54:01 wikitech-static CRON[5872]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:54:01 wikitech-static CRON[5873]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:54:02 wikitech-static check_icinga[5874]: 2021-11-07 07:54:02,415 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:54:02 wikitech-static check_icinga[5875]: 2021-11-07 07:54:02,422 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:54:05 wikitech-static check_icinga[5874]: 2021-11-07 07:54:05,519 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:54:05 wikitech-static check_icinga[5875]: 2021-11-07 07:54:05,596 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:56:01 wikitech-static CRON[5947]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:56:01 wikitech-static CRON[5948]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:56:02 wikitech-static check_icinga[5950]: 2021-11-07 07:56:02,716 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:56:02 wikitech-static check_icinga[5949]: 2021-11-07 07:56:02,741 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:56:05 wikitech-static check_icinga[5950]: 2021-11-07 07:56:05,799 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 07:56:05 wikitech-static check_icinga[5949]: 2021-11-07 07:56:05,816 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:58:01 wikitech-static CRON[6040]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 07:58:02 wikitech-static CRON[6042]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 07:58:03 wikitech-static check_icinga[6041]: 2021-11-07 07:58:03,000 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 07:58:03 wikitech-static check_icinga[6043]: 2021-11-07 07:58:03,072 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 07:58:06 wikitech-static check_icinga[6041]: 2021-11-07 07:58:06,156 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 07:58:06 wikitech-static check_icinga[6043]: 2021-11-07 07:58:06,493 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:00:01 wikitech-static CRON[6125]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:00:01 wikitech-static CRON[6126]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:00:02 wikitech-static check_icinga[6128]: 2021-11-07 08:00:02,695 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:00:02 wikitech-static check_icinga[6127]: 2021-11-07 08:00:02,699 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:00:05 wikitech-static check_icinga[6128]: 2021-11-07 08:00:05,806 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:00:06 wikitech-static check_icinga[6127]: 2021-11-07 08:00:06,012 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:02:01 wikitech-static CRON[6202]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:02:01 wikitech-static CRON[6204]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:02:02 wikitech-static check_icinga[6205]: 2021-11-07 08:02:02,266 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:02:02 wikitech-static check_icinga[6203]: 2021-11-07 08:02:02,270 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:02:05 wikitech-static check_icinga[6203]: 2021-11-07 08:02:05,299 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:02:05 wikitech-static check_icinga[6205]: 2021-11-07 08:02:05,375 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:04:01 wikitech-static CRON[6280]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:04:01 wikitech-static CRON[6281]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:04:02 wikitech-static check_icinga[6282]: 2021-11-07 08:04:02,537 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:04:02 wikitech-static check_icinga[6283]: 2021-11-07 08:04:02,566 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:04:05 wikitech-static check_icinga[6282]: 2021-11-07 08:04:05,712 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:04:05 wikitech-static check_icinga[6283]: 2021-11-07 08:04:05,742 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:06:01 wikitech-static CRON[6358]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:06:01 wikitech-static CRON[6359]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:06:02 wikitech-static check_icinga[6361]: 2021-11-07 08:06:02,963 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:06:02 wikitech-static check_icinga[6360]: 2021-11-07 08:06:02,966 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:06:06 wikitech-static check_icinga[6361]: 2021-11-07 08:06:06,197 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:06:06 wikitech-static check_icinga[6360]: 2021-11-07 08:06:06,368 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:08:01 wikitech-static CRON[6438]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:08:01 wikitech-static CRON[6439]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:08:03 wikitech-static check_icinga[6441]: 2021-11-07 08:08:03,161 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:08:03 wikitech-static check_icinga[6440]: 2021-11-07 08:08:03,163 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:08:06 wikitech-static check_icinga[6440]: 2021-11-07 08:08:06,246 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:08:06 wikitech-static check_icinga[6441]: 2021-11-07 08:08:06,296 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:09:01 wikitech-static CRON[6485]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 08:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 08:09:07 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 08:10:01 wikitech-static CRON[6608]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:10:01 wikitech-static CRON[6610]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:10:02 wikitech-static check_icinga[6612]: 2021-11-07 08:10:02,566 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:10:02 wikitech-static check_icinga[6611]: 2021-11-07 08:10:02,582 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:10:05 wikitech-static check_icinga[6612]: 2021-11-07 08:10:05,700 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:10:05 wikitech-static check_icinga[6611]: 2021-11-07 08:10:05,764 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:11:01 wikitech-static CRON[6659]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh)
Nov 7 08:11:02 wikitech-static check_icinga_validate_config[6660]: Valid config, nothing to do.
Nov 7 08:12:01 wikitech-static CRON[6692]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:12:01 wikitech-static CRON[6693]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:12:02 wikitech-static check_icinga[6695]: 2021-11-07 08:12:02,914 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:12:02 wikitech-static check_icinga[6694]: 2021-11-07 08:12:02,919 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:12:05 wikitech-static check_icinga[6694]: 2021-11-07 08:12:05,879 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:12:06 wikitech-static check_icinga[6695]: 2021-11-07 08:12:06,060 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:14:01 wikitech-static CRON[6767]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:14:01 wikitech-static CRON[6768]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:14:02 wikitech-static check_icinga[6769]: 2021-11-07 08:14:02,182 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:14:02 wikitech-static check_icinga[6770]: 2021-11-07 08:14:02,207 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:14:05 wikitech-static check_icinga[6769]: 2021-11-07 08:14:05,261 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:14:05 wikitech-static check_icinga[6770]: 2021-11-07 08:14:05,433 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:16:01 wikitech-static CRON[6843]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:16:01 wikitech-static CRON[6844]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:16:02 wikitech-static check_icinga[6846]: 2021-11-07 08:16:02,743 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:16:02 wikitech-static check_icinga[6845]: 2021-11-07 08:16:02,768 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:16:06 wikitech-static check_icinga[6846]: 2021-11-07 08:16:06,017 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:16:06 wikitech-static check_icinga[6845]: 2021-11-07 08:16:06,072 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:17:01 wikitech-static CRON[6890]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 08:18:01 wikitech-static CRON[6922]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:18:01 wikitech-static CRON[6923]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:18:03 wikitech-static check_icinga[6924]: 2021-11-07 08:18:03,218 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:18:03 wikitech-static check_icinga[6925]: 2021-11-07 08:18:03,221 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:18:06 wikitech-static check_icinga[6924]: 2021-11-07 08:18:06,165 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:18:06 wikitech-static check_icinga[6925]: 2021-11-07 08:18:06,336 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:19:02 wikitech-static systemd[1]: Started Session 1081818 of user root.
Nov 7 08:19:03 wikitech-static systemd[1]: Started Session 1081819 of user root.
Nov 7 08:20:01 wikitech-static CRON[7022]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:20:01 wikitech-static CRON[7023]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:20:02 wikitech-static check_icinga[7025]: 2021-11-07 08:20:02,473 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:20:02 wikitech-static check_icinga[7024]: 2021-11-07 08:20:02,476 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:20:05 wikitech-static check_icinga[7024]: 2021-11-07 08:20:05,529 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:20:05 wikitech-static check_icinga[7025]: 2021-11-07 08:20:05,820 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:22:01 wikitech-static CRON[7100]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:22:01 wikitech-static CRON[7102]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:22:02 wikitech-static check_icinga[7103]: 2021-11-07 08:22:02,950 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:22:02 wikitech-static check_icinga[7101]: 2021-11-07 08:22:02,963 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:22:05 wikitech-static check_icinga[7101]: 2021-11-07 08:22:05,977 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:22:06 wikitech-static check_icinga[7103]: 2021-11-07 08:22:06,104 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:24:01 wikitech-static CRON[7199]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:24:01 wikitech-static CRON[7200]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:24:02 wikitech-static check_icinga[7201]: 2021-11-07 08:24:02,230 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:24:02 wikitech-static check_icinga[7202]: 2021-11-07 08:24:02,306 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:24:05 wikitech-static check_icinga[7201]: 2021-11-07 08:24:05,266 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:24:05 wikitech-static check_icinga[7202]: 2021-11-07 08:24:05,777 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:26:01 wikitech-static CRON[7276]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:26:01 wikitech-static CRON[7277]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:26:02 wikitech-static check_icinga[7279]: 2021-11-07 08:26:02,940 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:26:02 wikitech-static check_icinga[7278]: 2021-11-07 08:26:02,946 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:26:05 wikitech-static check_icinga[7278]: 2021-11-07 08:26:05,862 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:26:05 wikitech-static check_icinga[7279]: 2021-11-07 08:26:05,945 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:28:01 wikitech-static CRON[7353]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:28:01 wikitech-static CRON[7354]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:28:02 wikitech-static check_icinga[7356]: 2021-11-07 08:28:02,161 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:28:02 wikitech-static check_icinga[7355]: 2021-11-07 08:28:02,253 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:28:05 wikitech-static check_icinga[7355]: 2021-11-07 08:28:05,393 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:28:05 wikitech-static check_icinga[7356]: 2021-11-07 08:28:05,498 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:30:01 wikitech-static CRON[7432]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:30:01 wikitech-static CRON[7433]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:30:02 wikitech-static check_icinga[7435]: 2021-11-07 08:30:02,755 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:30:02 wikitech-static check_icinga[7434]: 2021-11-07 08:30:02,758 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:30:05 wikitech-static check_icinga[7435]: 2021-11-07 08:30:05,934 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:30:05 wikitech-static check_icinga[7434]: 2021-11-07 08:30:05,999 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:32:01 wikitech-static CRON[7511]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:32:01 wikitech-static CRON[7512]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:32:02 wikitech-static check_icinga[7514]: 2021-11-07 08:32:02,157 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:32:02 wikitech-static check_icinga[7513]: 2021-11-07 08:32:02,161 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:32:05 wikitech-static check_icinga[7513]: 2021-11-07 08:32:05,134 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:32:05 wikitech-static check_icinga[7514]: 2021-11-07 08:32:05,417 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:34:01 wikitech-static CRON[7595]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:34:01 wikitech-static CRON[7596]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:34:02 wikitech-static check_icinga[7597]: 2021-11-07 08:34:02,661 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:34:02 wikitech-static check_icinga[7598]: 2021-11-07 08:34:02,742 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:34:04 wikitech-static check_icinga[7598]: 2021-11-07 08:34:04,126 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')"]
Nov 7 08:34:05 wikitech-static check_icinga[7597]: 2021-11-07 08:34:05,845 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:34:14 wikitech-static check_icinga[7598]: 2021-11-07 08:34:14,170 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:34:17 wikitech-static check_icinga[7598]: 2021-11-07 08:34:17,066 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:36:01 wikitech-static CRON[7672]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:36:01 wikitech-static CRON[7674]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:36:02 wikitech-static check_icinga[7675]: 2021-11-07 08:36:02,230 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:36:02 wikitech-static check_icinga[7673]: 2021-11-07 08:36:02,306 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:36:05 wikitech-static check_icinga[7673]: 2021-11-07 08:36:05,112 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:36:05 wikitech-static check_icinga[7675]: 2021-11-07 08:36:05,232 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:38:01 wikitech-static CRON[7747]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:38:01 wikitech-static CRON[7748]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:38:02 wikitech-static check_icinga[7749]: 2021-11-07 08:38:02,388 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:38:02 wikitech-static check_icinga[7750]: 2021-11-07 08:38:02,482 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:38:05 wikitech-static check_icinga[7749]: 2021-11-07 08:38:05,156 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:38:05 wikitech-static check_icinga[7750]: 2021-11-07 08:38:05,710 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:39:01 wikitech-static CRON[7794]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 08:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 08:39:06 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 08:40:01 wikitech-static CRON[7920]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:40:01 wikitech-static CRON[7921]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:40:02 wikitech-static check_icinga[7922]: 2021-11-07 08:40:02,816 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:40:02 wikitech-static check_icinga[7923]: 2021-11-07 08:40:02,841 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:40:05 wikitech-static check_icinga[7922]: 2021-11-07 08:40:05,573 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:40:06 wikitech-static check_icinga[7923]: 2021-11-07 08:40:06,187 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:42:01 wikitech-static CRON[7995]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:42:01 wikitech-static CRON[7996]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:42:02 wikitech-static check_icinga[7997]: 2021-11-07 08:42:02,386 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:42:02 wikitech-static check_icinga[7998]: 2021-11-07 08:42:02,415 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:42:05 wikitech-static check_icinga[7998]: 2021-11-07 08:42:05,272 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:42:05 wikitech-static check_icinga[7997]: 2021-11-07 08:42:05,487 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:44:01 wikitech-static CRON[8074]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:44:01 wikitech-static CRON[8075]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:44:02 wikitech-static check_icinga[8076]: 2021-11-07 08:44:02,631 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:44:02 wikitech-static check_icinga[8077]: 2021-11-07 08:44:02,634 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:44:05 wikitech-static check_icinga[8076]: 2021-11-07 08:44:05,480 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:44:05 wikitech-static check_icinga[8077]: 2021-11-07 08:44:05,796 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:46:01 wikitech-static CRON[8155]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:46:01 wikitech-static CRON[8156]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:46:02 wikitech-static check_icinga[8158]: 2021-11-07 08:46:02,909 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:46:02 wikitech-static check_icinga[8157]: 2021-11-07 08:46:02,939 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:46:06 wikitech-static check_icinga[8157]: 2021-11-07 08:46:06,065 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:46:06 wikitech-static check_icinga[8158]: 2021-11-07 08:46:06,170 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:48:01 wikitech-static CRON[8233]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:48:01 wikitech-static CRON[8234]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:48:02 wikitech-static check_icinga[8236]: 2021-11-07 08:48:02,463 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:48:02 wikitech-static check_icinga[8235]: 2021-11-07 08:48:02,489 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:48:05 wikitech-static check_icinga[8235]: 2021-11-07 08:48:05,466 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:48:05 wikitech-static check_icinga[8236]: 2021-11-07 08:48:05,655 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:50:01 wikitech-static CRON[8308]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:50:01 wikitech-static CRON[8310]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:50:02 wikitech-static check_icinga[8311]: 2021-11-07 08:50:02,813 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:50:02 wikitech-static check_icinga[8309]: 2021-11-07 08:50:02,822 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:50:05 wikitech-static check_icinga[8309]: 2021-11-07 08:50:05,887 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:50:05 wikitech-static check_icinga[8311]: 2021-11-07 08:50:05,929 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:52:01 wikitech-static CRON[8392]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:52:01 wikitech-static CRON[8393]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:52:02 wikitech-static check_icinga[8394]: 2021-11-07 08:52:02,123 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:52:02 wikitech-static check_icinga[8395]: 2021-11-07 08:52:02,189 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:52:05 wikitech-static check_icinga[8394]: 2021-11-07 08:52:05,214 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:52:05 wikitech-static check_icinga[8395]: 2021-11-07 08:52:05,447 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:54:01 wikitech-static CRON[8469]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:54:01 wikitech-static CRON[8470]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:54:02 wikitech-static check_icinga[8472]: 2021-11-07 08:54:02,591 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:54:02 wikitech-static check_icinga[8471]: 2021-11-07 08:54:02,600 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:54:05 wikitech-static check_icinga[8471]: 2021-11-07 08:54:05,786 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:54:05 wikitech-static check_icinga[8472]: 2021-11-07 08:54:05,824 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:56:01 wikitech-static CRON[8544]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:56:01 wikitech-static CRON[8545]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:56:03 wikitech-static check_icinga[8547]: 2021-11-07 08:56:03,026 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:56:03 wikitech-static check_icinga[8546]: 2021-11-07 08:56:03,029 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:56:06 wikitech-static check_icinga[8547]: 2021-11-07 08:56:06,067 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:56:06 wikitech-static check_icinga[8546]: 2021-11-07 08:56:06,179 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 08:58:01 wikitech-static CRON[8621]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 08:58:01 wikitech-static CRON[8623]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 08:58:02 wikitech-static check_icinga[8622]: 2021-11-07 08:58:02,442 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 08:58:02 wikitech-static check_icinga[8624]: 2021-11-07 08:58:02,449 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 08:58:05 wikitech-static check_icinga[8622]: 2021-11-07 08:58:05,463 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 08:58:05 wikitech-static check_icinga[8624]: 2021-11-07 08:58:05,595 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:00:01 wikitech-static CRON[8760]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:00:01 wikitech-static CRON[8761]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:00:02 wikitech-static check_icinga[8762]: 2021-11-07 09:00:02,735 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:00:02 wikitech-static check_icinga[8763]: 2021-11-07 09:00:02,761 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:00:05 wikitech-static check_icinga[8762]: 2021-11-07 09:00:05,686 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:00:05 wikitech-static check_icinga[8763]: 2021-11-07 09:00:05,861 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:02:01 wikitech-static CRON[8835]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:02:01 wikitech-static CRON[8836]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:02:02 wikitech-static check_icinga[8838]: 2021-11-07 09:02:02,960 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:02:02 wikitech-static check_icinga[8837]: 2021-11-07 09:02:02,987 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:02:05 wikitech-static check_icinga[8837]: 2021-11-07 09:02:05,954 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:02:06 wikitech-static check_icinga[8838]: 2021-11-07 09:02:06,125 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:04:01 wikitech-static CRON[8918]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:04:01 wikitech-static CRON[8919]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:04:02 wikitech-static check_icinga[8920]: 2021-11-07 09:04:02,274 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:04:02 wikitech-static check_icinga[8921]: 2021-11-07 09:04:02,282 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:04:05 wikitech-static check_icinga[8920]: 2021-11-07 09:04:05,379 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:04:05 wikitech-static check_icinga[8921]: 2021-11-07 09:04:05,514 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:06:01 wikitech-static CRON[8995]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:06:01 wikitech-static CRON[8996]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:06:02 wikitech-static check_icinga[8997]: 2021-11-07 09:06:02,792 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:06:02 wikitech-static check_icinga[8998]: 2021-11-07 09:06:02,794 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:06:05 wikitech-static check_icinga[8998]: 2021-11-07 09:06:05,836 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:06:05 wikitech-static check_icinga[8997]: 2021-11-07 09:06:05,987 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:08:01 wikitech-static CRON[9076]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:08:01 wikitech-static CRON[9077]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:08:02 wikitech-static check_icinga[9079]: 2021-11-07 09:08:02,103 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:08:02 wikitech-static check_icinga[9078]: 2021-11-07 09:08:02,162 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:08:05 wikitech-static check_icinga[9078]: 2021-11-07 09:08:05,257 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:08:05 wikitech-static check_icinga[9079]: 2021-11-07 09:08:05,280 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:09:01 wikitech-static CRON[9127]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 09:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 09:09:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 09:10:01 wikitech-static CRON[9253]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:10:01 wikitech-static CRON[9254]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:10:02 wikitech-static check_icinga[9256]: 2021-11-07 09:10:02,634 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:10:02 wikitech-static check_icinga[9255]: 2021-11-07 09:10:02,641 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:10:05 wikitech-static check_icinga[9256]: 2021-11-07 09:10:05,625 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:10:05 wikitech-static check_icinga[9255]: 2021-11-07 09:10:05,654 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:12:01 wikitech-static CRON[9333]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:12:01 wikitech-static CRON[9334]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:12:02 wikitech-static check_icinga[9336]: 2021-11-07 09:12:02,858 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:12:02 wikitech-static check_icinga[9335]: 2021-11-07 09:12:02,861 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:12:05 wikitech-static check_icinga[9336]: 2021-11-07 09:12:05,875 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:12:06 wikitech-static check_icinga[9335]: 2021-11-07 09:12:06,098 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:14:01 wikitech-static CRON[9410]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:14:01 wikitech-static CRON[9411]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:14:02 wikitech-static check_icinga[9412]: 2021-11-07 09:14:02,235 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:14:02 wikitech-static check_icinga[9413]: 2021-11-07 09:14:02,264 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:14:05 wikitech-static check_icinga[9413]: 2021-11-07 09:14:05,406 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:14:05 wikitech-static check_icinga[9412]: 2021-11-07 09:14:05,452 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:16:01 wikitech-static CRON[9517]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:16:01 wikitech-static CRON[9518]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:16:02 wikitech-static check_icinga[9520]: 2021-11-07 09:16:02,664 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:16:02 wikitech-static check_icinga[9519]: 2021-11-07 09:16:02,678 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:16:05 wikitech-static check_icinga[9520]: 2021-11-07 09:16:05,687 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:16:05 wikitech-static check_icinga[9519]: 2021-11-07 09:16:05,779 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:17:01 wikitech-static CRON[9564]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 09:18:01 wikitech-static CRON[9602]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:18:01 wikitech-static CRON[9603]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:18:03 wikitech-static check_icinga[9604]: 2021-11-07 09:18:03,383 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:18:03 wikitech-static check_icinga[9605]: 2021-11-07 09:18:03,409 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:18:06 wikitech-static check_icinga[9605]: 2021-11-07 09:18:06,444 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:18:06 wikitech-static check_icinga[9604]: 2021-11-07 09:18:06,503 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:20:01 wikitech-static CRON[9677]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:20:01 wikitech-static CRON[9678]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:20:02 wikitech-static check_icinga[9680]: 2021-11-07 09:20:02,724 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:20:02 wikitech-static check_icinga[9679]: 2021-11-07 09:20:02,729 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:20:05 wikitech-static check_icinga[9679]: 2021-11-07 09:20:05,895 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:20:06 wikitech-static check_icinga[9680]: 2021-11-07 09:20:06,013 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:22:01 wikitech-static CRON[9752]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:22:01 wikitech-static CRON[9753]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:22:02 wikitech-static check_icinga[9755]: 2021-11-07 09:22:02,175 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:22:02 wikitech-static check_icinga[9754]: 2021-11-07 09:22:02,181 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:22:05 wikitech-static check_icinga[9754]: 2021-11-07 09:22:05,307 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:22:05 wikitech-static check_icinga[9755]: 2021-11-07 09:22:05,319 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:24:01 wikitech-static CRON[9827]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:24:01 wikitech-static CRON[9828]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:24:02 wikitech-static check_icinga[9830]: 2021-11-07 09:24:02,544 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:24:02 wikitech-static check_icinga[9829]: 2021-11-07 09:24:02,638 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:24:05 wikitech-static check_icinga[9829]: 2021-11-07 09:24:05,667 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:24:05 wikitech-static check_icinga[9830]: 2021-11-07 09:24:05,845 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:26:01 wikitech-static CRON[9902]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:26:01 wikitech-static CRON[9903]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:26:03 wikitech-static check_icinga[9904]: 2021-11-07 09:26:03,053 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:26:03 wikitech-static check_icinga[9905]: 2021-11-07 09:26:03,151 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:26:06 wikitech-static check_icinga[9904]: 2021-11-07 09:26:06,068 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:26:06 wikitech-static check_icinga[9905]: 2021-11-07 09:26:06,382 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:28:01 wikitech-static CRON[9980]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:28:01 wikitech-static CRON[9981]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:28:02 wikitech-static check_icinga[9983]: 2021-11-07 09:28:02,531 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:28:02 wikitech-static check_icinga[9982]: 2021-11-07 09:28:02,616 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:28:05 wikitech-static check_icinga[9983]: 2021-11-07 09:28:05,595 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:28:05 wikitech-static check_icinga[9982]: 2021-11-07 09:28:05,828 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:30:01 wikitech-static CRON[10055]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:30:01 wikitech-static CRON[10057]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:30:02 wikitech-static check_icinga[10056]: 2021-11-07 09:30:02,951 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:30:02 wikitech-static check_icinga[10058]: 2021-11-07 09:30:02,965 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:30:05 wikitech-static check_icinga[10056]: 2021-11-07 09:30:05,895 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:30:06 wikitech-static check_icinga[10058]: 2021-11-07 09:30:06,247 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:32:01 wikitech-static CRON[10133]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:32:01 wikitech-static CRON[10134]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:32:02 wikitech-static check_icinga[10136]: 2021-11-07 09:32:02,502 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:32:02 wikitech-static check_icinga[10135]: 2021-11-07 09:32:02,566 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:32:05 wikitech-static check_icinga[10136]: 2021-11-07 09:32:05,608 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:32:05 wikitech-static check_icinga[10135]: 2021-11-07 09:32:05,806 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:34:01 wikitech-static CRON[10208]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:34:01 wikitech-static CRON[10209]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:34:02 wikitech-static check_icinga[10211]: 2021-11-07 09:34:02,952 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:34:02 wikitech-static check_icinga[10210]: 2021-11-07 09:34:02,959 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:34:04 wikitech-static check_icinga[10210]: 2021-11-07 09:34:04,321 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)']
Nov 7 09:34:06 wikitech-static check_icinga[10211]: 2021-11-07 09:34:06,282 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:34:14 wikitech-static check_icinga[10210]: 2021-11-07 09:34:14,334 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:34:17 wikitech-static check_icinga[10210]: 2021-11-07 09:34:17,180 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:36:01 wikitech-static CRON[10283]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:36:01 wikitech-static CRON[10284]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:36:02 wikitech-static check_icinga[10285]: 2021-11-07 09:36:02,320 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:36:02 wikitech-static check_icinga[10286]: 2021-11-07 09:36:02,335 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:36:05 wikitech-static check_icinga[10285]: 2021-11-07 09:36:05,188 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:36:05 wikitech-static check_icinga[10286]: 2021-11-07 09:36:05,677 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:38:01 wikitech-static CRON[10361]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:38:01 wikitech-static CRON[10362]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:38:02 wikitech-static check_icinga[10364]: 2021-11-07 09:38:02,924 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:38:03 wikitech-static check_icinga[10363]: 2021-11-07 09:38:03,004 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:38:05 wikitech-static check_icinga[10363]: 2021-11-07 09:38:05,937 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:38:06 wikitech-static check_icinga[10364]: 2021-11-07 09:38:06,231 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:39:01 wikitech-static CRON[10408]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 09:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 09:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 09:40:01 wikitech-static CRON[10530]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:40:01 wikitech-static CRON[10531]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:40:02 wikitech-static check_icinga[10532]: 2021-11-07 09:40:02,357 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:40:02 wikitech-static check_icinga[10533]: 2021-11-07 09:40:02,380 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:40:05 wikitech-static check_icinga[10532]: 2021-11-07 09:40:05,019 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:40:05 wikitech-static check_icinga[10533]: 2021-11-07 09:40:05,553 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:42:01 wikitech-static CRON[10617]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:42:01 wikitech-static CRON[10618]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:42:02 wikitech-static check_icinga[10620]: 2021-11-07 09:42:02,697 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:42:02 wikitech-static check_icinga[10619]: 2021-11-07 09:42:02,701 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:42:05 wikitech-static check_icinga[10619]: 2021-11-07 09:42:05,455 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:42:05 wikitech-static check_icinga[10620]: 2021-11-07 09:42:05,845 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:44:01 wikitech-static CRON[10692]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:44:01 wikitech-static CRON[10693]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:44:02 wikitech-static check_icinga[10695]: 2021-11-07 09:44:02,931 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:44:02 wikitech-static check_icinga[10694]: 2021-11-07 09:44:02,962 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:44:05 wikitech-static check_icinga[10695]: 2021-11-07 09:44:05,822 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:44:05 wikitech-static check_icinga[10694]: 2021-11-07 09:44:05,963 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:46:01 wikitech-static CRON[10767]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:46:01 wikitech-static CRON[10768]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:46:02 wikitech-static check_icinga[10769]: 2021-11-07 09:46:02,146 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:46:02 wikitech-static check_icinga[10770]: 2021-11-07 09:46:02,168 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:46:05 wikitech-static check_icinga[10769]: 2021-11-07 09:46:05,005 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:46:05 wikitech-static check_icinga[10770]: 2021-11-07 09:46:05,404 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:48:01 wikitech-static CRON[10842]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:48:01 wikitech-static CRON[10843]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:48:02 wikitech-static check_icinga[10844]: 2021-11-07 09:48:02,538 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:48:02 wikitech-static check_icinga[10845]: 2021-11-07 09:48:02,544 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:48:05 wikitech-static check_icinga[10845]: 2021-11-07 09:48:05,576 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:48:05 wikitech-static check_icinga[10844]: 2021-11-07 09:48:05,870 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:50:01 wikitech-static CRON[10917]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:50:01 wikitech-static CRON[10918]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:50:02 wikitech-static check_icinga[10919]: 2021-11-07 09:50:02,226 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:50:02 wikitech-static check_icinga[10920]: 2021-11-07 09:50:02,294 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:50:05 wikitech-static check_icinga[10919]: 2021-11-07 09:50:05,284 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:50:05 wikitech-static check_icinga[10920]: 2021-11-07 09:50:05,574 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:52:01 wikitech-static CRON[10995]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:52:01 wikitech-static CRON[10996]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:52:02 wikitech-static check_icinga[10997]: 2021-11-07 09:52:02,744 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:52:02 wikitech-static check_icinga[10998]: 2021-11-07 09:52:02,810 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:52:05 wikitech-static check_icinga[10997]: 2021-11-07 09:52:05,783 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:52:05 wikitech-static check_icinga[10998]: 2021-11-07 09:52:05,961 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:54:01 wikitech-static CRON[11070]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:54:01 wikitech-static CRON[11071]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:54:02 wikitech-static check_icinga[11072]: 2021-11-07 09:54:02,401 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:54:02 wikitech-static check_icinga[11073]: 2021-11-07 09:54:02,404 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:54:05 wikitech-static check_icinga[11073]: 2021-11-07 09:54:05,500 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:54:05 wikitech-static check_icinga[11072]: 2021-11-07 09:54:05,606 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:56:01 wikitech-static CRON[11145]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:56:01 wikitech-static CRON[11146]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:56:02 wikitech-static check_icinga[11147]: 2021-11-07 09:56:02,763 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:56:02 wikitech-static check_icinga[11148]: 2021-11-07 09:56:02,768 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:56:05 wikitech-static check_icinga[11147]: 2021-11-07 09:56:05,844 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:56:05 wikitech-static check_icinga[11148]: 2021-11-07 09:56:05,953 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 09:58:01 wikitech-static CRON[11220]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 09:58:01 wikitech-static CRON[11222]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 09:58:02 wikitech-static check_icinga[11223]: 2021-11-07 09:58:02,095 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 09:58:02 wikitech-static check_icinga[11221]: 2021-11-07 09:58:02,111 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 09:58:05 wikitech-static check_icinga[11221]: 2021-11-07 09:58:05,179 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 09:58:05 wikitech-static check_icinga[11223]: 2021-11-07 09:58:05,338 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:00:01 wikitech-static CRON[11295]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:00:01 wikitech-static CRON[11296]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:00:02 wikitech-static check_icinga[11297]: 2021-11-07 10:00:02,500 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:00:02 wikitech-static check_icinga[11298]: 2021-11-07 10:00:02,514 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:00:05 wikitech-static check_icinga[11297]: 2021-11-07 10:00:05,547 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:00:05 wikitech-static check_icinga[11298]: 2021-11-07 10:00:05,700 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:02:01 wikitech-static CRON[11372]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:02:01 wikitech-static CRON[11373]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:02:02 wikitech-static check_icinga[11375]: 2021-11-07 10:02:02,933 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:02:02 wikitech-static check_icinga[11374]: 2021-11-07 10:02:02,937 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:02:05 wikitech-static check_icinga[11374]: 2021-11-07 10:02:05,895 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:02:06 wikitech-static check_icinga[11375]: 2021-11-07 10:02:06,162 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:04:01 wikitech-static CRON[11466]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:04:01 wikitech-static CRON[11467]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:04:02 wikitech-static check_icinga[11470]: 2021-11-07 10:04:02,330 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:04:02 wikitech-static check_icinga[11468]: 2021-11-07 10:04:02,333 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:04:05 wikitech-static check_icinga[11468]: 2021-11-07 10:04:05,409 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:04:05 wikitech-static check_icinga[11470]: 2021-11-07 10:04:05,476 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:06:01 wikitech-static CRON[11542]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:06:01 wikitech-static CRON[11543]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:06:02 wikitech-static check_icinga[11544]: 2021-11-07 10:06:02,648 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:06:02 wikitech-static check_icinga[11545]: 2021-11-07 10:06:02,650 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:06:05 wikitech-static check_icinga[11544]: 2021-11-07 10:06:05,761 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:06:05 wikitech-static check_icinga[11545]: 2021-11-07 10:06:05,994 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:08:01 wikitech-static CRON[11618]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:08:01 wikitech-static CRON[11619]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:08:02 wikitech-static check_icinga[11620]: 2021-11-07 10:08:02,187 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:08:02 wikitech-static check_icinga[11621]: 2021-11-07 10:08:02,221 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:08:05 wikitech-static check_icinga[11621]: 2021-11-07 10:08:05,367 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:08:05 wikitech-static check_icinga[11620]: 2021-11-07 10:08:05,373 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:09:01 wikitech-static CRON[11665]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 10:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 10:09:06 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 10:10:01 wikitech-static CRON[11787]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:10:01 wikitech-static CRON[11788]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:10:02 wikitech-static check_icinga[11790]: 2021-11-07 10:10:02,573 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:10:02 wikitech-static check_icinga[11789]: 2021-11-07 10:10:02,599 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:10:05 wikitech-static check_icinga[11790]: 2021-11-07 10:10:05,734 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:10:06 wikitech-static check_icinga[11789]: 2021-11-07 10:10:06,034 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:11:01 wikitech-static CRON[11834]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh)
Nov 7 10:11:01 wikitech-static check_icinga_validate_config[11835]: Valid config, nothing to do.
Nov 7 10:12:01 wikitech-static CRON[11867]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:12:01 wikitech-static CRON[11868]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:12:02 wikitech-static check_icinga[11870]: 2021-11-07 10:12:02,981 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:12:02 wikitech-static check_icinga[11869]: 2021-11-07 10:12:02,988 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:12:05 wikitech-static check_icinga[11870]: 2021-11-07 10:12:05,963 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:12:06 wikitech-static check_icinga[11869]: 2021-11-07 10:12:06,150 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:14:01 wikitech-static CRON[11949]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:14:01 wikitech-static CRON[11950]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:14:02 wikitech-static check_icinga[11951]: 2021-11-07 10:14:02,276 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:14:02 wikitech-static check_icinga[11952]: 2021-11-07 10:14:02,302 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:14:05 wikitech-static check_icinga[11951]: 2021-11-07 10:14:05,606 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:14:05 wikitech-static check_icinga[11952]: 2021-11-07 10:14:05,693 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:16:01 wikitech-static CRON[12028]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:16:01 wikitech-static CRON[12029]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:16:02 wikitech-static check_icinga[12031]: 2021-11-07 10:16:02,897 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:16:02 wikitech-static check_icinga[12030]: 2021-11-07 10:16:02,899 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:16:05 wikitech-static check_icinga[12030]: 2021-11-07 10:16:05,958 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:16:06 wikitech-static check_icinga[12031]: 2021-11-07 10:16:06,238 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:17:01 wikitech-static CRON[12075]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 10:18:01 wikitech-static CRON[12107]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:18:01 wikitech-static CRON[12108]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:18:02 wikitech-static check_icinga[12110]: 2021-11-07 10:18:02,399 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:18:02 wikitech-static check_icinga[12109]: 2021-11-07 10:18:02,506 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:18:05 wikitech-static check_icinga[12109]: 2021-11-07 10:18:05,451 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:18:05 wikitech-static check_icinga[12110]: 2021-11-07 10:18:05,839 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:20:01 wikitech-static CRON[12184]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:20:01 wikitech-static CRON[12185]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:20:03 wikitech-static check_icinga[12187]: 2021-11-07 10:20:03,001 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:20:03 wikitech-static check_icinga[12186]: 2021-11-07 10:20:03,002 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:20:05 wikitech-static check_icinga[12186]: 2021-11-07 10:20:05,986 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:20:06 wikitech-static check_icinga[12187]: 2021-11-07 10:20:06,165 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:22:01 wikitech-static CRON[12261]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:22:01 wikitech-static CRON[12262]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:22:02 wikitech-static check_icinga[12264]: 2021-11-07 10:22:02,295 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:22:02 wikitech-static check_icinga[12263]: 2021-11-07 10:22:02,299 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:22:05 wikitech-static check_icinga[12263]: 2021-11-07 10:22:05,388 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:22:05 wikitech-static check_icinga[12264]: 2021-11-07 10:22:05,439 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:24:01 wikitech-static CRON[12340]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:24:01 wikitech-static CRON[12341]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:24:02 wikitech-static check_icinga[12343]: 2021-11-07 10:24:02,661 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:24:02 wikitech-static check_icinga[12342]: 2021-11-07 10:24:02,687 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:24:05 wikitech-static check_icinga[12343]: 2021-11-07 10:24:05,721 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:24:05 wikitech-static check_icinga[12342]: 2021-11-07 10:24:05,897 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:26:01 wikitech-static CRON[12415]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:26:01 wikitech-static CRON[12416]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:26:03 wikitech-static check_icinga[12417]: 2021-11-07 10:26:03,053 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:26:03 wikitech-static check_icinga[12418]: 2021-11-07 10:26:03,056 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:26:06 wikitech-static check_icinga[12418]: 2021-11-07 10:26:06,131 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:26:06 wikitech-static check_icinga[12417]: 2021-11-07 10:26:06,380 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:28:01 wikitech-static CRON[12490]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:28:01 wikitech-static CRON[12491]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:28:02 wikitech-static check_icinga[12493]: 2021-11-07 10:28:02,524 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:28:02 wikitech-static check_icinga[12492]: 2021-11-07 10:28:02,549 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:28:05 wikitech-static check_icinga[12493]: 2021-11-07 10:28:05,768 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:28:05 wikitech-static check_icinga[12492]: 2021-11-07 10:28:05,880 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:30:01 wikitech-static CRON[12567]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:30:01 wikitech-static CRON[12568]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:30:02 wikitech-static check_icinga[12570]: 2021-11-07 10:30:02,985 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:30:03 wikitech-static check_icinga[12569]: 2021-11-07 10:30:03,012 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:30:05 wikitech-static check_icinga[12569]: 2021-11-07 10:30:05,928 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:30:06 wikitech-static check_icinga[12570]: 2021-11-07 10:30:06,127 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:32:01 wikitech-static CRON[12642]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:32:01 wikitech-static CRON[12643]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:32:01 wikitech-static systemd[1]: Starting Certbot...
Nov 7 10:32:02 wikitech-static check_icinga[12645]: 2021-11-07 10:32:02,761 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:32:02 wikitech-static check_icinga[12644]: 2021-11-07 10:32:02,794 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:32:05 wikitech-static systemd[1]: Started Certbot.
Nov 7 10:32:05 wikitech-static systemd[1]: certbot.timer: Adding 5h 40min 55.850246s random time.
Nov 7 10:32:05 wikitech-static systemd[1]: certbot.timer: Adding 5h 33min 32.491629s random time.
Nov 7 10:32:05 wikitech-static check_icinga[12645]: 2021-11-07 10:32:05,828 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:32:05 wikitech-static check_icinga[12644]: 2021-11-07 10:32:05,982 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:34:01 wikitech-static CRON[12750]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:34:01 wikitech-static CRON[12751]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:34:02 wikitech-static check_icinga[12753]: 2021-11-07 10:34:02,429 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:34:02 wikitech-static check_icinga[12752]: 2021-11-07 10:34:02,538 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:34:03 wikitech-static check_icinga[12753]: 2021-11-07 10:34:03,808 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')"]
Nov 7 10:34:05 wikitech-static check_icinga[12752]: 2021-11-07 10:34:05,690 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:34:13 wikitech-static check_icinga[12753]: 2021-11-07 10:34:13,934 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:34:16 wikitech-static check_icinga[12753]: 2021-11-07 10:34:16,586 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:36:01 wikitech-static CRON[12828]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:36:01 wikitech-static CRON[12829]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:36:02 wikitech-static check_icinga[12831]: 2021-11-07 10:36:02,716 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:36:02 wikitech-static check_icinga[12830]: 2021-11-07 10:36:02,752 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:36:05 wikitech-static check_icinga[12830]: 2021-11-07 10:36:05,503 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:36:05 wikitech-static check_icinga[12831]: 2021-11-07 10:36:05,950 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:38:01 wikitech-static CRON[12903]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:38:01 wikitech-static CRON[12904]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:38:02 wikitech-static check_icinga[12905]: 2021-11-07 10:38:02,114 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:38:02 wikitech-static check_icinga[12906]: 2021-11-07 10:38:02,120 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:38:04 wikitech-static check_icinga[12906]: 2021-11-07 10:38:04,911 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:38:05 wikitech-static check_icinga[12905]: 2021-11-07 10:38:05,422 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:39:01 wikitech-static CRON[12950]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 10:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 10:39:06 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 10:40:01 wikitech-static CRON[13074]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:40:01 wikitech-static CRON[13075]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:40:02 wikitech-static check_icinga[13077]: 2021-11-07 10:40:02,598 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:40:02 wikitech-static check_icinga[13076]: 2021-11-07 10:40:02,602 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:40:05 wikitech-static check_icinga[13076]: 2021-11-07 10:40:05,443 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:40:05 wikitech-static check_icinga[13077]: 2021-11-07 10:40:05,766 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:42:01 wikitech-static CRON[13151]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:42:01 wikitech-static CRON[13152]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:42:02 wikitech-static check_icinga[13153]: 2021-11-07 10:42:02,915 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:42:02 wikitech-static check_icinga[13154]: 2021-11-07 10:42:02,919 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:42:05 wikitech-static check_icinga[13153]: 2021-11-07 10:42:05,848 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:42:06 wikitech-static check_icinga[13154]: 2021-11-07 10:42:06,125 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:44:01 wikitech-static CRON[13226]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:44:01 wikitech-static CRON[13227]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:44:02 wikitech-static check_icinga[13228]: 2021-11-07 10:44:02,337 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:44:02 wikitech-static check_icinga[13229]: 2021-11-07 10:44:02,362 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:44:05 wikitech-static check_icinga[13228]: 2021-11-07 10:44:05,037 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:44:05 wikitech-static check_icinga[13229]: 2021-11-07 10:44:05,487 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:46:01 wikitech-static CRON[13301]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:46:01 wikitech-static CRON[13302]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:46:02 wikitech-static check_icinga[13304]: 2021-11-07 10:46:02,644 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:46:02 wikitech-static check_icinga[13303]: 2021-11-07 10:46:02,651 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:46:05 wikitech-static check_icinga[13303]: 2021-11-07 10:46:05,511 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:46:05 wikitech-static check_icinga[13304]: 2021-11-07 10:46:05,848 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:48:01 wikitech-static CRON[13377]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:48:01 wikitech-static CRON[13378]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:48:02 wikitech-static check_icinga[13380]: 2021-11-07 10:48:02,976 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:48:02 wikitech-static check_icinga[13379]: 2021-11-07 10:48:02,982 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:48:05 wikitech-static check_icinga[13380]: 2021-11-07 10:48:05,816 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:48:06 wikitech-static check_icinga[13379]: 2021-11-07 10:48:06,161 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:50:01 wikitech-static CRON[13453]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:50:01 wikitech-static CRON[13455]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:50:02 wikitech-static check_icinga[13454]: 2021-11-07 10:50:02,296 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:50:02 wikitech-static check_icinga[13456]: 2021-11-07 10:50:02,320 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:50:05 wikitech-static check_icinga[13454]: 2021-11-07 10:50:05,220 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:50:05 wikitech-static check_icinga[13456]: 2021-11-07 10:50:05,535 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:52:01 wikitech-static CRON[13532]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:52:01 wikitech-static CRON[13534]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:52:02 wikitech-static check_icinga[13533]: 2021-11-07 10:52:02,688 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:52:02 wikitech-static check_icinga[13535]: 2021-11-07 10:52:02,698 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:52:05 wikitech-static check_icinga[13533]: 2021-11-07 10:52:05,494 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:52:05 wikitech-static check_icinga[13535]: 2021-11-07 10:52:05,859 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:54:01 wikitech-static CRON[13612]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:54:01 wikitech-static CRON[13613]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:54:03 wikitech-static check_icinga[13614]: 2021-11-07 10:54:03,007 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:54:03 wikitech-static check_icinga[13615]: 2021-11-07 10:54:03,010 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:54:06 wikitech-static check_icinga[13615]: 2021-11-07 10:54:06,036 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:54:06 wikitech-static check_icinga[13614]: 2021-11-07 10:54:06,110 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:56:01 wikitech-static CRON[13687]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:56:01 wikitech-static CRON[13688]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:56:02 wikitech-static check_icinga[13689]: 2021-11-07 10:56:02,300 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:56:02 wikitech-static check_icinga[13690]: 2021-11-07 10:56:02,306 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:56:05 wikitech-static check_icinga[13689]: 2021-11-07 10:56:05,451 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:56:05 wikitech-static check_icinga[13690]: 2021-11-07 10:56:05,497 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 10:58:01 wikitech-static CRON[13764]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 10:58:01 wikitech-static CRON[13765]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 10:58:02 wikitech-static check_icinga[13766]: 2021-11-07 10:58:02,799 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 10:58:02 wikitech-static check_icinga[13767]: 2021-11-07 10:58:02,804 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 10:58:05 wikitech-static check_icinga[13766]: 2021-11-07 10:58:05,681 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 10:58:05 wikitech-static check_icinga[13767]: 2021-11-07 10:58:05,955 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:00:01 wikitech-static CRON[13839]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:00:01 wikitech-static CRON[13840]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:00:02 wikitech-static check_icinga[13841]: 2021-11-07 11:00:02,115 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:00:02 wikitech-static check_icinga[13842]: 2021-11-07 11:00:02,151 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:00:05 wikitech-static check_icinga[13842]: 2021-11-07 11:00:05,304 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:00:05 wikitech-static check_icinga[13841]: 2021-11-07 11:00:05,359 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:02:01 wikitech-static CRON[13917]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:02:01 wikitech-static CRON[13918]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:02:02 wikitech-static check_icinga[13919]: 2021-11-07 11:02:02,519 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:02:02 wikitech-static check_icinga[13920]: 2021-11-07 11:02:02,547 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:02:05 wikitech-static check_icinga[13919]: 2021-11-07 11:02:05,637 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:02:05 wikitech-static check_icinga[13920]: 2021-11-07 11:02:05,717 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:04:01 wikitech-static CRON[13998]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:04:01 wikitech-static CRON[13999]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:04:02 wikitech-static check_icinga[14001]: 2021-11-07 11:04:02,889 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:04:02 wikitech-static check_icinga[14000]: 2021-11-07 11:04:02,959 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:04:05 wikitech-static check_icinga[14000]: 2021-11-07 11:04:05,942 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:04:06 wikitech-static check_icinga[14001]: 2021-11-07 11:04:06,100 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:06:01 wikitech-static CRON[14073]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:06:01 wikitech-static CRON[14075]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:06:02 wikitech-static check_icinga[14074]: 2021-11-07 11:06:02,209 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:06:02 wikitech-static check_icinga[14076]: 2021-11-07 11:06:02,276 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:06:05 wikitech-static check_icinga[14074]: 2021-11-07 11:06:05,131 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:06:05 wikitech-static check_icinga[14076]: 2021-11-07 11:06:05,525 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:08:01 wikitech-static CRON[14148]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:08:01 wikitech-static CRON[14149]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:08:02 wikitech-static check_icinga[14151]: 2021-11-07 11:08:02,656 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:08:02 wikitech-static check_icinga[14150]: 2021-11-07 11:08:02,681 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:08:05 wikitech-static check_icinga[14150]: 2021-11-07 11:08:05,895 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:08:06 wikitech-static check_icinga[14151]: 2021-11-07 11:08:06,010 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:09:01 wikitech-static CRON[14253]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 11:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 11:09:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 11:10:01 wikitech-static CRON[14379]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:10:01 wikitech-static CRON[14380]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:10:02 wikitech-static check_icinga[14382]: 2021-11-07 11:10:02,144 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:10:02 wikitech-static check_icinga[14381]: 2021-11-07 11:10:02,237 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:10:05 wikitech-static check_icinga[14381]: 2021-11-07 11:10:05,281 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:10:05 wikitech-static check_icinga[14382]: 2021-11-07 11:10:05,505 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:12:01 wikitech-static CRON[14457]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:12:01 wikitech-static CRON[14458]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:12:02 wikitech-static check_icinga[14459]: 2021-11-07 11:12:02,644 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:12:02 wikitech-static check_icinga[14460]: 2021-11-07 11:12:02,652 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:12:05 wikitech-static check_icinga[14459]: 2021-11-07 11:12:05,591 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:12:05 wikitech-static check_icinga[14460]: 2021-11-07 11:12:05,905 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:14:01 wikitech-static CRON[14537]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:14:01 wikitech-static CRON[14538]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:14:03 wikitech-static check_icinga[14539]: 2021-11-07 11:14:03,065 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:14:03 wikitech-static check_icinga[14540]: 2021-11-07 11:14:03,138 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:14:06 wikitech-static check_icinga[14539]: 2021-11-07 11:14:06,005 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:14:06 wikitech-static check_icinga[14540]: 2021-11-07 11:14:06,296 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:16:01 wikitech-static CRON[14616]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:16:01 wikitech-static CRON[14617]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:16:02 wikitech-static check_icinga[14618]: 2021-11-07 11:16:02,478 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:16:02 wikitech-static check_icinga[14619]: 2021-11-07 11:16:02,485 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:16:05 wikitech-static check_icinga[14618]: 2021-11-07 11:16:05,500 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:16:05 wikitech-static check_icinga[14619]: 2021-11-07 11:16:05,579 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:17:01 wikitech-static CRON[14663]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 11:18:01 wikitech-static CRON[14694]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:18:01 wikitech-static CRON[14696]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:18:02 wikitech-static check_icinga[14697]: 2021-11-07 11:18:02,768 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:18:02 wikitech-static check_icinga[14695]: 2021-11-07 11:18:02,866 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:18:06 wikitech-static check_icinga[14697]: 2021-11-07 11:18:06,001 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:18:06 wikitech-static check_icinga[14695]: 2021-11-07 11:18:06,031 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:20:01 wikitech-static CRON[14772]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:20:01 wikitech-static CRON[14774]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:20:02 wikitech-static check_icinga[14773]: 2021-11-07 11:20:02,291 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:20:02 wikitech-static check_icinga[14775]: 2021-11-07 11:20:02,335 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:20:05 wikitech-static check_icinga[14773]: 2021-11-07 11:20:05,279 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:20:05 wikitech-static check_icinga[14775]: 2021-11-07 11:20:05,655 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:22:01 wikitech-static CRON[14850]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:22:01 wikitech-static CRON[14851]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:22:02 wikitech-static check_icinga[14852]: 2021-11-07 11:22:02,776 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:22:02 wikitech-static check_icinga[14853]: 2021-11-07 11:22:02,804 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:22:05 wikitech-static check_icinga[14853]: 2021-11-07 11:22:05,750 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:22:05 wikitech-static check_icinga[14852]: 2021-11-07 11:22:05,838 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:24:01 wikitech-static CRON[14925]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:24:01 wikitech-static CRON[14927]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:24:02 wikitech-static check_icinga[14928]: 2021-11-07 11:24:02,971 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:24:02 wikitech-static check_icinga[14926]: 2021-11-07 11:24:02,977 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:24:05 wikitech-static check_icinga[14926]: 2021-11-07 11:24:05,947 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:24:06 wikitech-static check_icinga[14928]: 2021-11-07 11:24:06,058 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:26:01 wikitech-static CRON[15020]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:26:01 wikitech-static CRON[15021]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:26:02 wikitech-static check_icinga[15022]: 2021-11-07 11:26:02,181 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:26:02 wikitech-static check_icinga[15023]: 2021-11-07 11:26:02,218 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:26:05 wikitech-static check_icinga[15022]: 2021-11-07 11:26:05,131 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:26:05 wikitech-static check_icinga[15023]: 2021-11-07 11:26:05,287 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:28:01 wikitech-static CRON[15101]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:28:01 wikitech-static CRON[15102]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:28:02 wikitech-static check_icinga[15103]: 2021-11-07 11:28:02,411 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:28:02 wikitech-static check_icinga[15104]: 2021-11-07 11:28:02,437 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:28:05 wikitech-static check_icinga[15103]: 2021-11-07 11:28:05,317 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:28:05 wikitech-static check_icinga[15104]: 2021-11-07 11:28:05,505 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:30:01 wikitech-static CRON[15230]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:30:01 wikitech-static CRON[15231]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:30:02 wikitech-static check_icinga[15233]: 2021-11-07 11:30:02,828 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:30:02 wikitech-static check_icinga[15232]: 2021-11-07 11:30:02,829 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:30:05 wikitech-static check_icinga[15233]: 2021-11-07 11:30:05,808 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:30:05 wikitech-static check_icinga[15232]: 2021-11-07 11:30:05,898 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:32:01 wikitech-static CRON[15313]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:32:01 wikitech-static CRON[15315]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:32:03 wikitech-static check_icinga[15314]: 2021-11-07 11:32:03,032 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:32:03 wikitech-static check_icinga[15316]: 2021-11-07 11:32:03,037 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:32:06 wikitech-static check_icinga[15316]: 2021-11-07 11:32:06,210 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:32:06 wikitech-static check_icinga[15314]: 2021-11-07 11:32:06,245 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:34:01 wikitech-static CRON[15391]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:34:01 wikitech-static CRON[15392]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:34:02 wikitech-static check_icinga[15393]: 2021-11-07 11:34:02,483 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:34:02 wikitech-static check_icinga[15394]: 2021-11-07 11:34:02,505 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:34:03 wikitech-static check_icinga[15393]: 2021-11-07 11:34:03,856 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Service Checks Being Executed? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Notifications Enabled? MISSING_KEY (expected NO)']
Nov 7 11:34:05 wikitech-static check_icinga[15394]: 2021-11-07 11:34:05,763 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:34:13 wikitech-static check_icinga[15393]: 2021-11-07 11:34:13,900 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:34:16 wikitech-static check_icinga[15393]: 2021-11-07 11:34:16,940 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:36:01 wikitech-static CRON[15470]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:36:01 wikitech-static CRON[15472]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:36:02 wikitech-static check_icinga[15471]: 2021-11-07 11:36:02,065 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:36:02 wikitech-static check_icinga[15473]: 2021-11-07 11:36:02,085 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:36:04 wikitech-static check_icinga[15471]: 2021-11-07 11:36:04,781 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:36:05 wikitech-static check_icinga[15473]: 2021-11-07 11:36:05,141 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:38:01 wikitech-static CRON[15551]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:38:01 wikitech-static CRON[15552]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:38:02 wikitech-static check_icinga[15554]: 2021-11-07 11:38:02,834 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:38:02 wikitech-static check_icinga[15553]: 2021-11-07 11:38:02,843 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:38:05 wikitech-static check_icinga[15553]: 2021-11-07 11:38:05,578 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:38:05 wikitech-static check_icinga[15554]: 2021-11-07 11:38:05,974 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:39:01 wikitech-static CRON[15598]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 11:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 11:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 11:40:01 wikitech-static CRON[15720]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:40:01 wikitech-static CRON[15721]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:40:02 wikitech-static check_icinga[15723]: 2021-11-07 11:40:02,143 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:40:02 wikitech-static check_icinga[15722]: 2021-11-07 11:40:02,213 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:40:05 wikitech-static check_icinga[15722]: 2021-11-07 11:40:05,016 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:40:05 wikitech-static check_icinga[15723]: 2021-11-07 11:40:05,368 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:42:01 wikitech-static CRON[15802]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:42:01 wikitech-static CRON[15803]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:42:02 wikitech-static check_icinga[15805]: 2021-11-07 11:42:02,487 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:42:02 wikitech-static check_icinga[15804]: 2021-11-07 11:42:02,516 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:42:05 wikitech-static check_icinga[15804]: 2021-11-07 11:42:05,334 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:42:05 wikitech-static check_icinga[15805]: 2021-11-07 11:42:05,725 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:44:01 wikitech-static CRON[15881]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:44:01 wikitech-static CRON[15882]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:44:02 wikitech-static check_icinga[15883]: 2021-11-07 11:44:02,844 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:44:02 wikitech-static check_icinga[15884]: 2021-11-07 11:44:02,867 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:44:05 wikitech-static check_icinga[15884]: 2021-11-07 11:44:05,658 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:44:06 wikitech-static check_icinga[15883]: 2021-11-07 11:44:06,002 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:46:01 wikitech-static CRON[15962]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:46:01 wikitech-static CRON[15963]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:46:02 wikitech-static check_icinga[15965]: 2021-11-07 11:46:02,131 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:46:02 wikitech-static check_icinga[15964]: 2021-11-07 11:46:02,165 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:46:05 wikitech-static check_icinga[15964]: 2021-11-07 11:46:05,160 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:46:05 wikitech-static check_icinga[15965]: 2021-11-07 11:46:05,249 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:48:01 wikitech-static CRON[16045]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:48:01 wikitech-static CRON[16046]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:48:02 wikitech-static check_icinga[16047]: 2021-11-07 11:48:02,414 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:48:02 wikitech-static check_icinga[16048]: 2021-11-07 11:48:02,421 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:48:05 wikitech-static check_icinga[16047]: 2021-11-07 11:48:05,534 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:48:05 wikitech-static check_icinga[16048]: 2021-11-07 11:48:05,689 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:50:01 wikitech-static CRON[16137]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:50:01 wikitech-static CRON[16138]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:50:02 wikitech-static check_icinga[16139]: 2021-11-07 11:50:02,843 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:50:02 wikitech-static check_icinga[16140]: 2021-11-07 11:50:02,849 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:50:06 wikitech-static check_icinga[16139]: 2021-11-07 11:50:06,051 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:50:06 wikitech-static check_icinga[16140]: 2021-11-07 11:50:06,115 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:52:01 wikitech-static CRON[16212]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:52:01 wikitech-static CRON[16213]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:52:02 wikitech-static check_icinga[16214]: 2021-11-07 11:52:02,254 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:52:02 wikitech-static check_icinga[16215]: 2021-11-07 11:52:02,285 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:52:05 wikitech-static check_icinga[16215]: 2021-11-07 11:52:05,379 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:52:05 wikitech-static check_icinga[16214]: 2021-11-07 11:52:05,392 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:54:01 wikitech-static CRON[16295]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:54:01 wikitech-static CRON[16296]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:54:02 wikitech-static check_icinga[16298]: 2021-11-07 11:54:02,589 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:54:02 wikitech-static check_icinga[16299]: 2021-11-07 11:54:02,624 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:54:05 wikitech-static check_icinga[16298]: 2021-11-07 11:54:05,712 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:54:05 wikitech-static check_icinga[16299]: 2021-11-07 11:54:05,830 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:56:01 wikitech-static CRON[16372]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:56:01 wikitech-static CRON[16373]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:56:02 wikitech-static check_icinga[16375]: 2021-11-07 11:56:02,970 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:56:03 wikitech-static check_icinga[16374]: 2021-11-07 11:56:03,061 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:56:06 wikitech-static check_icinga[16374]: 2021-11-07 11:56:06,033 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:56:06 wikitech-static check_icinga[16375]: 2021-11-07 11:56:06,186 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 11:58:01 wikitech-static CRON[16452]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 11:58:01 wikitech-static CRON[16453]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 11:58:02 wikitech-static check_icinga[16454]: 2021-11-07 11:58:02,389 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 11:58:02 wikitech-static check_icinga[16455]: 2021-11-07 11:58:02,398 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 11:58:05 wikitech-static check_icinga[16455]: 2021-11-07 11:58:05,411 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 11:58:05 wikitech-static check_icinga[16454]: 2021-11-07 11:58:05,699 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:00:01 wikitech-static CRON[16527]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:00:01 wikitech-static CRON[16528]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:00:02 wikitech-static check_icinga[16529]: 2021-11-07 12:00:02,821 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:00:02 wikitech-static check_icinga[16530]: 2021-11-07 12:00:02,823 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:00:05 wikitech-static check_icinga[16529]: 2021-11-07 12:00:05,725 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:00:06 wikitech-static check_icinga[16530]: 2021-11-07 12:00:06,187 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:02:01 wikitech-static CRON[16603]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:02:01 wikitech-static CRON[16604]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:02:02 wikitech-static check_icinga[16605]: 2021-11-07 12:02:02,345 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:02:02 wikitech-static check_icinga[16606]: 2021-11-07 12:02:02,348 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:02:05 wikitech-static check_icinga[16605]: 2021-11-07 12:02:05,496 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:02:05 wikitech-static check_icinga[16606]: 2021-11-07 12:02:05,666 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:04:01 wikitech-static CRON[16680]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:04:01 wikitech-static CRON[16681]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:04:02 wikitech-static check_icinga[16682]: 2021-11-07 12:04:02,794 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:04:02 wikitech-static check_icinga[16683]: 2021-11-07 12:04:02,825 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:04:05 wikitech-static check_icinga[16683]: 2021-11-07 12:04:05,827 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:04:05 wikitech-static check_icinga[16682]: 2021-11-07 12:04:05,942 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:06:01 wikitech-static CRON[16755]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:06:01 wikitech-static CRON[16756]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:06:02 wikitech-static check_icinga[16757]: 2021-11-07 12:06:02,067 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:06:02 wikitech-static check_icinga[16758]: 2021-11-07 12:06:02,098 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:06:05 wikitech-static check_icinga[16757]: 2021-11-07 12:06:05,294 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:06:05 wikitech-static check_icinga[16758]: 2021-11-07 12:06:05,303 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:08:01 wikitech-static CRON[16830]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:08:01 wikitech-static CRON[16831]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:08:02 wikitech-static check_icinga[16833]: 2021-11-07 12:08:02,573 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:08:02 wikitech-static check_icinga[16832]: 2021-11-07 12:08:02,667 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:08:05 wikitech-static check_icinga[16832]: 2021-11-07 12:08:05,681 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:08:05 wikitech-static check_icinga[16833]: 2021-11-07 12:08:05,701 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:09:01 wikitech-static CRON[16877]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 12:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 12:09:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 12:10:01 wikitech-static CRON[17002]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:10:01 wikitech-static CRON[17004]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:10:02 wikitech-static check_icinga[17003]: 2021-11-07 12:10:02,948 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:10:02 wikitech-static check_icinga[17005]: 2021-11-07 12:10:02,953 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:10:05 wikitech-static check_icinga[17003]: 2021-11-07 12:10:05,895 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:10:06 wikitech-static check_icinga[17005]: 2021-11-07 12:10:06,010 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:11:01 wikitech-static CRON[17050]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh)
Nov 7 12:11:01 wikitech-static check_icinga_validate_config[17051]: Valid config, nothing to do.
Nov 7 12:12:01 wikitech-static CRON[17083]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:12:01 wikitech-static CRON[17085]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:12:02 wikitech-static check_icinga[17084]: 2021-11-07 12:12:02,843 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:12:02 wikitech-static check_icinga[17086]: 2021-11-07 12:12:02,861 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:12:06 wikitech-static check_icinga[17086]: 2021-11-07 12:12:06,003 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:12:06 wikitech-static check_icinga[17084]: 2021-11-07 12:12:06,034 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:14:01 wikitech-static CRON[17159]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:14:01 wikitech-static CRON[17160]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:14:02 wikitech-static check_icinga[17162]: 2021-11-07 12:14:02,288 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:14:02 wikitech-static check_icinga[17161]: 2021-11-07 12:14:02,293 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:14:05 wikitech-static check_icinga[17162]: 2021-11-07 12:14:05,427 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:14:05 wikitech-static check_icinga[17161]: 2021-11-07 12:14:05,485 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:16:01 wikitech-static CRON[17238]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:16:01 wikitech-static CRON[17239]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:16:02 wikitech-static check_icinga[17241]: 2021-11-07 12:16:02,635 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:16:02 wikitech-static check_icinga[17240]: 2021-11-07 12:16:02,728 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:16:05 wikitech-static check_icinga[17240]: 2021-11-07 12:16:05,819 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:16:05 wikitech-static check_icinga[17241]: 2021-11-07 12:16:05,838 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:17:01 wikitech-static CRON[17290]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 12:18:01 wikitech-static CRON[17323]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:18:01 wikitech-static CRON[17324]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:18:02 wikitech-static check_icinga[17326]: 2021-11-07 12:18:02,179 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:18:02 wikitech-static check_icinga[17325]: 2021-11-07 12:18:02,182 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:18:05 wikitech-static check_icinga[17325]: 2021-11-07 12:18:05,245 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:18:05 wikitech-static check_icinga[17326]: 2021-11-07 12:18:05,392 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:20:01 wikitech-static CRON[17406]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:20:01 wikitech-static CRON[17407]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:20:02 wikitech-static check_icinga[17408]: 2021-11-07 12:20:02,561 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:20:02 wikitech-static check_icinga[17409]: 2021-11-07 12:20:02,585 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:20:05 wikitech-static check_icinga[17409]: 2021-11-07 12:20:05,579 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:20:05 wikitech-static check_icinga[17408]: 2021-11-07 12:20:05,807 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:22:01 wikitech-static CRON[17488]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:22:01 wikitech-static CRON[17489]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:22:02 wikitech-static check_icinga[17490]: 2021-11-07 12:22:02,941 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:22:02 wikitech-static check_icinga[17491]: 2021-11-07 12:22:02,951 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:22:05 wikitech-static check_icinga[17490]: 2021-11-07 12:22:05,873 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:22:06 wikitech-static check_icinga[17491]: 2021-11-07 12:22:06,231 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:24:01 wikitech-static CRON[17567]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:24:01 wikitech-static CRON[17568]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:24:02 wikitech-static check_icinga[17570]: 2021-11-07 12:24:02,373 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:24:02 wikitech-static check_icinga[17569]: 2021-11-07 12:24:02,408 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:24:05 wikitech-static check_icinga[17570]: 2021-11-07 12:24:05,375 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:24:05 wikitech-static check_icinga[17569]: 2021-11-07 12:24:05,760 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:26:01 wikitech-static CRON[17642]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:26:01 wikitech-static CRON[17643]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:26:02 wikitech-static check_icinga[17644]: 2021-11-07 12:26:02,909 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:26:02 wikitech-static check_icinga[17645]: 2021-11-07 12:26:02,913 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:26:05 wikitech-static check_icinga[17645]: 2021-11-07 12:26:05,913 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:26:05 wikitech-static check_icinga[17644]: 2021-11-07 12:26:05,977 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:28:01 wikitech-static CRON[17717]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:28:01 wikitech-static CRON[17718]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:28:02 wikitech-static check_icinga[17720]: 2021-11-07 12:28:02,134 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:28:02 wikitech-static check_icinga[17719]: 2021-11-07 12:28:02,207 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:28:05 wikitech-static check_icinga[17720]: 2021-11-07 12:28:05,261 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:28:05 wikitech-static check_icinga[17719]: 2021-11-07 12:28:05,329 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:30:01 wikitech-static CRON[17792]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:30:01 wikitech-static CRON[17793]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:30:02 wikitech-static check_icinga[17794]: 2021-11-07 12:30:02,461 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:30:02 wikitech-static check_icinga[17795]: 2021-11-07 12:30:02,469 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:30:05 wikitech-static check_icinga[17794]: 2021-11-07 12:30:05,592 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:30:05 wikitech-static check_icinga[17795]: 2021-11-07 12:30:05,651 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:32:01 wikitech-static CRON[17877]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:32:01 wikitech-static CRON[17878]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:32:02 wikitech-static check_icinga[17879]: 2021-11-07 12:32:02,835 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:32:02 wikitech-static check_icinga[17880]: 2021-11-07 12:32:02,840 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:32:05 wikitech-static check_icinga[17879]: 2021-11-07 12:32:05,862 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:32:05 wikitech-static check_icinga[17880]: 2021-11-07 12:32:05,983 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:34:01 wikitech-static CRON[17952]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:34:01 wikitech-static CRON[17953]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:34:02 wikitech-static check_icinga[17955]: 2021-11-07 12:34:02,131 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:34:02 wikitech-static check_icinga[17954]: 2021-11-07 12:34:02,136 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:34:03 wikitech-static check_icinga[17955]: 2021-11-07 12:34:03,520 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ["Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)']
Nov 7 12:34:05 wikitech-static check_icinga[17954]: 2021-11-07 12:34:05,322 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:34:13 wikitech-static check_icinga[17955]: 2021-11-07 12:34:13,532 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:34:16 wikitech-static check_icinga[17955]: 2021-11-07 12:34:16,091 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:36:01 wikitech-static CRON[18027]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:36:01 wikitech-static CRON[18028]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:36:02 wikitech-static check_icinga[18030]: 2021-11-07 12:36:02,229 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:36:02 wikitech-static check_icinga[18029]: 2021-11-07 12:36:02,237 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:36:04 wikitech-static check_icinga[18029]: 2021-11-07 12:36:04,858 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:36:05 wikitech-static check_icinga[18030]: 2021-11-07 12:36:05,581 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:38:01 wikitech-static CRON[18107]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:38:01 wikitech-static CRON[18108]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:38:02 wikitech-static check_icinga[18110]: 2021-11-07 12:38:02,718 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:38:02 wikitech-static check_icinga[18109]: 2021-11-07 12:38:02,785 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:38:05 wikitech-static check_icinga[18109]: 2021-11-07 12:38:05,571 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:38:05 wikitech-static check_icinga[18110]: 2021-11-07 12:38:05,755 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:39:01 wikitech-static CRON[18154]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 12:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 12:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 12:40:01 wikitech-static CRON[18288]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:40:01 wikitech-static CRON[18289]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:40:02 wikitech-static check_icinga[18290]: 2021-11-07 12:40:02,912 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:40:02 wikitech-static check_icinga[18291]: 2021-11-07 12:40:02,919 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:40:05 wikitech-static check_icinga[18290]: 2021-11-07 12:40:05,705 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:40:06 wikitech-static check_icinga[18291]: 2021-11-07 12:40:06,173 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:42:01 wikitech-static CRON[18363]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:42:01 wikitech-static CRON[18364]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:42:02 wikitech-static check_icinga[18365]: 2021-11-07 12:42:02,346 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:42:02 wikitech-static check_icinga[18366]: 2021-11-07 12:42:02,354 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:42:05 wikitech-static check_icinga[18365]: 2021-11-07 12:42:05,165 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:42:05 wikitech-static check_icinga[18366]: 2021-11-07 12:42:05,494 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:44:01 wikitech-static CRON[18438]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:44:01 wikitech-static CRON[18440]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:44:02 wikitech-static check_icinga[18439]: 2021-11-07 12:44:02,636 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:44:02 wikitech-static check_icinga[18441]: 2021-11-07 12:44:02,644 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:44:05 wikitech-static check_icinga[18439]: 2021-11-07 12:44:05,386 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:44:05 wikitech-static check_icinga[18441]: 2021-11-07 12:44:05,874 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:46:01 wikitech-static CRON[18522]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:46:01 wikitech-static CRON[18523]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:46:03 wikitech-static check_icinga[18525]: 2021-11-07 12:46:03,004 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:46:03 wikitech-static check_icinga[18524]: 2021-11-07 12:46:03,007 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:46:06 wikitech-static check_icinga[18524]: 2021-11-07 12:46:06,070 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:46:06 wikitech-static check_icinga[18525]: 2021-11-07 12:46:06,320 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:48:01 wikitech-static CRON[18600]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:48:01 wikitech-static CRON[18601]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:48:02 wikitech-static check_icinga[18603]: 2021-11-07 12:48:02,538 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:48:02 wikitech-static check_icinga[18602]: 2021-11-07 12:48:02,564 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:48:05 wikitech-static check_icinga[18602]: 2021-11-07 12:48:05,623 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:48:05 wikitech-static check_icinga[18603]: 2021-11-07 12:48:05,778 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:50:01 wikitech-static CRON[18676]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:50:01 wikitech-static CRON[18677]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:50:02 wikitech-static check_icinga[18679]: 2021-11-07 12:50:02,901 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:50:02 wikitech-static check_icinga[18678]: 2021-11-07 12:50:02,903 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:50:06 wikitech-static check_icinga[18679]: 2021-11-07 12:50:06,092 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:50:06 wikitech-static check_icinga[18678]: 2021-11-07 12:50:06,139 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:52:01 wikitech-static CRON[18754]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:52:01 wikitech-static CRON[18755]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:52:02 wikitech-static check_icinga[18756]: 2021-11-07 12:52:02,381 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:52:02 wikitech-static check_icinga[18757]: 2021-11-07 12:52:02,461 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:52:05 wikitech-static check_icinga[18756]: 2021-11-07 12:52:05,503 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:52:05 wikitech-static check_icinga[18757]: 2021-11-07 12:52:05,538 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:54:01 wikitech-static CRON[18835]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:54:01 wikitech-static CRON[18836]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:54:02 wikitech-static check_icinga[18837]: 2021-11-07 12:54:02,721 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:54:02 wikitech-static check_icinga[18838]: 2021-11-07 12:54:02,722 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:54:05 wikitech-static check_icinga[18837]: 2021-11-07 12:54:05,837 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:54:05 wikitech-static check_icinga[18838]: 2021-11-07 12:54:05,889 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:56:02 wikitech-static CRON[18922]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:56:02 wikitech-static CRON[18923]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:56:03 wikitech-static check_icinga[18924]: 2021-11-07 12:56:03,078 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:56:03 wikitech-static check_icinga[18925]: 2021-11-07 12:56:03,085 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:56:06 wikitech-static check_icinga[18924]: 2021-11-07 12:56:06,055 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:56:06 wikitech-static check_icinga[18925]: 2021-11-07 12:56:06,329 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 12:58:01 wikitech-static CRON[18997]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 12:58:01 wikitech-static CRON[18998]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 12:58:02 wikitech-static check_icinga[19000]: 2021-11-07 12:58:02,518 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 12:58:02 wikitech-static check_icinga[18999]: 2021-11-07 12:58:02,521 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 12:58:05 wikitech-static check_icinga[19000]: 2021-11-07 12:58:05,427 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 12:58:05 wikitech-static check_icinga[18999]: 2021-11-07 12:58:05,689 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:00:01 wikitech-static CRON[19074]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:00:01 wikitech-static CRON[19075]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:00:02 wikitech-static check_icinga[19076]: 2021-11-07 13:00:02,822 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:00:02 wikitech-static check_icinga[19077]: 2021-11-07 13:00:02,851 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:00:05 wikitech-static check_icinga[19076]: 2021-11-07 13:00:05,735 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:00:05 wikitech-static check_icinga[19077]: 2021-11-07 13:00:05,978 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:02:01 wikitech-static CRON[19208]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:02:01 wikitech-static CRON[19209]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:02:02 wikitech-static check_icinga[19210]: 2021-11-07 13:02:02,113 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:02:02 wikitech-static check_icinga[19211]: 2021-11-07 13:02:02,245 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:02:05 wikitech-static check_icinga[19210]: 2021-11-07 13:02:05,157 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:02:05 wikitech-static check_icinga[19211]: 2021-11-07 13:02:05,622 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:04:01 wikitech-static CRON[19288]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:04:01 wikitech-static CRON[19289]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:04:02 wikitech-static check_icinga[19291]: 2021-11-07 13:04:02,757 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:04:02 wikitech-static check_icinga[19290]: 2021-11-07 13:04:02,786 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:04:05 wikitech-static check_icinga[19291]: 2021-11-07 13:04:05,866 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:04:06 wikitech-static check_icinga[19290]: 2021-11-07 13:04:06,002 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:06:01 wikitech-static CRON[19366]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:06:01 wikitech-static CRON[19367]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:06:02 wikitech-static check_icinga[19369]: 2021-11-07 13:06:02,154 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:06:02 wikitech-static check_icinga[19368]: 2021-11-07 13:06:02,158 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:06:05 wikitech-static check_icinga[19369]: 2021-11-07 13:06:05,242 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:06:05 wikitech-static check_icinga[19368]: 2021-11-07 13:06:05,494 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:08:01 wikitech-static CRON[19446]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:08:01 wikitech-static CRON[19447]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:08:02 wikitech-static check_icinga[19448]: 2021-11-07 13:08:02,695 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:08:02 wikitech-static check_icinga[19449]: 2021-11-07 13:08:02,702 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:08:05 wikitech-static check_icinga[19448]: 2021-11-07 13:08:05,645 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:08:05 wikitech-static check_icinga[19449]: 2021-11-07 13:08:05,836 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:09:01 wikitech-static CRON[19493]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 13:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 13:09:07 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 13:10:01 wikitech-static CRON[19626]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:10:01 wikitech-static CRON[19627]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:10:02 wikitech-static check_icinga[19629]: 2021-11-07 13:10:02,966 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:10:02 wikitech-static check_icinga[19628]: 2021-11-07 13:10:02,992 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:10:06 wikitech-static check_icinga[19628]: 2021-11-07 13:10:06,042 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:10:06 wikitech-static check_icinga[19629]: 2021-11-07 13:10:06,148 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:12:01 wikitech-static CRON[19702]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:12:01 wikitech-static CRON[19703]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:12:02 wikitech-static check_icinga[19704]: 2021-11-07 13:12:02,295 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:12:02 wikitech-static check_icinga[19705]: 2021-11-07 13:12:02,308 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:12:05 wikitech-static check_icinga[19705]: 2021-11-07 13:12:05,296 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:12:05 wikitech-static check_icinga[19704]: 2021-11-07 13:12:05,583 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:14:01 wikitech-static CRON[19779]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:14:01 wikitech-static CRON[19780]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:14:02 wikitech-static check_icinga[19782]: 2021-11-07 13:14:02,722 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:14:02 wikitech-static check_icinga[19781]: 2021-11-07 13:14:02,730 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:14:05 wikitech-static check_icinga[19782]: 2021-11-07 13:14:05,691 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:14:05 wikitech-static check_icinga[19781]: 2021-11-07 13:14:05,970 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:16:01 wikitech-static CRON[19858]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:16:01 wikitech-static CRON[19859]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:16:02 wikitech-static check_icinga[19860]: 2021-11-07 13:16:02,095 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:16:02 wikitech-static check_icinga[19861]: 2021-11-07 13:16:02,119 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:16:05 wikitech-static check_icinga[19860]: 2021-11-07 13:16:05,199 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:16:05 wikitech-static check_icinga[19861]: 2021-11-07 13:16:05,261 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:17:01 wikitech-static CRON[19905]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 13:18:01 wikitech-static CRON[19936]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:18:01 wikitech-static CRON[19937]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:18:02 wikitech-static check_icinga[19939]: 2021-11-07 13:18:02,441 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:18:02 wikitech-static check_icinga[19938]: 2021-11-07 13:18:02,503 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:18:05 wikitech-static check_icinga[19938]: 2021-11-07 13:18:05,494 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:18:05 wikitech-static check_icinga[19939]: 2021-11-07 13:18:05,876 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:20:01 wikitech-static CRON[20030]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:20:01 wikitech-static CRON[20031]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:20:02 wikitech-static check_icinga[20033]: 2021-11-07 13:20:02,981 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:20:03 wikitech-static check_icinga[20032]: 2021-11-07 13:20:03,008 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:20:06 wikitech-static check_icinga[20032]: 2021-11-07 13:20:06,112 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:20:06 wikitech-static check_icinga[20033]: 2021-11-07 13:20:06,343 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:22:01 wikitech-static CRON[20108]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:22:01 wikitech-static CRON[20109]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:22:02 wikitech-static check_icinga[20110]: 2021-11-07 13:22:02,498 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:22:02 wikitech-static check_icinga[20111]: 2021-11-07 13:22:02,532 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:22:05 wikitech-static check_icinga[20110]: 2021-11-07 13:22:05,572 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:22:05 wikitech-static check_icinga[20111]: 2021-11-07 13:22:05,778 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:24:01 wikitech-static CRON[20185]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:24:01 wikitech-static CRON[20186]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:24:02 wikitech-static check_icinga[20187]: 2021-11-07 13:24:02,926 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:24:02 wikitech-static check_icinga[20188]: 2021-11-07 13:24:02,989 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:24:05 wikitech-static check_icinga[20187]: 2021-11-07 13:24:05,806 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:24:06 wikitech-static check_icinga[20188]: 2021-11-07 13:24:06,297 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:26:01 wikitech-static CRON[20263]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:26:01 wikitech-static CRON[20264]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:26:02 wikitech-static check_icinga[20266]: 2021-11-07 13:26:02,502 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:26:02 wikitech-static check_icinga[20265]: 2021-11-07 13:26:02,505 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:26:05 wikitech-static check_icinga[20265]: 2021-11-07 13:26:05,439 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:26:05 wikitech-static check_icinga[20266]: 2021-11-07 13:26:05,563 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:28:01 wikitech-static CRON[20389]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:28:01 wikitech-static CRON[20390]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:28:02 wikitech-static check_icinga[20391]: 2021-11-07 13:28:02,690 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:28:02 wikitech-static check_icinga[20392]: 2021-11-07 13:28:02,717 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:28:05 wikitech-static check_icinga[20391]: 2021-11-07 13:28:05,779 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:28:05 wikitech-static check_icinga[20392]: 2021-11-07 13:28:05,954 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:30:01 wikitech-static CRON[20464]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:30:01 wikitech-static CRON[20465]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:30:02 wikitech-static check_icinga[20467]: 2021-11-07 13:30:02,093 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:30:02 wikitech-static check_icinga[20466]: 2021-11-07 13:30:02,122 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:30:05 wikitech-static check_icinga[20467]: 2021-11-07 13:30:05,073 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:30:05 wikitech-static check_icinga[20466]: 2021-11-07 13:30:05,212 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:32:01 wikitech-static CRON[20543]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:32:01 wikitech-static CRON[20545]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:32:02 wikitech-static check_icinga[20544]: 2021-11-07 13:32:02,450 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:32:02 wikitech-static check_icinga[20546]: 2021-11-07 13:32:02,466 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:32:05 wikitech-static check_icinga[20544]: 2021-11-07 13:32:05,442 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:32:05 wikitech-static check_icinga[20546]: 2021-11-07 13:32:05,655 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:34:01 wikitech-static CRON[20618]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:34:01 wikitech-static CRON[20619]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:34:02 wikitech-static check_icinga[20620]: 2021-11-07 13:34:02,797 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:34:02 wikitech-static check_icinga[20621]: 2021-11-07 13:34:02,803 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:34:04 wikitech-static check_icinga[20620]: 2021-11-07 13:34:04,201 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Notifications Enabled? MISSING_KEY (expected NO)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Event Handlers Enabled? MISSING_KEY (expected No)']
Nov 7 13:34:05 wikitech-static check_icinga[20621]: 2021-11-07 13:34:05,986 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:34:14 wikitech-static check_icinga[20620]: 2021-11-07 13:34:14,214 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:34:16 wikitech-static check_icinga[20620]: 2021-11-07 13:34:16,957 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:36:01 wikitech-static CRON[20697]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:36:01 wikitech-static CRON[20698]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:36:02 wikitech-static check_icinga[20700]: 2021-11-07 13:36:02,081 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:36:02 wikitech-static check_icinga[20699]: 2021-11-07 13:36:02,115 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:36:04 wikitech-static check_icinga[20699]: 2021-11-07 13:36:04,877 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:36:05 wikitech-static check_icinga[20700]: 2021-11-07 13:36:05,141 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:38:01 wikitech-static CRON[20774]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:38:01 wikitech-static CRON[20775]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:38:02 wikitech-static check_icinga[20776]: 2021-11-07 13:38:02,313 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:38:02 wikitech-static check_icinga[20777]: 2021-11-07 13:38:02,321 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:38:05 wikitech-static check_icinga[20776]: 2021-11-07 13:38:05,058 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:38:05 wikitech-static check_icinga[20777]: 2021-11-07 13:38:05,676 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:39:01 wikitech-static CRON[20821]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 13:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 13:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 13:40:01 wikitech-static CRON[20946]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:40:01 wikitech-static CRON[20947]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:40:02 wikitech-static check_icinga[20948]: 2021-11-07 13:40:02,804 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:40:02 wikitech-static check_icinga[20949]: 2021-11-07 13:40:02,830 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:40:05 wikitech-static check_icinga[20948]: 2021-11-07 13:40:05,567 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:40:05 wikitech-static check_icinga[20949]: 2021-11-07 13:40:05,909 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:42:01 wikitech-static CRON[21021]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:42:01 wikitech-static CRON[21022]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:42:03 wikitech-static check_icinga[21024]: 2021-11-07 13:42:03,039 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:42:03 wikitech-static check_icinga[21023]: 2021-11-07 13:42:03,109 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:42:05 wikitech-static check_icinga[21023]: 2021-11-07 13:42:05,911 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:42:06 wikitech-static check_icinga[21024]: 2021-11-07 13:42:06,133 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:44:01 wikitech-static CRON[21096]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:44:01 wikitech-static CRON[21097]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:44:02 wikitech-static check_icinga[21099]: 2021-11-07 13:44:02,278 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:44:02 wikitech-static check_icinga[21098]: 2021-11-07 13:44:02,286 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:44:05 wikitech-static check_icinga[21098]: 2021-11-07 13:44:05,014 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:44:05 wikitech-static check_icinga[21099]: 2021-11-07 13:44:05,498 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:46:01 wikitech-static CRON[21171]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:46:01 wikitech-static CRON[21172]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:46:02 wikitech-static check_icinga[21173]: 2021-11-07 13:46:02,690 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:46:02 wikitech-static check_icinga[21174]: 2021-11-07 13:46:02,693 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:46:05 wikitech-static check_icinga[21173]: 2021-11-07 13:46:05,655 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:46:05 wikitech-static check_icinga[21174]: 2021-11-07 13:46:05,803 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:48:01 wikitech-static CRON[21250]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:48:01 wikitech-static CRON[21251]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:48:02 wikitech-static check_icinga[21252]: 2021-11-07 13:48:02,944 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:48:03 wikitech-static check_icinga[21253]: 2021-11-07 13:48:03,048 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:48:05 wikitech-static check_icinga[21252]: 2021-11-07 13:48:05,869 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:48:06 wikitech-static check_icinga[21253]: 2021-11-07 13:48:06,153 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:50:01 wikitech-static CRON[21373]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:50:01 wikitech-static CRON[21374]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:50:02 wikitech-static check_icinga[21376]: 2021-11-07 13:50:02,298 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:50:02 wikitech-static check_icinga[21375]: 2021-11-07 13:50:02,300 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:50:05 wikitech-static check_icinga[21376]: 2021-11-07 13:50:05,366 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:50:05 wikitech-static check_icinga[21375]: 2021-11-07 13:50:05,476 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:52:01 wikitech-static CRON[21453]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:52:01 wikitech-static CRON[21454]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:52:02 wikitech-static check_icinga[21456]: 2021-11-07 13:52:02,649 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:52:02 wikitech-static check_icinga[21455]: 2021-11-07 13:52:02,684 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:52:05 wikitech-static check_icinga[21455]: 2021-11-07 13:52:05,739 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:52:06 wikitech-static check_icinga[21456]: 2021-11-07 13:52:06,056 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:54:01 wikitech-static CRON[21530]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:54:01 wikitech-static CRON[21532]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:54:02 wikitech-static check_icinga[21533]: 2021-11-07 13:54:02,233 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:54:02 wikitech-static check_icinga[21531]: 2021-11-07 13:54:02,237 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:54:05 wikitech-static check_icinga[21531]: 2021-11-07 13:54:05,400 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:54:05 wikitech-static check_icinga[21533]: 2021-11-07 13:54:05,495 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:56:01 wikitech-static CRON[21605]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:56:01 wikitech-static CRON[21606]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:56:02 wikitech-static check_icinga[21607]: 2021-11-07 13:56:02,614 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:56:02 wikitech-static check_icinga[21608]: 2021-11-07 13:56:02,629 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:56:05 wikitech-static check_icinga[21607]: 2021-11-07 13:56:05,665 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:56:05 wikitech-static check_icinga[21608]: 2021-11-07 13:56:05,815 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 13:58:01 wikitech-static CRON[21684]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 13:58:01 wikitech-static CRON[21685]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 13:58:02 wikitech-static check_icinga[21686]: 2021-11-07 13:58:02,976 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 13:58:02 wikitech-static check_icinga[21687]: 2021-11-07 13:58:02,984 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 13:58:05 wikitech-static check_icinga[21686]: 2021-11-07 13:58:05,870 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 13:58:06 wikitech-static check_icinga[21687]: 2021-11-07 13:58:06,126 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:00:01 wikitech-static CRON[21829]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:00:01 wikitech-static CRON[21830]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:00:02 wikitech-static check_icinga[21832]: 2021-11-07 14:00:02,284 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:00:02 wikitech-static check_icinga[21831]: 2021-11-07 14:00:02,285 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:00:05 wikitech-static check_icinga[21831]: 2021-11-07 14:00:05,440 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:00:05 wikitech-static check_icinga[21832]: 2021-11-07 14:00:05,528 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:02:01 wikitech-static CRON[21907]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:02:01 wikitech-static CRON[21908]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:02:02 wikitech-static check_icinga[21910]: 2021-11-07 14:02:02,688 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:02:02 wikitech-static check_icinga[21909]: 2021-11-07 14:02:02,732 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:02:05 wikitech-static check_icinga[21909]: 2021-11-07 14:02:05,765 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:02:05 wikitech-static check_icinga[21910]: 2021-11-07 14:02:05,842 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:04:01 wikitech-static CRON[21982]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:04:01 wikitech-static CRON[21983]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:04:02 wikitech-static check_icinga[21985]: 2021-11-07 14:04:02,996 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:04:03 wikitech-static check_icinga[21984]: 2021-11-07 14:04:03,066 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:04:06 wikitech-static check_icinga[21984]: 2021-11-07 14:04:06,140 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:04:06 wikitech-static check_icinga[21985]: 2021-11-07 14:04:06,290 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:06:01 wikitech-static CRON[22060]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:06:01 wikitech-static CRON[22061]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:06:02 wikitech-static check_icinga[22063]: 2021-11-07 14:06:02,467 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:06:02 wikitech-static check_icinga[22062]: 2021-11-07 14:06:02,496 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:06:05 wikitech-static check_icinga[22062]: 2021-11-07 14:06:05,677 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:06:05 wikitech-static check_icinga[22063]: 2021-11-07 14:06:05,738 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:08:01 wikitech-static CRON[22137]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:08:01 wikitech-static CRON[22138]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:08:02 wikitech-static check_icinga[22140]: 2021-11-07 14:08:02,929 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:08:02 wikitech-static check_icinga[22139]: 2021-11-07 14:08:02,994 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:08:05 wikitech-static check_icinga[22139]: 2021-11-07 14:08:05,862 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:08:06 wikitech-static check_icinga[22140]: 2021-11-07 14:08:06,051 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:09:01 wikitech-static CRON[22184]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 14:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 14:09:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 14:10:01 wikitech-static CRON[22306]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:10:01 wikitech-static CRON[22307]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:10:02 wikitech-static check_icinga[22309]: 2021-11-07 14:10:02,200 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:10:02 wikitech-static check_icinga[22308]: 2021-11-07 14:10:02,269 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:10:05 wikitech-static check_icinga[22308]: 2021-11-07 14:10:05,397 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:10:05 wikitech-static check_icinga[22309]: 2021-11-07 14:10:05,438 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:11:01 wikitech-static CRON[22353]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh)
Nov 7 14:11:02 wikitech-static check_icinga_validate_config[22354]: Valid config, nothing to do.
Nov 7 14:12:01 wikitech-static CRON[22386]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:12:01 wikitech-static CRON[22387]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:12:02 wikitech-static check_icinga[22388]: 2021-11-07 14:12:02,397 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:12:02 wikitech-static check_icinga[22389]: 2021-11-07 14:12:02,423 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:12:05 wikitech-static check_icinga[22388]: 2021-11-07 14:12:05,497 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:12:05 wikitech-static check_icinga[22389]: 2021-11-07 14:12:05,505 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:14:01 wikitech-static CRON[22470]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:14:01 wikitech-static CRON[22471]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:14:02 wikitech-static check_icinga[22472]: 2021-11-07 14:14:02,762 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:14:02 wikitech-static check_icinga[22473]: 2021-11-07 14:14:02,766 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:14:05 wikitech-static check_icinga[22473]: 2021-11-07 14:14:05,858 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:14:06 wikitech-static check_icinga[22472]: 2021-11-07 14:14:06,059 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:16:01 wikitech-static CRON[22572]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:16:01 wikitech-static CRON[22573]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:16:02 wikitech-static check_icinga[22574]: 2021-11-07 14:16:02,225 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:16:02 wikitech-static check_icinga[22575]: 2021-11-07 14:16:02,228 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:16:05 wikitech-static check_icinga[22574]: 2021-11-07 14:16:05,256 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:16:05 wikitech-static check_icinga[22575]: 2021-11-07 14:16:05,367 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:17:01 wikitech-static CRON[22622]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 14:18:01 wikitech-static CRON[22653]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:18:01 wikitech-static CRON[22654]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:18:02 wikitech-static check_icinga[22655]: 2021-11-07 14:18:02,557 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:18:02 wikitech-static check_icinga[22656]: 2021-11-07 14:18:02,593 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:18:05 wikitech-static check_icinga[22655]: 2021-11-07 14:18:05,609 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:18:05 wikitech-static check_icinga[22656]: 2021-11-07 14:18:05,686 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:20:01 wikitech-static CRON[22731]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:20:01 wikitech-static CRON[22732]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:20:02 wikitech-static check_icinga[22733]: 2021-11-07 14:20:02,984 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:20:03 wikitech-static check_icinga[22734]: 2021-11-07 14:20:03,007 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:20:06 wikitech-static check_icinga[22733]: 2021-11-07 14:20:06,089 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:20:06 wikitech-static check_icinga[22734]: 2021-11-07 14:20:06,229 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:22:01 wikitech-static CRON[22806]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:22:01 wikitech-static CRON[22807]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:22:02 wikitech-static check_icinga[22808]: 2021-11-07 14:22:02,412 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:22:02 wikitech-static check_icinga[22809]: 2021-11-07 14:22:02,490 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:22:05 wikitech-static check_icinga[22808]: 2021-11-07 14:22:05,498 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:22:05 wikitech-static check_icinga[22809]: 2021-11-07 14:22:05,597 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:24:01 wikitech-static CRON[22881]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:24:01 wikitech-static CRON[22883]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:24:02 wikitech-static check_icinga[22882]: 2021-11-07 14:24:02,749 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:24:02 wikitech-static check_icinga[22884]: 2021-11-07 14:24:02,765 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:24:05 wikitech-static check_icinga[22882]: 2021-11-07 14:24:05,778 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:24:05 wikitech-static check_icinga[22884]: 2021-11-07 14:24:05,803 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:26:01 wikitech-static CRON[22958]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:26:01 wikitech-static CRON[22959]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:26:03 wikitech-static check_icinga[22961]: 2021-11-07 14:26:03,029 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:26:03 wikitech-static check_icinga[22960]: 2021-11-07 14:26:03,098 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:26:06 wikitech-static check_icinga[22961]: 2021-11-07 14:26:06,099 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:26:06 wikitech-static check_icinga[22960]: 2021-11-07 14:26:06,291 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:28:01 wikitech-static CRON[23033]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:28:01 wikitech-static CRON[23034]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:28:02 wikitech-static check_icinga[23036]: 2021-11-07 14:28:02,427 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:28:02 wikitech-static check_icinga[23035]: 2021-11-07 14:28:02,454 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:28:05 wikitech-static check_icinga[23035]: 2021-11-07 14:28:05,492 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:28:05 wikitech-static check_icinga[23036]: 2021-11-07 14:28:05,548 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:30:01 wikitech-static CRON[23110]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:30:01 wikitech-static CRON[23111]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:30:02 wikitech-static check_icinga[23112]: 2021-11-07 14:30:02,727 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:30:02 wikitech-static check_icinga[23113]: 2021-11-07 14:30:02,748 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:30:05 wikitech-static check_icinga[23113]: 2021-11-07 14:30:05,907 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:30:05 wikitech-static check_icinga[23112]: 2021-11-07 14:30:05,945 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:32:01 wikitech-static CRON[23189]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:32:01 wikitech-static CRON[23190]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:32:02 wikitech-static check_icinga[23192]: 2021-11-07 14:32:02,144 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:32:02 wikitech-static check_icinga[23191]: 2021-11-07 14:32:02,175 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:32:05 wikitech-static check_icinga[23191]: 2021-11-07 14:32:05,293 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:32:05 wikitech-static check_icinga[23192]: 2021-11-07 14:32:05,322 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:34:01 wikitech-static CRON[23278]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:34:01 wikitech-static CRON[23279]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:34:02 wikitech-static check_icinga[23281]: 2021-11-07 14:34:02,503 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:34:02 wikitech-static check_icinga[23280]: 2021-11-07 14:34:02,509 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:34:03 wikitech-static check_icinga[23280]: 2021-11-07 14:34:03,904 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)']
Nov 7 14:34:05 wikitech-static check_icinga[23281]: 2021-11-07 14:34:05,717 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:34:13 wikitech-static check_icinga[23280]: 2021-11-07 14:34:13,918 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:34:16 wikitech-static check_icinga[23280]: 2021-11-07 14:34:16,584 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:36:01 wikitech-static CRON[23362]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:36:01 wikitech-static CRON[23363]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:36:02 wikitech-static check_icinga[23364]: 2021-11-07 14:36:02,699 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:36:02 wikitech-static check_icinga[23365]: 2021-11-07 14:36:02,713 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:36:05 wikitech-static check_icinga[23364]: 2021-11-07 14:36:05,557 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:36:05 wikitech-static check_icinga[23365]: 2021-11-07 14:36:05,691 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:38:01 wikitech-static CRON[23445]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:38:01 wikitech-static CRON[23446]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:38:02 wikitech-static check_icinga[23448]: 2021-11-07 14:38:02,927 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:38:03 wikitech-static check_icinga[23447]: 2021-11-07 14:38:03,005 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:38:05 wikitech-static check_icinga[23447]: 2021-11-07 14:38:05,705 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:38:06 wikitech-static check_icinga[23448]: 2021-11-07 14:38:06,204 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:39:01 wikitech-static CRON[23492]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 14:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 14:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 14:40:01 wikitech-static CRON[23616]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:40:01 wikitech-static CRON[23618]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:40:02 wikitech-static check_icinga[23619]: 2021-11-07 14:40:02,346 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:40:02 wikitech-static check_icinga[23617]: 2021-11-07 14:40:02,361 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:40:05 wikitech-static check_icinga[23617]: 2021-11-07 14:40:05,115 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:40:05 wikitech-static check_icinga[23619]: 2021-11-07 14:40:05,421 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:42:01 wikitech-static CRON[23746]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:42:01 wikitech-static CRON[23747]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:42:02 wikitech-static check_icinga[23748]: 2021-11-07 14:42:02,591 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:42:02 wikitech-static check_icinga[23749]: 2021-11-07 14:42:02,655 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:42:05 wikitech-static check_icinga[23749]: 2021-11-07 14:42:05,481 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:42:05 wikitech-static check_icinga[23748]: 2021-11-07 14:42:05,847 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:44:01 wikitech-static CRON[23842]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:44:01 wikitech-static CRON[23843]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:44:03 wikitech-static check_icinga[23845]: 2021-11-07 14:44:03,030 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:44:03 wikitech-static check_icinga[23844]: 2021-11-07 14:44:03,033 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:44:05 wikitech-static check_icinga[23844]: 2021-11-07 14:44:05,984 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:44:06 wikitech-static check_icinga[23845]: 2021-11-07 14:44:06,040 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:46:01 wikitech-static CRON[23932]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:46:01 wikitech-static CRON[23933]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:46:02 wikitech-static check_icinga[23935]: 2021-11-07 14:46:02,218 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:46:02 wikitech-static check_icinga[23934]: 2021-11-07 14:46:02,223 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:46:05 wikitech-static check_icinga[23934]: 2021-11-07 14:46:05,299 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:46:05 wikitech-static check_icinga[23935]: 2021-11-07 14:46:05,616 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:48:01 wikitech-static CRON[24017]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:48:01 wikitech-static CRON[24018]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:48:02 wikitech-static check_icinga[24020]: 2021-11-07 14:48:02,920 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:48:02 wikitech-static check_icinga[24019]: 2021-11-07 14:48:02,990 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:48:05 wikitech-static check_icinga[24019]: 2021-11-07 14:48:05,864 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:48:06 wikitech-static check_icinga[24020]: 2021-11-07 14:48:06,203 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:50:01 wikitech-static CRON[24093]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:50:01 wikitech-static CRON[24094]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:50:02 wikitech-static check_icinga[24095]: 2021-11-07 14:50:02,365 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:50:02 wikitech-static check_icinga[24096]: 2021-11-07 14:50:02,370 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:50:05 wikitech-static check_icinga[24095]: 2021-11-07 14:50:05,365 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:50:05 wikitech-static check_icinga[24096]: 2021-11-07 14:50:05,981 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:52:01 wikitech-static CRON[24168]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:52:01 wikitech-static CRON[24169]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:52:02 wikitech-static check_icinga[24171]: 2021-11-07 14:52:02,125 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:52:02 wikitech-static check_icinga[24170]: 2021-11-07 14:52:02,185 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:52:05 wikitech-static check_icinga[24170]: 2021-11-07 14:52:05,227 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:52:05 wikitech-static check_icinga[24171]: 2021-11-07 14:52:05,315 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:54:01 wikitech-static CRON[24245]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:54:01 wikitech-static CRON[24246]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:54:02 wikitech-static check_icinga[24248]: 2021-11-07 14:54:02,472 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:54:02 wikitech-static check_icinga[24247]: 2021-11-07 14:54:02,481 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:54:05 wikitech-static check_icinga[24247]: 2021-11-07 14:54:05,390 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:54:05 wikitech-static check_icinga[24248]: 2021-11-07 14:54:05,637 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:56:01 wikitech-static CRON[24321]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:56:01 wikitech-static CRON[24322]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:56:03 wikitech-static check_icinga[24324]: 2021-11-07 14:56:03,566 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:56:03 wikitech-static check_icinga[24323]: 2021-11-07 14:56:03,594 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:56:06 wikitech-static check_icinga[24324]: 2021-11-07 14:56:06,479 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 14:56:06 wikitech-static check_icinga[24323]: 2021-11-07 14:56:06,573 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:58:01 wikitech-static CRON[24399]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 14:58:01 wikitech-static CRON[24400]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 14:58:02 wikitech-static check_icinga[24401]: 2021-11-07 14:58:02,841 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 14:58:02 wikitech-static check_icinga[24402]: 2021-11-07 14:58:02,910 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 14:58:05 wikitech-static check_icinga[24401]: 2021-11-07 14:58:05,801 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 14:58:06 wikitech-static check_icinga[24402]: 2021-11-07 14:58:06,110 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:00:01 wikitech-static CRON[24485]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:00:01 wikitech-static CRON[24486]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:00:02 wikitech-static check_icinga[24488]: 2021-11-07 15:00:02,237 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:00:02 wikitech-static check_icinga[24487]: 2021-11-07 15:00:02,262 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:00:05 wikitech-static check_icinga[24487]: 2021-11-07 15:00:05,323 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:00:05 wikitech-static check_icinga[24488]: 2021-11-07 15:00:05,559 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:02:01 wikitech-static CRON[24560]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:02:01 wikitech-static CRON[24561]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:02:02 wikitech-static check_icinga[24563]: 2021-11-07 15:02:02,703 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:02:02 wikitech-static check_icinga[24562]: 2021-11-07 15:02:02,705 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:02:05 wikitech-static check_icinga[24562]: 2021-11-07 15:02:05,660 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:02:05 wikitech-static check_icinga[24563]: 2021-11-07 15:02:05,936 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:04:01 wikitech-static CRON[24635]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:04:01 wikitech-static CRON[24636]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:04:01 wikitech-static systemd[1]: Starting Daily apt download activities...
Nov 7 15:04:02 wikitech-static check_icinga[24637]: 2021-11-07 15:04:02,148 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:04:02 wikitech-static check_icinga[24638]: 2021-11-07 15:04:02,165 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:04:03 wikitech-static systemd[1]: Started Daily apt download activities.
Nov 7 15:04:03 wikitech-static systemd[1]: apt-daily.timer: Adding 5h 11min 43.897564s random time.
Nov 7 15:04:03 wikitech-static systemd[1]: apt-daily.timer: Adding 7min 14.847413s random time.
Nov 7 15:04:05 wikitech-static check_icinga[24637]: 2021-11-07 15:04:05,120 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:04:05 wikitech-static check_icinga[24638]: 2021-11-07 15:04:05,254 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:06:01 wikitech-static CRON[24756]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:06:01 wikitech-static CRON[24757]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:06:03 wikitech-static check_icinga[24758]: 2021-11-07 15:06:03,756 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:06:03 wikitech-static check_icinga[24759]: 2021-11-07 15:06:03,824 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:06:06 wikitech-static check_icinga[24758]: 2021-11-07 15:06:06,761 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:06:06 wikitech-static check_icinga[24759]: 2021-11-07 15:06:06,845 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:08:01 wikitech-static CRON[24831]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:08:01 wikitech-static CRON[24832]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:08:02 wikitech-static check_icinga[24833]: 2021-11-07 15:08:02,998 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:08:03 wikitech-static check_icinga[24834]: 2021-11-07 15:08:03,001 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:08:06 wikitech-static check_icinga[24833]: 2021-11-07 15:08:06,171 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:08:06 wikitech-static check_icinga[24834]: 2021-11-07 15:08:06,224 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:09:01 wikitech-static CRON[24878]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 15:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 15:09:11 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 15:10:01 wikitech-static CRON[25000]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:10:01 wikitech-static CRON[25001]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:10:03 wikitech-static check_icinga[25002]: 2021-11-07 15:10:03,268 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:10:03 wikitech-static check_icinga[25003]: 2021-11-07 15:10:03,336 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:10:06 wikitech-static check_icinga[25002]: 2021-11-07 15:10:06,164 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:10:06 wikitech-static check_icinga[25003]: 2021-11-07 15:10:06,351 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:12:01 wikitech-static CRON[25089]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:12:01 wikitech-static CRON[25090]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:12:02 wikitech-static check_icinga[25091]: 2021-11-07 15:12:02,887 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:12:02 wikitech-static check_icinga[25092]: 2021-11-07 15:12:02,888 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:12:05 wikitech-static check_icinga[25091]: 2021-11-07 15:12:05,893 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:12:06 wikitech-static check_icinga[25092]: 2021-11-07 15:12:06,249 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:14:01 wikitech-static CRON[25162]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:14:01 wikitech-static CRON[25163]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:14:02 wikitech-static check_icinga[25165]: 2021-11-07 15:14:02,446 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:14:02 wikitech-static check_icinga[25164]: 2021-11-07 15:14:02,475 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:14:05 wikitech-static check_icinga[25164]: 2021-11-07 15:14:05,498 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:14:05 wikitech-static check_icinga[25165]: 2021-11-07 15:14:05,551 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:16:01 wikitech-static CRON[25237]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:16:01 wikitech-static CRON[25238]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:16:02 wikitech-static check_icinga[25240]: 2021-11-07 15:16:02,769 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:16:02 wikitech-static check_icinga[25239]: 2021-11-07 15:16:02,773 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:16:05 wikitech-static check_icinga[25240]: 2021-11-07 15:16:05,828 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:16:05 wikitech-static check_icinga[25239]: 2021-11-07 15:16:05,885 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:17:02 wikitech-static CRON[25284]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 15:18:01 wikitech-static CRON[25315]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:18:01 wikitech-static CRON[25316]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:18:02 wikitech-static check_icinga[25317]: 2021-11-07 15:18:02,341 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:18:02 wikitech-static check_icinga[25318]: 2021-11-07 15:18:02,371 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:18:05 wikitech-static check_icinga[25317]: 2021-11-07 15:18:05,308 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:18:05 wikitech-static check_icinga[25318]: 2021-11-07 15:18:05,656 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:20:01 wikitech-static CRON[25396]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:20:01 wikitech-static CRON[25397]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:20:02 wikitech-static check_icinga[25398]: 2021-11-07 15:20:02,893 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:20:02 wikitech-static check_icinga[25399]: 2021-11-07 15:20:02,909 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:20:05 wikitech-static check_icinga[25398]: 2021-11-07 15:20:05,789 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:20:05 wikitech-static check_icinga[25399]: 2021-11-07 15:20:05,915 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:22:01 wikitech-static CRON[25471]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:22:01 wikitech-static CRON[25472]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:22:03 wikitech-static check_icinga[25473]: 2021-11-07 15:22:03,016 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:22:03 wikitech-static check_icinga[25474]: 2021-11-07 15:22:03,113 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:22:06 wikitech-static check_icinga[25474]: 2021-11-07 15:22:06,124 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:22:06 wikitech-static check_icinga[25473]: 2021-11-07 15:22:06,171 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:24:01 wikitech-static CRON[25549]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:24:01 wikitech-static CRON[25551]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:24:02 wikitech-static check_icinga[25550]: 2021-11-07 15:24:02,334 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:24:02 wikitech-static check_icinga[25552]: 2021-11-07 15:24:02,388 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:24:05 wikitech-static check_icinga[25550]: 2021-11-07 15:24:05,306 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:24:05 wikitech-static check_icinga[25552]: 2021-11-07 15:24:05,467 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:26:01 wikitech-static CRON[25627]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:26:01 wikitech-static CRON[25628]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:26:02 wikitech-static check_icinga[25629]: 2021-11-07 15:26:02,605 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:26:02 wikitech-static check_icinga[25630]: 2021-11-07 15:26:02,633 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:26:05 wikitech-static check_icinga[25630]: 2021-11-07 15:26:05,723 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:26:05 wikitech-static check_icinga[25629]: 2021-11-07 15:26:05,762 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:28:01 wikitech-static CRON[25710]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:28:01 wikitech-static CRON[25712]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:28:03 wikitech-static check_icinga[25713]: 2021-11-07 15:28:03,110 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:28:03 wikitech-static check_icinga[25711]: 2021-11-07 15:28:03,166 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:28:06 wikitech-static check_icinga[25711]: 2021-11-07 15:28:06,011 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:28:06 wikitech-static check_icinga[25713]: 2021-11-07 15:28:06,236 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:30:01 wikitech-static CRON[25788]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:30:01 wikitech-static CRON[25789]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:30:02 wikitech-static check_icinga[25790]: 2021-11-07 15:30:02,498 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:30:02 wikitech-static check_icinga[25791]: 2021-11-07 15:30:02,505 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:30:05 wikitech-static check_icinga[25790]: 2021-11-07 15:30:05,474 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:30:05 wikitech-static check_icinga[25791]: 2021-11-07 15:30:05,630 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:32:01 wikitech-static CRON[25864]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:32:01 wikitech-static CRON[25865]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:32:02 wikitech-static check_icinga[25867]: 2021-11-07 15:32:02,755 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:32:02 wikitech-static check_icinga[25866]: 2021-11-07 15:32:02,868 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:32:05 wikitech-static check_icinga[25866]: 2021-11-07 15:32:05,818 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:32:05 wikitech-static check_icinga[25867]: 2021-11-07 15:32:05,881 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:34:01 wikitech-static CRON[25947]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:34:01 wikitech-static CRON[25948]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:34:03 wikitech-static check_icinga[25950]: 2021-11-07 15:34:03,037 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:34:03 wikitech-static check_icinga[25949]: 2021-11-07 15:34:03,061 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:34:04 wikitech-static check_icinga[25950]: 2021-11-07 15:34:04,401 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)']
Nov 7 15:34:06 wikitech-static check_icinga[25949]: 2021-11-07 15:34:06,157 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:34:14 wikitech-static check_icinga[25950]: 2021-11-07 15:34:14,413 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:34:17 wikitech-static check_icinga[25950]: 2021-11-07 15:34:17,400 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:36:01 wikitech-static CRON[26068]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:36:01 wikitech-static CRON[26069]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:36:02 wikitech-static check_icinga[26070]: 2021-11-07 15:36:02,495 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:36:02 wikitech-static check_icinga[26071]: 2021-11-07 15:36:02,520 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:36:05 wikitech-static check_icinga[26070]: 2021-11-07 15:36:05,150 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:36:05 wikitech-static check_icinga[26071]: 2021-11-07 15:36:05,532 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:38:01 wikitech-static CRON[26151]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:38:01 wikitech-static CRON[26152]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:38:02 wikitech-static check_icinga[26153]: 2021-11-07 15:38:02,674 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:38:02 wikitech-static check_icinga[26154]: 2021-11-07 15:38:02,677 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:38:05 wikitech-static check_icinga[26153]: 2021-11-07 15:38:05,458 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:38:05 wikitech-static check_icinga[26154]: 2021-11-07 15:38:05,921 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:39:01 wikitech-static CRON[26201]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 15:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 15:39:06 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 15:40:02 wikitech-static CRON[26331]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:40:02 wikitech-static CRON[26332]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:40:03 wikitech-static check_icinga[26333]: 2021-11-07 15:40:03,170 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:40:03 wikitech-static check_icinga[26334]: 2021-11-07 15:40:03,177 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:40:06 wikitech-static check_icinga[26333]: 2021-11-07 15:40:06,033 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:40:06 wikitech-static check_icinga[26334]: 2021-11-07 15:40:06,315 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:42:01 wikitech-static CRON[26476]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:42:01 wikitech-static CRON[26477]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:42:02 wikitech-static check_icinga[26479]: 2021-11-07 15:42:02,566 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:42:02 wikitech-static check_icinga[26478]: 2021-11-07 15:42:02,629 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:42:05 wikitech-static check_icinga[26478]: 2021-11-07 15:42:05,461 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:42:05 wikitech-static check_icinga[26479]: 2021-11-07 15:42:05,875 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:44:01 wikitech-static CRON[26557]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:44:01 wikitech-static CRON[26559]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:44:03 wikitech-static check_icinga[26558]: 2021-11-07 15:44:03,015 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:44:03 wikitech-static check_icinga[26560]: 2021-11-07 15:44:03,099 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:44:05 wikitech-static check_icinga[26558]: 2021-11-07 15:44:05,780 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:44:06 wikitech-static check_icinga[26560]: 2021-11-07 15:44:06,235 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:46:01 wikitech-static CRON[26645]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:46:01 wikitech-static CRON[26646]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:46:02 wikitech-static check_icinga[26648]: 2021-11-07 15:46:02,378 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:46:02 wikitech-static check_icinga[26647]: 2021-11-07 15:46:02,403 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:46:05 wikitech-static check_icinga[26648]: 2021-11-07 15:46:05,182 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:46:05 wikitech-static check_icinga[26647]: 2021-11-07 15:46:05,500 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:48:01 wikitech-static CRON[26723]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:48:01 wikitech-static CRON[26724]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:48:02 wikitech-static check_icinga[26726]: 2021-11-07 15:48:02,709 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:48:02 wikitech-static check_icinga[26725]: 2021-11-07 15:48:02,714 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:48:05 wikitech-static check_icinga[26726]: 2021-11-07 15:48:05,666 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:48:05 wikitech-static check_icinga[26725]: 2021-11-07 15:48:05,828 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:50:01 wikitech-static CRON[26799]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:50:01 wikitech-static CRON[26800]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:50:02 wikitech-static check_icinga[26801]: 2021-11-07 15:50:02,946 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:50:02 wikitech-static check_icinga[26802]: 2021-11-07 15:50:02,972 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:50:06 wikitech-static check_icinga[26802]: 2021-11-07 15:50:06,133 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:50:06 wikitech-static check_icinga[26801]: 2021-11-07 15:50:06,146 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:52:01 wikitech-static CRON[26875]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:52:01 wikitech-static CRON[26876]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:52:02 wikitech-static check_icinga[26878]: 2021-11-07 15:52:02,463 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:52:02 wikitech-static check_icinga[26877]: 2021-11-07 15:52:02,469 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:52:05 wikitech-static check_icinga[26877]: 2021-11-07 15:52:05,585 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:52:05 wikitech-static check_icinga[26878]: 2021-11-07 15:52:05,650 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:54:01 wikitech-static CRON[26953]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:54:01 wikitech-static CRON[26954]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:54:02 wikitech-static check_icinga[26956]: 2021-11-07 15:54:02,827 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:54:02 wikitech-static check_icinga[26955]: 2021-11-07 15:54:02,840 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:54:05 wikitech-static check_icinga[26955]: 2021-11-07 15:54:05,837 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:54:06 wikitech-static check_icinga[26956]: 2021-11-07 15:54:06,082 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:56:01 wikitech-static CRON[27037]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:56:01 wikitech-static CRON[27038]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:56:02 wikitech-static check_icinga[27039]: 2021-11-07 15:56:02,213 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:56:02 wikitech-static check_icinga[27040]: 2021-11-07 15:56:02,239 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:56:05 wikitech-static check_icinga[27039]: 2021-11-07 15:56:05,348 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:56:05 wikitech-static check_icinga[27040]: 2021-11-07 15:56:05,459 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 15:58:01 wikitech-static CRON[27114]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 15:58:01 wikitech-static CRON[27115]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 15:58:02 wikitech-static check_icinga[27117]: 2021-11-07 15:58:02,673 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 15:58:02 wikitech-static check_icinga[27116]: 2021-11-07 15:58:02,677 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 15:58:05 wikitech-static check_icinga[27117]: 2021-11-07 15:58:05,853 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 15:58:05 wikitech-static check_icinga[27116]: 2021-11-07 15:58:05,928 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:00:01 wikitech-static CRON[27189]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:00:01 wikitech-static CRON[27191]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:00:02 wikitech-static check_icinga[27190]: 2021-11-07 16:00:02,043 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:00:02 wikitech-static check_icinga[27192]: 2021-11-07 16:00:02,060 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:00:05 wikitech-static check_icinga[27190]: 2021-11-07 16:00:05,045 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:00:05 wikitech-static check_icinga[27192]: 2021-11-07 16:00:05,171 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:02:01 wikitech-static CRON[27265]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:02:01 wikitech-static CRON[27266]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:02:02 wikitech-static check_icinga[27267]: 2021-11-07 16:02:02,277 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:02:02 wikitech-static check_icinga[27268]: 2021-11-07 16:02:02,299 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:02:05 wikitech-static check_icinga[27268]: 2021-11-07 16:02:05,476 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:02:05 wikitech-static check_icinga[27267]: 2021-11-07 16:02:05,621 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:04:01 wikitech-static CRON[27343]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:04:01 wikitech-static CRON[27344]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:04:02 wikitech-static check_icinga[27345]: 2021-11-07 16:04:02,767 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:04:02 wikitech-static check_icinga[27346]: 2021-11-07 16:04:02,775 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:04:05 wikitech-static check_icinga[27345]: 2021-11-07 16:04:05,950 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:04:06 wikitech-static check_icinga[27346]: 2021-11-07 16:04:06,066 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:06:01 wikitech-static CRON[27421]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:06:01 wikitech-static CRON[27422]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:06:02 wikitech-static check_icinga[27424]: 2021-11-07 16:06:02,245 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:06:02 wikitech-static check_icinga[27423]: 2021-11-07 16:06:02,243 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:06:05 wikitech-static check_icinga[27424]: 2021-11-07 16:06:05,437 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:06:05 wikitech-static check_icinga[27423]: 2021-11-07 16:06:05,513 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:08:01 wikitech-static CRON[27502]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:08:01 wikitech-static CRON[27503]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:08:02 wikitech-static check_icinga[27505]: 2021-11-07 16:08:02,678 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:08:02 wikitech-static check_icinga[27504]: 2021-11-07 16:08:02,681 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:08:05 wikitech-static check_icinga[27505]: 2021-11-07 16:08:05,777 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:08:06 wikitech-static check_icinga[27504]: 2021-11-07 16:08:06,118 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:09:00 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 16:09:00 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 16:09:01 wikitech-static CRON[27655]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 16:10:01 wikitech-static CRON[27687]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:10:01 wikitech-static CRON[27688]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:10:02 wikitech-static check_icinga[27689]: 2021-11-07 16:10:02,286 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:10:02 wikitech-static check_icinga[27690]: 2021-11-07 16:10:02,363 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:10:05 wikitech-static check_icinga[27689]: 2021-11-07 16:10:05,724 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:10:05 wikitech-static check_icinga[27690]: 2021-11-07 16:10:05,776 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:11:01 wikitech-static CRON[27736]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh)
Nov 7 16:11:02 wikitech-static check_icinga_validate_config[27737]: Valid config, nothing to do.
Nov 7 16:12:01 wikitech-static CRON[27772]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:12:01 wikitech-static CRON[27773]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:12:02 wikitech-static check_icinga[27774]: 2021-11-07 16:12:02,778 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:12:02 wikitech-static check_icinga[27775]: 2021-11-07 16:12:02,807 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:12:06 wikitech-static check_icinga[27774]: 2021-11-07 16:12:06,081 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:12:06 wikitech-static check_icinga[27775]: 2021-11-07 16:12:06,118 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:14:01 wikitech-static CRON[27855]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:14:01 wikitech-static CRON[27856]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:14:02 wikitech-static check_icinga[27857]: 2021-11-07 16:14:02,282 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:14:02 wikitech-static check_icinga[27858]: 2021-11-07 16:14:02,308 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:14:05 wikitech-static check_icinga[27857]: 2021-11-07 16:14:05,505 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:14:05 wikitech-static check_icinga[27858]: 2021-11-07 16:14:05,548 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:16:01 wikitech-static CRON[27940]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:16:01 wikitech-static CRON[27942]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:16:02 wikitech-static check_icinga[27941]: 2021-11-07 16:16:02,818 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:16:02 wikitech-static check_icinga[27943]: 2021-11-07 16:16:02,870 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:16:06 wikitech-static check_icinga[27941]: 2021-11-07 16:16:06,146 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:16:06 wikitech-static check_icinga[27943]: 2021-11-07 16:16:06,442 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:17:01 wikitech-static CRON[27993]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 16:18:01 wikitech-static CRON[28029]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:18:01 wikitech-static CRON[28031]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:18:02 wikitech-static check_icinga[28030]: 2021-11-07 16:18:02,569 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:18:02 wikitech-static check_icinga[28032]: 2021-11-07 16:18:02,588 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:18:05 wikitech-static check_icinga[28032]: 2021-11-07 16:18:05,996 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:18:06 wikitech-static check_icinga[28030]: 2021-11-07 16:18:06,098 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:20:01 wikitech-static CRON[28105]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:20:01 wikitech-static CRON[28106]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:20:02 wikitech-static check_icinga[28107]: 2021-11-07 16:20:02,242 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:20:02 wikitech-static check_icinga[28108]: 2021-11-07 16:20:02,246 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:20:05 wikitech-static check_icinga[28107]: 2021-11-07 16:20:05,348 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:20:05 wikitech-static check_icinga[28108]: 2021-11-07 16:20:05,400 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:22:01 wikitech-static CRON[28183]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:22:01 wikitech-static CRON[28185]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:22:02 wikitech-static check_icinga[28186]: 2021-11-07 16:22:02,585 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:22:02 wikitech-static check_icinga[28184]: 2021-11-07 16:22:02,615 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:22:05 wikitech-static check_icinga[28184]: 2021-11-07 16:22:05,764 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:22:05 wikitech-static check_icinga[28186]: 2021-11-07 16:22:05,826 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:24:01 wikitech-static CRON[28263]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:24:01 wikitech-static CRON[28264]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:24:02 wikitech-static check_icinga[28266]: 2021-11-07 16:24:02,981 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:24:02 wikitech-static check_icinga[28265]: 2021-11-07 16:24:02,986 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:24:06 wikitech-static check_icinga[28265]: 2021-11-07 16:24:06,189 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:24:06 wikitech-static check_icinga[28266]: 2021-11-07 16:24:06,312 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:26:01 wikitech-static CRON[28351]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:26:01 wikitech-static CRON[28352]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:26:02 wikitech-static check_icinga[28353]: 2021-11-07 16:26:02,466 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:26:02 wikitech-static check_icinga[28354]: 2021-11-07 16:26:02,473 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:26:05 wikitech-static check_icinga[28354]: 2021-11-07 16:26:05,598 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:26:05 wikitech-static check_icinga[28353]: 2021-11-07 16:26:05,756 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:28:01 wikitech-static CRON[28431]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:28:01 wikitech-static CRON[28432]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:28:02 wikitech-static check_icinga[28433]: 2021-11-07 16:28:02,886 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:28:02 wikitech-static check_icinga[28434]: 2021-11-07 16:28:02,893 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:28:06 wikitech-static check_icinga[28433]: 2021-11-07 16:28:06,101 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:28:06 wikitech-static check_icinga[28434]: 2021-11-07 16:28:06,109 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:30:01 wikitech-static CRON[28512]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:30:01 wikitech-static CRON[28513]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:30:02 wikitech-static check_icinga[28515]: 2021-11-07 16:30:02,329 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:30:02 wikitech-static check_icinga[28514]: 2021-11-07 16:30:02,327 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:30:05 wikitech-static check_icinga[28514]: 2021-11-07 16:30:05,516 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:30:05 wikitech-static check_icinga[28515]: 2021-11-07 16:30:05,556 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:32:01 wikitech-static CRON[28593]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:32:01 wikitech-static CRON[28594]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:32:02 wikitech-static check_icinga[28595]: 2021-11-07 16:32:02,868 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:32:02 wikitech-static check_icinga[28596]: 2021-11-07 16:32:02,872 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:32:05 wikitech-static check_icinga[28596]: 2021-11-07 16:32:05,893 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:32:06 wikitech-static check_icinga[28595]: 2021-11-07 16:32:06,179 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:34:01 wikitech-static CRON[28675]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:34:01 wikitech-static CRON[28676]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:34:02 wikitech-static check_icinga[28677]: 2021-11-07 16:34:02,309 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:34:02 wikitech-static check_icinga[28678]: 2021-11-07 16:34:02,313 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:34:03 wikitech-static check_icinga[28678]: 2021-11-07 16:34:03,683 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Service Checks Being Executed? MISSING_KEY (expected YES)']
Nov 7 16:34:05 wikitech-static check_icinga[28677]: 2021-11-07 16:34:05,636 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:34:13 wikitech-static check_icinga[28678]: 2021-11-07 16:34:13,696 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:34:16 wikitech-static check_icinga[28678]: 2021-11-07 16:34:16,625 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:36:01 wikitech-static CRON[28753]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:36:01 wikitech-static CRON[28754]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:36:02 wikitech-static check_icinga[28755]: 2021-11-07 16:36:02,798 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:36:02 wikitech-static check_icinga[28756]: 2021-11-07 16:36:02,843 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:36:05 wikitech-static check_icinga[28755]: 2021-11-07 16:36:05,472 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:36:06 wikitech-static check_icinga[28756]: 2021-11-07 16:36:06,168 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:38:01 wikitech-static CRON[28843]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:38:01 wikitech-static CRON[28844]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:38:02 wikitech-static check_icinga[28845]: 2021-11-07 16:38:02,429 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:38:02 wikitech-static check_icinga[28846]: 2021-11-07 16:38:02,470 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:38:05 wikitech-static check_icinga[28845]: 2021-11-07 16:38:05,111 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:38:05 wikitech-static check_icinga[28846]: 2021-11-07 16:38:05,479 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:39:01 wikitech-static CRON[28890]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 16:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 16:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 16:40:01 wikitech-static CRON[29012]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:40:01 wikitech-static CRON[29013]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:40:02 wikitech-static check_icinga[29015]: 2021-11-07 16:40:02,624 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:40:02 wikitech-static check_icinga[29014]: 2021-11-07 16:40:02,638 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:40:05 wikitech-static check_icinga[29014]: 2021-11-07 16:40:05,388 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:40:05 wikitech-static check_icinga[29015]: 2021-11-07 16:40:05,834 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:42:01 wikitech-static CRON[29099]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:42:01 wikitech-static CRON[29100]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:42:02 wikitech-static check_icinga[29101]: 2021-11-07 16:42:02,938 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:42:02 wikitech-static check_icinga[29102]: 2021-11-07 16:42:02,964 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:42:05 wikitech-static check_icinga[29101]: 2021-11-07 16:42:05,808 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:42:06 wikitech-static check_icinga[29102]: 2021-11-07 16:42:06,061 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:44:01 wikitech-static CRON[29181]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:44:01 wikitech-static CRON[29182]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:44:02 wikitech-static check_icinga[29183]: 2021-11-07 16:44:02,221 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:44:02 wikitech-static check_icinga[29184]: 2021-11-07 16:44:02,289 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:44:05 wikitech-static check_icinga[29183]: 2021-11-07 16:44:05,046 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:44:05 wikitech-static check_icinga[29184]: 2021-11-07 16:44:05,659 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:46:01 wikitech-static CRON[29264]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:46:01 wikitech-static CRON[29265]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:46:02 wikitech-static check_icinga[29266]: 2021-11-07 16:46:02,777 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:46:02 wikitech-static check_icinga[29267]: 2021-11-07 16:46:02,807 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:46:05 wikitech-static check_icinga[29266]: 2021-11-07 16:46:05,647 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:46:05 wikitech-static check_icinga[29267]: 2021-11-07 16:46:05,966 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:48:01 wikitech-static CRON[29342]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:48:01 wikitech-static CRON[29343]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:48:02 wikitech-static check_icinga[29345]: 2021-11-07 16:48:02,227 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:48:02 wikitech-static check_icinga[29344]: 2021-11-07 16:48:02,253 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:48:05 wikitech-static check_icinga[29344]: 2021-11-07 16:48:05,237 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:48:05 wikitech-static check_icinga[29345]: 2021-11-07 16:48:05,579 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:50:01 wikitech-static CRON[29420]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:50:01 wikitech-static CRON[29421]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:50:02 wikitech-static check_icinga[29422]: 2021-11-07 16:50:02,714 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:50:02 wikitech-static check_icinga[29423]: 2021-11-07 16:50:02,784 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:50:05 wikitech-static check_icinga[29422]: 2021-11-07 16:50:05,826 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:50:06 wikitech-static check_icinga[29423]: 2021-11-07 16:50:06,169 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:52:01 wikitech-static CRON[29500]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:52:01 wikitech-static CRON[29501]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:52:02 wikitech-static check_icinga[29502]: 2021-11-07 16:52:02,289 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:52:02 wikitech-static check_icinga[29503]: 2021-11-07 16:52:02,345 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:52:05 wikitech-static check_icinga[29502]: 2021-11-07 16:52:05,299 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:52:05 wikitech-static check_icinga[29503]: 2021-11-07 16:52:05,338 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:54:01 wikitech-static CRON[29579]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:54:01 wikitech-static CRON[29580]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:54:02 wikitech-static check_icinga[29581]: 2021-11-07 16:54:02,550 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:54:02 wikitech-static check_icinga[29582]: 2021-11-07 16:54:02,553 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:54:05 wikitech-static check_icinga[29582]: 2021-11-07 16:54:05,518 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:54:05 wikitech-static check_icinga[29581]: 2021-11-07 16:54:05,687 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:56:01 wikitech-static CRON[29721]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:56:01 wikitech-static CRON[29722]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:56:02 wikitech-static check_icinga[29724]: 2021-11-07 16:56:02,848 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:56:02 wikitech-static check_icinga[29723]: 2021-11-07 16:56:02,853 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:56:06 wikitech-static check_icinga[29723]: 2021-11-07 16:56:06,076 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 16:56:06 wikitech-static check_icinga[29724]: 2021-11-07 16:56:06,112 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:58:01 wikitech-static CRON[29804]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 16:58:01 wikitech-static CRON[29806]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 16:58:02 wikitech-static check_icinga[29805]: 2021-11-07 16:58:02,338 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 16:58:02 wikitech-static check_icinga[29807]: 2021-11-07 16:58:02,350 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 16:58:05 wikitech-static check_icinga[29805]: 2021-11-07 16:58:05,383 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 16:58:05 wikitech-static check_icinga[29807]: 2021-11-07 16:58:05,537 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:00:01 wikitech-static CRON[29889]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:00:01 wikitech-static CRON[29890]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:00:02 wikitech-static check_icinga[29891]: 2021-11-07 17:00:02,710 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:00:02 wikitech-static check_icinga[29892]: 2021-11-07 17:00:02,735 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:00:05 wikitech-static check_icinga[29891]: 2021-11-07 17:00:05,743 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:00:05 wikitech-static check_icinga[29892]: 2021-11-07 17:00:05,753 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:02:01 wikitech-static CRON[29970]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:02:01 wikitech-static CRON[29971]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:02:02 wikitech-static check_icinga[29972]: 2021-11-07 17:02:02,981 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:02:03 wikitech-static check_icinga[29973]: 2021-11-07 17:02:03,053 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:02:05 wikitech-static check_icinga[29973]: 2021-11-07 17:02:05,922 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:02:06 wikitech-static check_icinga[29972]: 2021-11-07 17:02:06,138 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:04:01 wikitech-static CRON[30045]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:04:01 wikitech-static CRON[30046]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:04:02 wikitech-static check_icinga[30048]: 2021-11-07 17:04:02,292 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:04:02 wikitech-static check_icinga[30047]: 2021-11-07 17:04:02,297 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:04:05 wikitech-static check_icinga[30047]: 2021-11-07 17:04:05,368 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:04:05 wikitech-static check_icinga[30048]: 2021-11-07 17:04:05,423 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:06:01 wikitech-static CRON[30120]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:06:01 wikitech-static CRON[30121]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:06:02 wikitech-static check_icinga[30123]: 2021-11-07 17:06:02,589 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:06:02 wikitech-static check_icinga[30122]: 2021-11-07 17:06:02,614 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:06:05 wikitech-static check_icinga[30123]: 2021-11-07 17:06:05,666 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:06:05 wikitech-static check_icinga[30122]: 2021-11-07 17:06:05,802 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:08:01 wikitech-static CRON[30200]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:08:01 wikitech-static CRON[30201]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:08:02 wikitech-static check_icinga[30202]: 2021-11-07 17:08:02,945 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:08:02 wikitech-static check_icinga[30203]: 2021-11-07 17:08:02,953 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:08:06 wikitech-static check_icinga[30202]: 2021-11-07 17:08:06,059 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:08:06 wikitech-static check_icinga[30203]: 2021-11-07 17:08:06,196 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:09:01 wikitech-static CRON[30252]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 17:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 17:09:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 17:10:01 wikitech-static CRON[30374]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:10:01 wikitech-static CRON[30375]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:10:02 wikitech-static check_icinga[30376]: 2021-11-07 17:10:02,357 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:10:02 wikitech-static check_icinga[30377]: 2021-11-07 17:10:02,392 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:10:05 wikitech-static check_icinga[30377]: 2021-11-07 17:10:05,305 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:10:05 wikitech-static check_icinga[30376]: 2021-11-07 17:10:05,732 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:12:01 wikitech-static CRON[30452]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:12:01 wikitech-static CRON[30453]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:12:02 wikitech-static check_icinga[30454]: 2021-11-07 17:12:02,861 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:12:02 wikitech-static check_icinga[30455]: 2021-11-07 17:12:02,865 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:12:06 wikitech-static check_icinga[30454]: 2021-11-07 17:12:06,002 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:12:06 wikitech-static check_icinga[30455]: 2021-11-07 17:12:06,092 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:14:01 wikitech-static CRON[30530]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:14:01 wikitech-static CRON[30531]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:14:02 wikitech-static check_icinga[30532]: 2021-11-07 17:14:02,213 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:14:02 wikitech-static check_icinga[30533]: 2021-11-07 17:14:02,221 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:14:05 wikitech-static check_icinga[30532]: 2021-11-07 17:14:05,444 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:14:05 wikitech-static check_icinga[30533]: 2021-11-07 17:14:05,453 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:16:01 wikitech-static CRON[30614]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:16:01 wikitech-static CRON[30615]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:16:02 wikitech-static check_icinga[30616]: 2021-11-07 17:16:02,660 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:16:02 wikitech-static check_icinga[30617]: 2021-11-07 17:16:02,663 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:16:05 wikitech-static check_icinga[30616]: 2021-11-07 17:16:05,766 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:16:05 wikitech-static check_icinga[30617]: 2021-11-07 17:16:05,846 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:17:01 wikitech-static CRON[30661]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 17:18:01 wikitech-static CRON[30692]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:18:01 wikitech-static CRON[30693]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:18:03 wikitech-static check_icinga[30695]: 2021-11-07 17:18:03,002 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:18:03 wikitech-static check_icinga[30694]: 2021-11-07 17:18:03,005 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:18:06 wikitech-static check_icinga[30694]: 2021-11-07 17:18:06,147 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:18:06 wikitech-static check_icinga[30695]: 2021-11-07 17:18:06,286 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:20:01 wikitech-static CRON[30774]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:20:01 wikitech-static CRON[30775]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:20:02 wikitech-static check_icinga[30777]: 2021-11-07 17:20:02,411 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:20:02 wikitech-static check_icinga[30776]: 2021-11-07 17:20:02,505 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:20:05 wikitech-static check_icinga[30776]: 2021-11-07 17:20:05,545 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:20:05 wikitech-static check_icinga[30777]: 2021-11-07 17:20:05,767 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:22:01 wikitech-static CRON[30849]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:22:01 wikitech-static CRON[30850]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:22:03 wikitech-static check_icinga[30851]: 2021-11-07 17:22:03,019 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:22:03 wikitech-static check_icinga[30852]: 2021-11-07 17:22:03,021 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:22:05 wikitech-static check_icinga[30852]: 2021-11-07 17:22:05,975 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:22:06 wikitech-static check_icinga[30851]: 2021-11-07 17:22:06,304 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:24:01 wikitech-static CRON[30924]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:24:01 wikitech-static CRON[30925]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:24:02 wikitech-static check_icinga[30927]: 2021-11-07 17:24:02,481 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:24:02 wikitech-static check_icinga[30926]: 2021-11-07 17:24:02,482 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:24:05 wikitech-static check_icinga[30926]: 2021-11-07 17:24:05,653 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:24:05 wikitech-static check_icinga[30927]: 2021-11-07 17:24:05,798 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:26:01 wikitech-static CRON[30999]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:26:01 wikitech-static CRON[31000]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:26:02 wikitech-static check_icinga[31001]: 2021-11-07 17:26:02,946 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:26:02 wikitech-static check_icinga[31002]: 2021-11-07 17:26:02,970 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:26:06 wikitech-static check_icinga[31002]: 2021-11-07 17:26:06,096 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:26:06 wikitech-static check_icinga[31001]: 2021-11-07 17:26:06,151 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:28:01 wikitech-static CRON[31074]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:28:01 wikitech-static CRON[31075]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:28:02 wikitech-static check_icinga[31077]: 2021-11-07 17:28:02,371 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:28:02 wikitech-static check_icinga[31076]: 2021-11-07 17:28:02,379 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:28:05 wikitech-static check_icinga[31076]: 2021-11-07 17:28:05,486 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:28:05 wikitech-static check_icinga[31077]: 2021-11-07 17:28:05,671 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:30:01 wikitech-static CRON[31153]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:30:01 wikitech-static CRON[31154]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:30:02 wikitech-static check_icinga[31155]: 2021-11-07 17:30:02,839 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:30:02 wikitech-static check_icinga[31156]: 2021-11-07 17:30:02,842 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:30:06 wikitech-static check_icinga[31156]: 2021-11-07 17:30:06,164 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:30:06 wikitech-static check_icinga[31155]: 2021-11-07 17:30:06,239 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:32:01 wikitech-static CRON[31236]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:32:01 wikitech-static CRON[31237]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:32:02 wikitech-static check_icinga[31238]: 2021-11-07 17:32:02,389 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:32:02 wikitech-static check_icinga[31239]: 2021-11-07 17:32:02,392 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:32:05 wikitech-static check_icinga[31239]: 2021-11-07 17:32:05,401 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:32:05 wikitech-static check_icinga[31238]: 2021-11-07 17:32:05,542 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:33:48 wikitech-static systemd[1]: Starting Certbot...
Nov 7 17:33:50 wikitech-static systemd[1]: Started Certbot.
Nov 7 17:33:50 wikitech-static systemd[1]: certbot.timer: Adding 5h 46min 4.960389s random time.
Nov 7 17:33:50 wikitech-static systemd[1]: certbot.timer: Adding 1h 24min 57.362530s random time.
Nov 7 17:34:01 wikitech-static CRON[31321]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:34:01 wikitech-static CRON[31322]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:34:02 wikitech-static check_icinga[31323]: 2021-11-07 17:34:02,649 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:34:02 wikitech-static check_icinga[31324]: 2021-11-07 17:34:02,708 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:34:04 wikitech-static check_icinga[31323]: 2021-11-07 17:34:04,051 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Service Checks Being Executed? MISSING_KEY (expected YES)']
Nov 7 17:34:05 wikitech-static check_icinga[31324]: 2021-11-07 17:34:05,918 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:34:14 wikitech-static check_icinga[31323]: 2021-11-07 17:34:14,057 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:34:16 wikitech-static check_icinga[31323]: 2021-11-07 17:34:16,830 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:36:01 wikitech-static CRON[31409]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:36:01 wikitech-static CRON[31410]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:36:03 wikitech-static check_icinga[31411]: 2021-11-07 17:36:03,026 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:36:03 wikitech-static check_icinga[31412]: 2021-11-07 17:36:03,029 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:36:05 wikitech-static check_icinga[31411]: 2021-11-07 17:36:05,838 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:36:06 wikitech-static check_icinga[31412]: 2021-11-07 17:36:06,258 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:38:01 wikitech-static CRON[31490]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:38:01 wikitech-static CRON[31491]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:38:02 wikitech-static check_icinga[31493]: 2021-11-07 17:38:02,414 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:38:02 wikitech-static check_icinga[31492]: 2021-11-07 17:38:02,439 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:38:05 wikitech-static check_icinga[31492]: 2021-11-07 17:38:05,232 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:38:05 wikitech-static check_icinga[31493]: 2021-11-07 17:38:05,798 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:39:01 wikitech-static CRON[31540]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 17:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 17:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 17:40:01 wikitech-static CRON[31689]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:40:01 wikitech-static CRON[31690]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:40:02 wikitech-static check_icinga[31692]: 2021-11-07 17:40:02,929 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:40:02 wikitech-static check_icinga[31691]: 2021-11-07 17:40:02,955 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:40:05 wikitech-static check_icinga[31691]: 2021-11-07 17:40:05,729 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:40:06 wikitech-static check_icinga[31692]: 2021-11-07 17:40:06,145 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:42:01 wikitech-static CRON[31767]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:42:01 wikitech-static CRON[31768]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:42:02 wikitech-static check_icinga[31769]: 2021-11-07 17:42:02,314 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:42:02 wikitech-static check_icinga[31770]: 2021-11-07 17:42:02,319 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:42:05 wikitech-static check_icinga[31770]: 2021-11-07 17:42:05,093 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:42:05 wikitech-static check_icinga[31769]: 2021-11-07 17:42:05,733 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:44:01 wikitech-static CRON[31846]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:44:01 wikitech-static CRON[31847]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:44:02 wikitech-static check_icinga[31849]: 2021-11-07 17:44:02,943 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:44:02 wikitech-static check_icinga[31848]: 2021-11-07 17:44:02,974 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:44:05 wikitech-static check_icinga[31849]: 2021-11-07 17:44:05,832 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:44:06 wikitech-static check_icinga[31848]: 2021-11-07 17:44:06,080 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:46:01 wikitech-static CRON[31923]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:46:01 wikitech-static CRON[31924]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:46:02 wikitech-static check_icinga[31926]: 2021-11-07 17:46:02,274 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:46:02 wikitech-static check_icinga[31925]: 2021-11-07 17:46:02,344 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:46:05 wikitech-static check_icinga[31925]: 2021-11-07 17:46:05,417 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:46:05 wikitech-static check_icinga[31926]: 2021-11-07 17:46:05,578 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:48:01 wikitech-static CRON[31998]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:48:01 wikitech-static CRON[31999]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:48:02 wikitech-static check_icinga[32000]: 2021-11-07 17:48:02,776 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:48:02 wikitech-static check_icinga[32001]: 2021-11-07 17:48:02,804 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:48:05 wikitech-static check_icinga[32000]: 2021-11-07 17:48:05,770 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:48:06 wikitech-static check_icinga[32001]: 2021-11-07 17:48:06,073 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:50:01 wikitech-static CRON[32073]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:50:01 wikitech-static CRON[32074]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:50:02 wikitech-static check_icinga[32076]: 2021-11-07 17:50:02,282 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:50:02 wikitech-static check_icinga[32075]: 2021-11-07 17:50:02,303 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:50:05 wikitech-static check_icinga[32076]: 2021-11-07 17:50:05,373 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:50:05 wikitech-static check_icinga[32075]: 2021-11-07 17:50:05,640 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:52:01 wikitech-static CRON[32148]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:52:01 wikitech-static CRON[32149]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:52:02 wikitech-static check_icinga[32151]: 2021-11-07 17:52:02,765 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:52:02 wikitech-static check_icinga[32150]: 2021-11-07 17:52:02,789 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:52:05 wikitech-static check_icinga[32150]: 2021-11-07 17:52:05,779 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:52:05 wikitech-static check_icinga[32151]: 2021-11-07 17:52:05,923 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:54:01 wikitech-static CRON[32228]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:54:01 wikitech-static CRON[32229]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:54:02 wikitech-static check_icinga[32230]: 2021-11-07 17:54:02,115 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:54:02 wikitech-static check_icinga[32231]: 2021-11-07 17:54:02,121 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:54:05 wikitech-static check_icinga[32230]: 2021-11-07 17:54:05,156 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:54:05 wikitech-static check_icinga[32231]: 2021-11-07 17:54:05,260 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:56:01 wikitech-static CRON[32315]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:56:01 wikitech-static CRON[32316]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:56:02 wikitech-static check_icinga[32318]: 2021-11-07 17:56:02,402 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:56:02 wikitech-static check_icinga[32317]: 2021-11-07 17:56:02,478 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:56:05 wikitech-static check_icinga[32317]: 2021-11-07 17:56:05,532 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:56:05 wikitech-static check_icinga[32318]: 2021-11-07 17:56:05,666 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 17:58:01 wikitech-static CRON[32417]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 17:58:01 wikitech-static CRON[32418]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 17:58:02 wikitech-static check_icinga[32419]: 2021-11-07 17:58:02,841 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 17:58:02 wikitech-static check_icinga[32420]: 2021-11-07 17:58:02,844 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 17:58:05 wikitech-static check_icinga[32419]: 2021-11-07 17:58:05,848 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 17:58:05 wikitech-static check_icinga[32420]: 2021-11-07 17:58:05,957 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:00:01 wikitech-static CRON[32494]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:00:01 wikitech-static CRON[32495]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:00:02 wikitech-static check_icinga[32497]: 2021-11-07 18:00:02,213 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:00:02 wikitech-static check_icinga[32496]: 2021-11-07 18:00:02,234 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:00:05 wikitech-static check_icinga[32497]: 2021-11-07 18:00:05,290 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:00:05 wikitech-static check_icinga[32496]: 2021-11-07 18:00:05,342 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:02:01 wikitech-static CRON[32597]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:02:01 wikitech-static CRON[32598]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:02:02 wikitech-static check_icinga[32599]: 2021-11-07 18:02:02,583 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:02:02 wikitech-static check_icinga[32600]: 2021-11-07 18:02:02,609 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:02:05 wikitech-static check_icinga[32599]: 2021-11-07 18:02:05,592 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:02:05 wikitech-static check_icinga[32600]: 2021-11-07 18:02:05,755 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:04:01 wikitech-static CRON[32677]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:04:01 wikitech-static CRON[32678]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:04:02 wikitech-static check_icinga[32680]: 2021-11-07 18:04:02,985 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:04:02 wikitech-static check_icinga[32679]: 2021-11-07 18:04:02,983 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:04:05 wikitech-static check_icinga[32679]: 2021-11-07 18:04:05,941 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:04:06 wikitech-static check_icinga[32680]: 2021-11-07 18:04:06,186 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:06:01 wikitech-static CRON[32759]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:06:01 wikitech-static CRON[32760]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:06:02 wikitech-static check_icinga[32762]: 2021-11-07 18:06:02,320 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:06:02 wikitech-static check_icinga[32761]: 2021-11-07 18:06:02,327 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:06:05 wikitech-static check_icinga[32762]: 2021-11-07 18:06:05,581 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:06:05 wikitech-static check_icinga[32761]: 2021-11-07 18:06:05,597 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:08:01 wikitech-static CRON[371]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:08:01 wikitech-static CRON[372]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:08:01 wikitech-static systemd[1]: Starting Daily apt download activities...
Nov 7 18:08:03 wikitech-static check_icinga[373]: 2021-11-07 18:08:03,163 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:08:03 wikitech-static check_icinga[374]: 2021-11-07 18:08:03,165 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:08:03 wikitech-static systemd[1]: Started Daily apt download activities.
Nov 7 18:08:03 wikitech-static systemd[1]: apt-daily.timer: Adding 6h 40min 9.976147s random time.
Nov 7 18:08:03 wikitech-static systemd[1]: apt-daily.timer: Adding 1h 54min 27.588303s random time.
Nov 7 18:08:06 wikitech-static check_icinga[373]: 2021-11-07 18:08:06,287 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:08:06 wikitech-static check_icinga[374]: 2021-11-07 18:08:06,345 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:09:01 wikitech-static CRON[465]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 18:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 18:09:06 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 18:10:01 wikitech-static CRON[589]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:10:01 wikitech-static CRON[590]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:10:02 wikitech-static check_icinga[591]: 2021-11-07 18:10:02,930 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:10:02 wikitech-static check_icinga[592]: 2021-11-07 18:10:02,933 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:10:06 wikitech-static check_icinga[592]: 2021-11-07 18:10:06,119 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:10:06 wikitech-static check_icinga[591]: 2021-11-07 18:10:06,237 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:11:01 wikitech-static CRON[646]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh)
Nov 7 18:11:02 wikitech-static check_icinga_validate_config[647]: Valid config, nothing to do.
Nov 7 18:12:01 wikitech-static CRON[730]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:12:01 wikitech-static CRON[732]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:12:02 wikitech-static check_icinga[731]: 2021-11-07 18:12:02,081 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:12:02 wikitech-static check_icinga[733]: 2021-11-07 18:12:02,141 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:12:05 wikitech-static check_icinga[733]: 2021-11-07 18:12:05,268 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:12:05 wikitech-static check_icinga[731]: 2021-11-07 18:12:05,341 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:14:01 wikitech-static CRON[819]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:14:01 wikitech-static CRON[821]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:14:02 wikitech-static check_icinga[820]: 2021-11-07 18:14:02,509 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:14:02 wikitech-static check_icinga[822]: 2021-11-07 18:14:02,552 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:14:05 wikitech-static check_icinga[820]: 2021-11-07 18:14:05,510 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:14:05 wikitech-static check_icinga[822]: 2021-11-07 18:14:05,714 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:16:01 wikitech-static CRON[897]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:16:01 wikitech-static CRON[898]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:16:02 wikitech-static check_icinga[900]: 2021-11-07 18:16:02,873 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:16:02 wikitech-static check_icinga[899]: 2021-11-07 18:16:02,875 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:16:06 wikitech-static check_icinga[899]: 2021-11-07 18:16:06,084 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:16:06 wikitech-static check_icinga[900]: 2021-11-07 18:16:06,166 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:17:01 wikitech-static CRON[946]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 18:18:01 wikitech-static CRON[1009]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:18:01 wikitech-static CRON[1010]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:18:02 wikitech-static check_icinga[1011]: 2021-11-07 18:18:02,351 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:18:02 wikitech-static check_icinga[1012]: 2021-11-07 18:18:02,356 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:18:05 wikitech-static check_icinga[1011]: 2021-11-07 18:18:05,434 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:18:05 wikitech-static check_icinga[1012]: 2021-11-07 18:18:05,732 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:20:01 wikitech-static CRON[1104]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:20:01 wikitech-static CRON[1105]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:20:02 wikitech-static check_icinga[1107]: 2021-11-07 18:20:02,887 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:20:02 wikitech-static check_icinga[1106]: 2021-11-07 18:20:02,888 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:20:05 wikitech-static check_icinga[1106]: 2021-11-07 18:20:05,866 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:20:06 wikitech-static check_icinga[1107]: 2021-11-07 18:20:06,135 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:22:01 wikitech-static CRON[1199]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:22:01 wikitech-static CRON[1200]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:22:02 wikitech-static check_icinga[1202]: 2021-11-07 18:22:02,286 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:22:02 wikitech-static check_icinga[1201]: 2021-11-07 18:22:02,353 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:22:05 wikitech-static check_icinga[1201]: 2021-11-07 18:22:05,361 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:22:05 wikitech-static check_icinga[1202]: 2021-11-07 18:22:05,599 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:24:01 wikitech-static CRON[1304]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:24:01 wikitech-static CRON[1305]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:24:02 wikitech-static check_icinga[1306]: 2021-11-07 18:24:02,873 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:24:02 wikitech-static check_icinga[1307]: 2021-11-07 18:24:02,967 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:24:05 wikitech-static check_icinga[1306]: 2021-11-07 18:24:05,915 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:24:06 wikitech-static check_icinga[1307]: 2021-11-07 18:24:06,304 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:26:01 wikitech-static CRON[1383]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:26:01 wikitech-static CRON[1384]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:26:02 wikitech-static check_icinga[1385]: 2021-11-07 18:26:02,620 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:26:02 wikitech-static check_icinga[1386]: 2021-11-07 18:26:02,646 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:26:05 wikitech-static check_icinga[1385]: 2021-11-07 18:26:05,787 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:26:05 wikitech-static check_icinga[1386]: 2021-11-07 18:26:05,912 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:28:01 wikitech-static CRON[1473]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:28:01 wikitech-static CRON[1474]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:28:03 wikitech-static check_icinga[1475]: 2021-11-07 18:28:03,125 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:28:03 wikitech-static check_icinga[1476]: 2021-11-07 18:28:03,129 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:28:06 wikitech-static check_icinga[1476]: 2021-11-07 18:28:06,203 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:28:06 wikitech-static check_icinga[1475]: 2021-11-07 18:28:06,210 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:30:01 wikitech-static CRON[1625]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:30:01 wikitech-static CRON[1626]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:30:02 wikitech-static check_icinga[1628]: 2021-11-07 18:30:02,504 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:30:02 wikitech-static check_icinga[1627]: 2021-11-07 18:30:02,529 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:30:05 wikitech-static check_icinga[1628]: 2021-11-07 18:30:05,541 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:30:05 wikitech-static check_icinga[1627]: 2021-11-07 18:30:05,684 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:32:01 wikitech-static CRON[1704]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:32:01 wikitech-static CRON[1705]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:32:02 wikitech-static check_icinga[1707]: 2021-11-07 18:32:02,843 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:32:02 wikitech-static check_icinga[1706]: 2021-11-07 18:32:02,849 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:32:05 wikitech-static check_icinga[1707]: 2021-11-07 18:32:05,726 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:32:05 wikitech-static check_icinga[1706]: 2021-11-07 18:32:05,965 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:34:01 wikitech-static CRON[1786]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:34:01 wikitech-static CRON[1787]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:34:02 wikitech-static check_icinga[1789]: 2021-11-07 18:34:02,116 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:34:02 wikitech-static check_icinga[1788]: 2021-11-07 18:34:02,185 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:34:03 wikitech-static check_icinga[1788]: 2021-11-07 18:34:03,572 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ["Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Service Checks Being Executed? MISSING_KEY (expected YES)']
Nov 7 18:34:05 wikitech-static check_icinga[1789]: 2021-11-07 18:34:05,397 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:34:13 wikitech-static check_icinga[1788]: 2021-11-07 18:34:13,610 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:34:16 wikitech-static check_icinga[1788]: 2021-11-07 18:34:16,447 [ERROR] Check for host alert2001.wikimedia.org (2/3) failed: ["Last External Command Check: N/A (expected failed to calculate expected value: time data 'N/A' does not match format '%Y-%m-%d %H:%M:%S')"]
Nov 7 18:34:26 wikitech-static check_icinga[1788]: 2021-11-07 18:34:26,460 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:34:29 wikitech-static check_icinga[1788]: 2021-11-07 18:34:29,185 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:36:01 wikitech-static CRON[1864]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:36:01 wikitech-static CRON[1865]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:36:02 wikitech-static check_icinga[1866]: 2021-11-07 18:36:02,337 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:36:02 wikitech-static check_icinga[1867]: 2021-11-07 18:36:02,335 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:36:04 wikitech-static check_icinga[1867]: 2021-11-07 18:36:04,994 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:36:05 wikitech-static check_icinga[1866]: 2021-11-07 18:36:05,378 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:38:01 wikitech-static CRON[1943]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:38:01 wikitech-static CRON[1944]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:38:02 wikitech-static check_icinga[1946]: 2021-11-07 18:38:02,517 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:38:02 wikitech-static check_icinga[1945]: 2021-11-07 18:38:02,549 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:38:05 wikitech-static check_icinga[1945]: 2021-11-07 18:38:05,330 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:38:05 wikitech-static check_icinga[1946]: 2021-11-07 18:38:05,597 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:39:01 wikitech-static CRON[1990]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 18:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 18:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 18:40:01 wikitech-static CRON[2112]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:40:01 wikitech-static CRON[2113]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:40:02 wikitech-static check_icinga[2114]: 2021-11-07 18:40:02,771 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:40:02 wikitech-static check_icinga[2115]: 2021-11-07 18:40:02,792 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:40:05 wikitech-static check_icinga[2114]: 2021-11-07 18:40:05,695 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:40:05 wikitech-static check_icinga[2115]: 2021-11-07 18:40:05,972 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:42:01 wikitech-static CRON[2187]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:42:01 wikitech-static CRON[2189]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:42:02 wikitech-static check_icinga[2188]: 2021-11-07 18:42:02,229 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:42:02 wikitech-static check_icinga[2190]: 2021-11-07 18:42:02,233 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:42:05 wikitech-static check_icinga[2188]: 2021-11-07 18:42:05,068 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:42:05 wikitech-static check_icinga[2190]: 2021-11-07 18:42:05,492 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:44:01 wikitech-static CRON[2263]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:44:01 wikitech-static CRON[2264]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:44:02 wikitech-static check_icinga[2266]: 2021-11-07 18:44:02,667 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:44:02 wikitech-static check_icinga[2265]: 2021-11-07 18:44:02,696 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:44:05 wikitech-static check_icinga[2265]: 2021-11-07 18:44:05,551 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:44:05 wikitech-static check_icinga[2266]: 2021-11-07 18:44:05,929 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:46:02 wikitech-static CRON[2338]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:46:02 wikitech-static CRON[2339]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:46:03 wikitech-static check_icinga[2341]: 2021-11-07 18:46:03,036 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:46:03 wikitech-static check_icinga[2340]: 2021-11-07 18:46:03,061 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:46:06 wikitech-static check_icinga[2340]: 2021-11-07 18:46:06,026 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:46:06 wikitech-static check_icinga[2341]: 2021-11-07 18:46:06,152 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:48:01 wikitech-static CRON[2416]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:48:01 wikitech-static CRON[2417]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:48:02 wikitech-static check_icinga[2419]: 2021-11-07 18:48:02,285 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:48:02 wikitech-static check_icinga[2418]: 2021-11-07 18:48:02,292 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:48:05 wikitech-static check_icinga[2418]: 2021-11-07 18:48:05,408 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:48:05 wikitech-static check_icinga[2419]: 2021-11-07 18:48:05,573 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:50:01 wikitech-static CRON[2501]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:50:01 wikitech-static CRON[2502]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:50:02 wikitech-static check_icinga[2504]: 2021-11-07 18:50:02,728 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:50:02 wikitech-static check_icinga[2503]: 2021-11-07 18:50:02,730 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:50:05 wikitech-static check_icinga[2504]: 2021-11-07 18:50:05,874 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:50:05 wikitech-static check_icinga[2503]: 2021-11-07 18:50:05,961 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:52:01 wikitech-static CRON[2576]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:52:01 wikitech-static CRON[2577]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:52:02 wikitech-static check_icinga[2579]: 2021-11-07 18:52:02,179 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:52:02 wikitech-static check_icinga[2578]: 2021-11-07 18:52:02,202 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:52:05 wikitech-static check_icinga[2578]: 2021-11-07 18:52:05,341 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:52:05 wikitech-static check_icinga[2579]: 2021-11-07 18:52:05,571 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:54:01 wikitech-static CRON[2657]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:54:01 wikitech-static CRON[2658]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:54:02 wikitech-static check_icinga[2660]: 2021-11-07 18:54:02,769 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:54:02 wikitech-static check_icinga[2659]: 2021-11-07 18:54:02,790 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:54:05 wikitech-static check_icinga[2660]: 2021-11-07 18:54:05,863 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:54:06 wikitech-static check_icinga[2659]: 2021-11-07 18:54:06,044 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:56:01 wikitech-static CRON[2792]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:56:01 wikitech-static CRON[2793]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:56:02 wikitech-static check_icinga[2794]: 2021-11-07 18:56:02,294 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:56:02 wikitech-static check_icinga[2795]: 2021-11-07 18:56:02,298 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:56:05 wikitech-static check_icinga[2794]: 2021-11-07 18:56:05,484 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:56:05 wikitech-static check_icinga[2795]: 2021-11-07 18:56:05,676 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 18:58:01 wikitech-static CRON[2891]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 18:58:01 wikitech-static CRON[2892]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 18:58:02 wikitech-static check_icinga[2894]: 2021-11-07 18:58:02,853 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 18:58:02 wikitech-static check_icinga[2893]: 2021-11-07 18:58:02,858 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 18:58:05 wikitech-static check_icinga[2893]: 2021-11-07 18:58:05,897 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 18:58:06 wikitech-static check_icinga[2894]: 2021-11-07 18:58:06,218 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:00:01 wikitech-static CRON[2967]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:00:01 wikitech-static CRON[2968]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:00:02 wikitech-static check_icinga[2970]: 2021-11-07 19:00:02,333 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:00:02 wikitech-static check_icinga[2969]: 2021-11-07 19:00:02,361 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:00:05 wikitech-static check_icinga[2969]: 2021-11-07 19:00:05,448 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:00:05 wikitech-static check_icinga[2970]: 2021-11-07 19:00:05,876 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:02:01 wikitech-static CRON[3042]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:02:01 wikitech-static CRON[3043]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:02:03 wikitech-static check_icinga[3045]: 2021-11-07 19:02:03,011 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:02:03 wikitech-static check_icinga[3044]: 2021-11-07 19:02:03,080 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:02:06 wikitech-static check_icinga[3044]: 2021-11-07 19:02:06,107 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:02:06 wikitech-static check_icinga[3045]: 2021-11-07 19:02:06,192 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:04:01 wikitech-static CRON[3117]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:04:01 wikitech-static CRON[3118]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:04:02 wikitech-static check_icinga[3119]: 2021-11-07 19:04:02,340 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:04:02 wikitech-static check_icinga[3120]: 2021-11-07 19:04:02,345 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:04:05 wikitech-static check_icinga[3120]: 2021-11-07 19:04:05,356 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:04:05 wikitech-static check_icinga[3119]: 2021-11-07 19:04:05,585 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:06:01 wikitech-static CRON[3192]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:06:01 wikitech-static CRON[3193]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:06:02 wikitech-static check_icinga[3194]: 2021-11-07 19:06:02,731 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:06:02 wikitech-static check_icinga[3195]: 2021-11-07 19:06:02,747 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:06:05 wikitech-static check_icinga[3195]: 2021-11-07 19:06:05,767 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:06:05 wikitech-static check_icinga[3194]: 2021-11-07 19:06:05,950 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:08:01 wikitech-static CRON[3267]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:08:01 wikitech-static CRON[3268]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:08:02 wikitech-static check_icinga[3269]: 2021-11-07 19:08:02,077 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:08:02 wikitech-static check_icinga[3270]: 2021-11-07 19:08:02,103 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:08:05 wikitech-static check_icinga[3270]: 2021-11-07 19:08:05,244 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:08:05 wikitech-static check_icinga[3269]: 2021-11-07 19:08:05,315 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:09:01 wikitech-static CRON[3340]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 19:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 19:09:07 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 19:10:01 wikitech-static CRON[3462]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:10:01 wikitech-static CRON[3463]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:10:02 wikitech-static check_icinga[3465]: 2021-11-07 19:10:02,747 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:10:02 wikitech-static check_icinga[3464]: 2021-11-07 19:10:02,750 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:10:06 wikitech-static check_icinga[3464]: 2021-11-07 19:10:06,043 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:10:06 wikitech-static check_icinga[3465]: 2021-11-07 19:10:06,136 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:12:01 wikitech-static CRON[3539]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:12:01 wikitech-static CRON[3540]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:12:02 wikitech-static check_icinga[3542]: 2021-11-07 19:12:02,394 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:12:02 wikitech-static check_icinga[3541]: 2021-11-07 19:12:02,433 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:12:05 wikitech-static check_icinga[3541]: 2021-11-07 19:12:05,588 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:12:05 wikitech-static check_icinga[3542]: 2021-11-07 19:12:05,733 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:14:01 wikitech-static CRON[3614]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:14:01 wikitech-static CRON[3615]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:14:02 wikitech-static check_icinga[3617]: 2021-11-07 19:14:02,856 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:14:02 wikitech-static check_icinga[3616]: 2021-11-07 19:14:02,863 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:14:05 wikitech-static check_icinga[3617]: 2021-11-07 19:14:05,962 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:14:05 wikitech-static check_icinga[3616]: 2021-11-07 19:14:05,992 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:16:01 wikitech-static CRON[3710]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:16:01 wikitech-static CRON[3711]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:16:02 wikitech-static check_icinga[3712]: 2021-11-07 19:16:02,206 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:16:02 wikitech-static check_icinga[3713]: 2021-11-07 19:16:02,231 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:16:05 wikitech-static check_icinga[3712]: 2021-11-07 19:16:05,258 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:16:05 wikitech-static check_icinga[3713]: 2021-11-07 19:16:05,530 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:17:01 wikitech-static CRON[3757]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 19:18:01 wikitech-static CRON[3788]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:18:01 wikitech-static CRON[3789]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:18:02 wikitech-static check_icinga[3790]: 2021-11-07 19:18:02,762 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:18:02 wikitech-static check_icinga[3791]: 2021-11-07 19:18:02,769 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:18:05 wikitech-static check_icinga[3790]: 2021-11-07 19:18:05,867 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:18:05 wikitech-static check_icinga[3791]: 2021-11-07 19:18:05,948 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:20:01 wikitech-static CRON[3863]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:20:01 wikitech-static CRON[3864]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:20:02 wikitech-static check_icinga[3866]: 2021-11-07 19:20:02,087 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:20:02 wikitech-static check_icinga[3865]: 2021-11-07 19:20:02,090 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:20:05 wikitech-static check_icinga[3866]: 2021-11-07 19:20:05,221 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:20:05 wikitech-static check_icinga[3865]: 2021-11-07 19:20:05,311 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:22:01 wikitech-static CRON[3988]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:22:01 wikitech-static CRON[3989]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:22:02 wikitech-static check_icinga[3990]: 2021-11-07 19:22:02,510 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:22:02 wikitech-static check_icinga[3991]: 2021-11-07 19:22:02,522 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:22:05 wikitech-static check_icinga[3990]: 2021-11-07 19:22:05,752 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:22:05 wikitech-static check_icinga[3991]: 2021-11-07 19:22:05,790 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:24:01 wikitech-static CRON[4066]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:24:01 wikitech-static CRON[4067]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:24:02 wikitech-static check_icinga[4068]: 2021-11-07 19:24:02,961 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:24:02 wikitech-static check_icinga[4069]: 2021-11-07 19:24:02,964 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:24:06 wikitech-static check_icinga[4069]: 2021-11-07 19:24:06,233 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:24:06 wikitech-static check_icinga[4068]: 2021-11-07 19:24:06,240 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:26:01 wikitech-static CRON[4147]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:26:01 wikitech-static CRON[4148]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:26:02 wikitech-static check_icinga[4150]: 2021-11-07 19:26:02,509 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:26:02 wikitech-static check_icinga[4149]: 2021-11-07 19:26:02,578 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:26:05 wikitech-static check_icinga[4149]: 2021-11-07 19:26:05,745 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:26:05 wikitech-static check_icinga[4150]: 2021-11-07 19:26:05,830 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:28:01 wikitech-static CRON[4222]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:28:01 wikitech-static CRON[4223]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:28:03 wikitech-static check_icinga[4224]: 2021-11-07 19:28:03,023 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:28:03 wikitech-static check_icinga[4225]: 2021-11-07 19:28:03,027 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:28:06 wikitech-static check_icinga[4224]: 2021-11-07 19:28:06,226 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:28:06 wikitech-static check_icinga[4225]: 2021-11-07 19:28:06,318 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:30:01 wikitech-static CRON[4299]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:30:01 wikitech-static CRON[4300]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:30:02 wikitech-static check_icinga[4302]: 2021-11-07 19:30:02,471 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:30:02 wikitech-static check_icinga[4301]: 2021-11-07 19:30:02,477 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:30:05 wikitech-static check_icinga[4301]: 2021-11-07 19:30:05,575 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:30:05 wikitech-static check_icinga[4302]: 2021-11-07 19:30:05,579 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:32:01 wikitech-static CRON[4384]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:32:01 wikitech-static CRON[4385]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:32:02 wikitech-static check_icinga[4387]: 2021-11-07 19:32:02,780 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:32:02 wikitech-static check_icinga[4388]: 2021-11-07 19:32:02,830 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:32:06 wikitech-static check_icinga[4387]: 2021-11-07 19:32:06,001 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:32:06 wikitech-static check_icinga[4388]: 2021-11-07 19:32:06,010 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:34:01 wikitech-static CRON[4466]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:34:01 wikitech-static CRON[4467]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:34:02 wikitech-static check_icinga[4468]: 2021-11-07 19:34:02,254 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:34:02 wikitech-static check_icinga[4469]: 2021-11-07 19:34:02,257 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:34:03 wikitech-static check_icinga[4469]: 2021-11-07 19:34:03,626 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Service Checks Being Executed? MISSING_KEY (expected YES)']
Nov 7 19:34:05 wikitech-static check_icinga[4468]: 2021-11-07 19:34:05,516 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:34:13 wikitech-static check_icinga[4469]: 2021-11-07 19:34:13,640 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:34:16 wikitech-static check_icinga[4469]: 2021-11-07 19:34:16,329 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:36:01 wikitech-static CRON[4545]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:36:01 wikitech-static CRON[4546]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:36:02 wikitech-static check_icinga[4548]: 2021-11-07 19:36:02,509 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:36:02 wikitech-static check_icinga[4547]: 2021-11-07 19:36:02,514 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:36:05 wikitech-static check_icinga[4547]: 2021-11-07 19:36:05,317 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:36:05 wikitech-static check_icinga[4548]: 2021-11-07 19:36:05,767 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:38:01 wikitech-static CRON[4630]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:38:01 wikitech-static CRON[4631]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:38:02 wikitech-static check_icinga[4632]: 2021-11-07 19:38:02,916 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:38:02 wikitech-static check_icinga[4633]: 2021-11-07 19:38:02,918 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:38:05 wikitech-static check_icinga[4632]: 2021-11-07 19:38:05,667 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:38:06 wikitech-static check_icinga[4633]: 2021-11-07 19:38:06,207 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:39:01 wikitech-static CRON[4677]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 19:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 19:39:06 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 19:40:01 wikitech-static CRON[4800]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:40:01 wikitech-static CRON[4801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:40:02 wikitech-static check_icinga[4803]: 2021-11-07 19:40:02,772 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:40:02 wikitech-static check_icinga[4802]: 2021-11-07 19:40:02,777 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:40:05 wikitech-static check_icinga[4802]: 2021-11-07 19:40:05,662 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:40:05 wikitech-static check_icinga[4803]: 2021-11-07 19:40:05,980 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:42:01 wikitech-static CRON[4875]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:42:01 wikitech-static CRON[4876]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:42:02 wikitech-static check_icinga[4878]: 2021-11-07 19:42:02,139 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:42:02 wikitech-static check_icinga[4877]: 2021-11-07 19:42:02,210 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:42:04 wikitech-static check_icinga[4877]: 2021-11-07 19:42:04,970 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:42:05 wikitech-static check_icinga[4878]: 2021-11-07 19:42:05,393 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:44:01 wikitech-static CRON[4977]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:44:01 wikitech-static CRON[4978]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:44:02 wikitech-static check_icinga[4979]: 2021-11-07 19:44:02,601 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:44:02 wikitech-static check_icinga[4980]: 2021-11-07 19:44:02,604 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:44:05 wikitech-static check_icinga[4980]: 2021-11-07 19:44:05,439 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:44:05 wikitech-static check_icinga[4979]: 2021-11-07 19:44:05,836 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:46:01 wikitech-static CRON[5056]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:46:01 wikitech-static CRON[5057]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:46:03 wikitech-static check_icinga[5059]: 2021-11-07 19:46:03,071 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:46:03 wikitech-static check_icinga[5058]: 2021-11-07 19:46:03,074 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:46:06 wikitech-static check_icinga[5059]: 2021-11-07 19:46:06,153 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:46:06 wikitech-static check_icinga[5058]: 2021-11-07 19:46:06,162 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:48:01 wikitech-static CRON[5248]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:48:01 wikitech-static CRON[5249]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:48:02 wikitech-static check_icinga[5250]: 2021-11-07 19:48:02,408 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:48:02 wikitech-static check_icinga[5251]: 2021-11-07 19:48:02,435 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:48:05 wikitech-static check_icinga[5250]: 2021-11-07 19:48:05,470 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:48:05 wikitech-static check_icinga[5251]: 2021-11-07 19:48:05,567 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:50:01 wikitech-static CRON[5341]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:50:01 wikitech-static CRON[5342]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:50:02 wikitech-static check_icinga[5343]: 2021-11-07 19:50:02,714 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:50:02 wikitech-static check_icinga[5344]: 2021-11-07 19:50:02,724 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:50:05 wikitech-static check_icinga[5343]: 2021-11-07 19:50:05,706 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:50:05 wikitech-static check_icinga[5344]: 2021-11-07 19:50:05,939 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:52:01 wikitech-static CRON[5416]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:52:01 wikitech-static CRON[5417]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:52:02 wikitech-static check_icinga[5418]: 2021-11-07 19:52:02,117 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:52:02 wikitech-static check_icinga[5419]: 2021-11-07 19:52:02,121 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:52:05 wikitech-static check_icinga[5418]: 2021-11-07 19:52:05,119 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:52:05 wikitech-static check_icinga[5419]: 2021-11-07 19:52:05,367 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:54:01 wikitech-static CRON[5494]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:54:01 wikitech-static CRON[5495]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:54:02 wikitech-static check_icinga[5496]: 2021-11-07 19:54:02,498 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:54:02 wikitech-static check_icinga[5497]: 2021-11-07 19:54:02,502 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:54:05 wikitech-static check_icinga[5496]: 2021-11-07 19:54:05,583 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:54:05 wikitech-static check_icinga[5497]: 2021-11-07 19:54:05,646 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:56:01 wikitech-static CRON[5573]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:56:01 wikitech-static CRON[5574]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:56:02 wikitech-static check_icinga[5576]: 2021-11-07 19:56:02,808 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:56:02 wikitech-static check_icinga[5575]: 2021-11-07 19:56:02,813 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:56:05 wikitech-static check_icinga[5575]: 2021-11-07 19:56:05,886 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:56:05 wikitech-static check_icinga[5576]: 2021-11-07 19:56:05,982 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 19:58:01 wikitech-static CRON[5652]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 19:58:01 wikitech-static CRON[5653]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 19:58:02 wikitech-static check_icinga[5655]: 2021-11-07 19:58:02,138 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 19:58:02 wikitech-static check_icinga[5654]: 2021-11-07 19:58:02,156 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 19:58:05 wikitech-static check_icinga[5654]: 2021-11-07 19:58:05,200 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 19:58:05 wikitech-static check_icinga[5655]: 2021-11-07 19:58:05,373 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:00:01 wikitech-static CRON[5730]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:00:01 wikitech-static CRON[5731]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:00:02 wikitech-static check_icinga[5732]: 2021-11-07 20:00:02,509 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:00:02 wikitech-static check_icinga[5733]: 2021-11-07 20:00:02,513 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:00:05 wikitech-static check_icinga[5732]: 2021-11-07 20:00:05,611 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:00:05 wikitech-static check_icinga[5733]: 2021-11-07 20:00:05,687 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:02:01 wikitech-static CRON[5807]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:02:01 wikitech-static CRON[5808]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:02:03 wikitech-static check_icinga[5809]: 2021-11-07 20:02:03,146 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:02:03 wikitech-static check_icinga[5810]: 2021-11-07 20:02:03,232 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:02:06 wikitech-static check_icinga[5809]: 2021-11-07 20:02:06,129 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:02:06 wikitech-static check_icinga[5810]: 2021-11-07 20:02:06,213 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:04:01 wikitech-static CRON[5883]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:04:01 wikitech-static CRON[5884]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:04:02 wikitech-static check_icinga[5886]: 2021-11-07 20:04:02,494 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:04:02 wikitech-static check_icinga[5885]: 2021-11-07 20:04:02,556 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:04:05 wikitech-static check_icinga[5885]: 2021-11-07 20:04:05,614 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:04:05 wikitech-static check_icinga[5886]: 2021-11-07 20:04:05,746 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:06:01 wikitech-static CRON[5967]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:06:01 wikitech-static CRON[5968]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:06:02 wikitech-static check_icinga[5970]: 2021-11-07 20:06:02,994 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:06:03 wikitech-static check_icinga[5969]: 2021-11-07 20:06:03,001 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:06:05 wikitech-static check_icinga[5969]: 2021-11-07 20:06:05,993 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:06:06 wikitech-static check_icinga[5970]: 2021-11-07 20:06:06,047 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:08:01 wikitech-static CRON[6059]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:08:01 wikitech-static CRON[6060]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:08:02 wikitech-static check_icinga[6062]: 2021-11-07 20:08:02,215 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:08:02 wikitech-static check_icinga[6061]: 2021-11-07 20:08:02,246 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:08:05 wikitech-static check_icinga[6062]: 2021-11-07 20:08:05,206 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:08:05 wikitech-static check_icinga[6061]: 2021-11-07 20:08:05,437 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:09:01 wikitech-static CRON[6106]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 20:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 20:09:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 20:10:01 wikitech-static CRON[6228]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:10:01 wikitech-static CRON[6229]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:10:02 wikitech-static check_icinga[6231]: 2021-11-07 20:10:02,590 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:10:02 wikitech-static check_icinga[6230]: 2021-11-07 20:10:02,616 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:10:05 wikitech-static check_icinga[6230]: 2021-11-07 20:10:05,664 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:10:05 wikitech-static check_icinga[6231]: 2021-11-07 20:10:05,994 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:11:01 wikitech-static CRON[6275]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh)
Nov 7 20:11:01 wikitech-static check_icinga_validate_config[6276]: Valid config, nothing to do.
Nov 7 20:12:01 wikitech-static CRON[6308]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:12:01 wikitech-static CRON[6309]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:12:02 wikitech-static check_icinga[6310]: 2021-11-07 20:12:02,934 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:12:02 wikitech-static check_icinga[6311]: 2021-11-07 20:12:02,937 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:12:06 wikitech-static check_icinga[6311]: 2021-11-07 20:12:06,065 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:12:06 wikitech-static check_icinga[6310]: 2021-11-07 20:12:06,229 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:14:01 wikitech-static CRON[6386]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:14:01 wikitech-static CRON[6387]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:14:02 wikitech-static check_icinga[6388]: 2021-11-07 20:14:02,418 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:14:02 wikitech-static check_icinga[6389]: 2021-11-07 20:14:02,421 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:14:05 wikitech-static check_icinga[6388]: 2021-11-07 20:14:05,416 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:14:05 wikitech-static check_icinga[6389]: 2021-11-07 20:14:05,641 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:16:01 wikitech-static CRON[6463]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:16:01 wikitech-static CRON[6464]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:16:02 wikitech-static check_icinga[6466]: 2021-11-07 20:16:02,761 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:16:02 wikitech-static check_icinga[6465]: 2021-11-07 20:16:02,779 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:16:05 wikitech-static check_icinga[6465]: 2021-11-07 20:16:05,829 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:16:06 wikitech-static check_icinga[6466]: 2021-11-07 20:16:06,185 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:17:01 wikitech-static CRON[6515]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 20:18:01 wikitech-static CRON[6548]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:18:01 wikitech-static CRON[6549]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:18:02 wikitech-static check_icinga[6550]: 2021-11-07 20:18:02,339 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:18:02 wikitech-static check_icinga[6551]: 2021-11-07 20:18:02,346 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:18:05 wikitech-static check_icinga[6550]: 2021-11-07 20:18:05,291 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:18:05 wikitech-static check_icinga[6551]: 2021-11-07 20:18:05,424 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:19:05 wikitech-static systemd[1]: Started Session 1082582 of user root.
Nov 7 20:19:06 wikitech-static systemd[1]: Started Session 1082583 of user root.
Nov 7 20:20:01 wikitech-static CRON[6649]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:20:01 wikitech-static CRON[6650]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:20:02 wikitech-static check_icinga[6651]: 2021-11-07 20:20:02,625 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:20:02 wikitech-static check_icinga[6652]: 2021-11-07 20:20:02,631 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:20:05 wikitech-static check_icinga[6652]: 2021-11-07 20:20:05,686 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:20:06 wikitech-static check_icinga[6651]: 2021-11-07 20:20:06,180 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:22:01 wikitech-static CRON[6724]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:22:01 wikitech-static CRON[6725]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:22:02 wikitech-static check_icinga[6726]: 2021-11-07 20:22:02,322 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:22:02 wikitech-static check_icinga[6727]: 2021-11-07 20:22:02,347 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:22:05 wikitech-static check_icinga[6727]: 2021-11-07 20:22:05,460 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:22:05 wikitech-static check_icinga[6726]: 2021-11-07 20:22:05,539 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:24:01 wikitech-static CRON[6801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:24:01 wikitech-static CRON[6803]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:24:02 wikitech-static check_icinga[6802]: 2021-11-07 20:24:02,679 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:24:02 wikitech-static check_icinga[6804]: 2021-11-07 20:24:02,704 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:24:05 wikitech-static check_icinga[6802]: 2021-11-07 20:24:05,618 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:24:05 wikitech-static check_icinga[6804]: 2021-11-07 20:24:05,708 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:26:01 wikitech-static CRON[6887]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:26:01 wikitech-static CRON[6888]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:26:02 wikitech-static check_icinga[6890]: 2021-11-07 20:26:02,830 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:26:02 wikitech-static check_icinga[6889]: 2021-11-07 20:26:02,837 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:26:05 wikitech-static check_icinga[6889]: 2021-11-07 20:26:05,918 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:26:06 wikitech-static check_icinga[6890]: 2021-11-07 20:26:06,039 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:28:01 wikitech-static CRON[6963]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:28:01 wikitech-static CRON[6965]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:28:02 wikitech-static check_icinga[6964]: 2021-11-07 20:28:02,198 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:28:02 wikitech-static check_icinga[6966]: 2021-11-07 20:28:02,210 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:28:05 wikitech-static check_icinga[6964]: 2021-11-07 20:28:05,171 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:28:05 wikitech-static check_icinga[6966]: 2021-11-07 20:28:05,449 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:30:01 wikitech-static CRON[7044]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:30:01 wikitech-static CRON[7045]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:30:02 wikitech-static check_icinga[7047]: 2021-11-07 20:30:02,562 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:30:02 wikitech-static check_icinga[7046]: 2021-11-07 20:30:02,588 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:30:05 wikitech-static check_icinga[7047]: 2021-11-07 20:30:05,713 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:30:05 wikitech-static check_icinga[7046]: 2021-11-07 20:30:05,758 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:32:01 wikitech-static CRON[7122]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:32:01 wikitech-static CRON[7123]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:32:02 wikitech-static check_icinga[7124]: 2021-11-07 20:32:02,937 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:32:02 wikitech-static check_icinga[7125]: 2021-11-07 20:32:02,940 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:32:05 wikitech-static check_icinga[7124]: 2021-11-07 20:32:05,827 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:32:06 wikitech-static check_icinga[7125]: 2021-11-07 20:32:06,249 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:34:01 wikitech-static CRON[7197]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:34:01 wikitech-static CRON[7198]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:34:02 wikitech-static check_icinga[7199]: 2021-11-07 20:34:02,397 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:34:02 wikitech-static check_icinga[7200]: 2021-11-07 20:34:02,401 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:34:03 wikitech-static check_icinga[7200]: 2021-11-07 20:34:03,763 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)']
Nov 7 20:34:05 wikitech-static check_icinga[7199]: 2021-11-07 20:34:05,482 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:34:13 wikitech-static check_icinga[7200]: 2021-11-07 20:34:13,802 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:34:16 wikitech-static check_icinga[7200]: 2021-11-07 20:34:16,571 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:36:01 wikitech-static CRON[7274]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:36:01 wikitech-static CRON[7275]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:36:02 wikitech-static check_icinga[7276]: 2021-11-07 20:36:02,729 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:36:02 wikitech-static check_icinga[7277]: 2021-11-07 20:36:02,830 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:36:05 wikitech-static check_icinga[7276]: 2021-11-07 20:36:05,588 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:36:06 wikitech-static check_icinga[7277]: 2021-11-07 20:36:06,029 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:38:01 wikitech-static CRON[7349]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:38:01 wikitech-static CRON[7350]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:38:02 wikitech-static check_icinga[7352]: 2021-11-07 20:38:02,157 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:38:02 wikitech-static check_icinga[7351]: 2021-11-07 20:38:02,183 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:38:04 wikitech-static check_icinga[7351]: 2021-11-07 20:38:04,906 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:38:05 wikitech-static check_icinga[7352]: 2021-11-07 20:38:05,515 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:39:01 wikitech-static CRON[7396]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 20:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 20:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 20:40:01 wikitech-static CRON[7520]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:40:01 wikitech-static CRON[7521]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:40:02 wikitech-static check_icinga[7522]: 2021-11-07 20:40:02,719 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:40:02 wikitech-static check_icinga[7523]: 2021-11-07 20:40:02,723 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:40:05 wikitech-static check_icinga[7522]: 2021-11-07 20:40:05,579 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:40:05 wikitech-static check_icinga[7523]: 2021-11-07 20:40:05,894 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:42:01 wikitech-static CRON[7595]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:42:01 wikitech-static CRON[7596]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:42:03 wikitech-static check_icinga[7597]: 2021-11-07 20:42:03,024 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:42:03 wikitech-static check_icinga[7598]: 2021-11-07 20:42:03,026 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:42:05 wikitech-static check_icinga[7597]: 2021-11-07 20:42:05,821 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:42:06 wikitech-static check_icinga[7598]: 2021-11-07 20:42:06,088 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:44:01 wikitech-static CRON[7673]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:44:01 wikitech-static CRON[7674]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:44:02 wikitech-static check_icinga[7675]: 2021-11-07 20:44:02,240 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:44:02 wikitech-static check_icinga[7676]: 2021-11-07 20:44:02,242 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:44:05 wikitech-static check_icinga[7676]: 2021-11-07 20:44:05,033 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:44:05 wikitech-static check_icinga[7675]: 2021-11-07 20:44:05,467 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:46:01 wikitech-static CRON[7748]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:46:01 wikitech-static CRON[7749]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:46:02 wikitech-static check_icinga[7750]: 2021-11-07 20:46:02,629 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:46:02 wikitech-static check_icinga[7751]: 2021-11-07 20:46:02,659 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:46:05 wikitech-static check_icinga[7750]: 2021-11-07 20:46:05,375 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:46:05 wikitech-static check_icinga[7751]: 2021-11-07 20:46:05,805 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:48:01 wikitech-static CRON[7824]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:48:01 wikitech-static CRON[7825]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:48:02 wikitech-static check_icinga[7826]: 2021-11-07 20:48:02,946 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:48:02 wikitech-static check_icinga[7827]: 2021-11-07 20:48:02,950 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:48:05 wikitech-static check_icinga[7827]: 2021-11-07 20:48:05,967 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:48:06 wikitech-static check_icinga[7826]: 2021-11-07 20:48:06,121 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:50:01 wikitech-static CRON[7899]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:50:01 wikitech-static CRON[7900]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:50:02 wikitech-static check_icinga[7902]: 2021-11-07 20:50:02,268 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:50:02 wikitech-static check_icinga[7901]: 2021-11-07 20:50:02,271 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:50:05 wikitech-static check_icinga[7901]: 2021-11-07 20:50:05,697 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:50:05 wikitech-static check_icinga[7902]: 2021-11-07 20:50:05,699 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:52:01 wikitech-static CRON[7979]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:52:01 wikitech-static CRON[7980]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:52:02 wikitech-static check_icinga[7982]: 2021-11-07 20:52:02,970 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:52:02 wikitech-static check_icinga[7981]: 2021-11-07 20:52:02,989 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:52:05 wikitech-static check_icinga[7981]: 2021-11-07 20:52:05,939 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:52:06 wikitech-static check_icinga[7982]: 2021-11-07 20:52:06,097 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:54:01 wikitech-static CRON[8099]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:54:01 wikitech-static CRON[8100]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:54:02 wikitech-static check_icinga[8101]: 2021-11-07 20:54:02,277 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:54:02 wikitech-static check_icinga[8102]: 2021-11-07 20:54:02,279 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:54:05 wikitech-static check_icinga[8101]: 2021-11-07 20:54:05,336 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:54:05 wikitech-static check_icinga[8102]: 2021-11-07 20:54:05,391 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:56:01 wikitech-static CRON[8178]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:56:01 wikitech-static CRON[8179]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:56:02 wikitech-static check_icinga[8180]: 2021-11-07 20:56:02,590 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:56:02 wikitech-static check_icinga[8181]: 2021-11-07 20:56:02,591 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:56:05 wikitech-static check_icinga[8180]: 2021-11-07 20:56:05,573 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:56:05 wikitech-static check_icinga[8181]: 2021-11-07 20:56:05,780 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 20:58:01 wikitech-static CRON[8253]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 20:58:01 wikitech-static CRON[8254]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 20:58:02 wikitech-static check_icinga[8255]: 2021-11-07 20:58:02,893 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 20:58:02 wikitech-static check_icinga[8256]: 2021-11-07 20:58:02,923 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 20:58:05 wikitech-static check_icinga[8255]: 2021-11-07 20:58:05,964 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 20:58:06 wikitech-static check_icinga[8256]: 2021-11-07 20:58:06,120 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:00:01 wikitech-static CRON[8335]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:00:01 wikitech-static CRON[8336]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:00:02 wikitech-static check_icinga[8338]: 2021-11-07 21:00:02,251 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:00:02 wikitech-static check_icinga[8337]: 2021-11-07 21:00:02,255 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:00:05 wikitech-static check_icinga[8337]: 2021-11-07 21:00:05,261 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:00:05 wikitech-static check_icinga[8338]: 2021-11-07 21:00:05,608 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:02:01 wikitech-static CRON[8410]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:02:01 wikitech-static CRON[8411]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:02:02 wikitech-static check_icinga[8412]: 2021-11-07 21:02:02,725 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:02:02 wikitech-static check_icinga[8413]: 2021-11-07 21:02:02,760 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:02:05 wikitech-static check_icinga[8413]: 2021-11-07 21:02:05,805 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:02:05 wikitech-static check_icinga[8412]: 2021-11-07 21:02:05,877 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:04:01 wikitech-static CRON[8488]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:04:01 wikitech-static CRON[8489]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:04:03 wikitech-static check_icinga[8490]: 2021-11-07 21:04:03,009 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:04:03 wikitech-static check_icinga[8491]: 2021-11-07 21:04:03,035 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:04:06 wikitech-static check_icinga[8491]: 2021-11-07 21:04:06,018 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:04:06 wikitech-static check_icinga[8490]: 2021-11-07 21:04:06,186 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:06:01 wikitech-static CRON[8563]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:06:01 wikitech-static CRON[8564]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:06:02 wikitech-static check_icinga[8566]: 2021-11-07 21:06:02,336 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:06:02 wikitech-static check_icinga[8565]: 2021-11-07 21:06:02,350 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:06:05 wikitech-static check_icinga[8566]: 2021-11-07 21:06:05,334 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:06:05 wikitech-static check_icinga[8565]: 2021-11-07 21:06:05,527 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:08:01 wikitech-static CRON[8641]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:08:01 wikitech-static CRON[8642]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:08:02 wikitech-static check_icinga[8644]: 2021-11-07 21:08:02,667 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:08:02 wikitech-static check_icinga[8643]: 2021-11-07 21:08:02,673 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:08:05 wikitech-static check_icinga[8643]: 2021-11-07 21:08:05,782 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:08:05 wikitech-static check_icinga[8644]: 2021-11-07 21:08:05,874 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:09:01 wikitech-static CRON[8692]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 21:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 21:09:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 21:10:01 wikitech-static CRON[8814]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:10:01 wikitech-static CRON[8815]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:10:03 wikitech-static check_icinga[8816]: 2021-11-07 21:10:03,148 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:10:03 wikitech-static check_icinga[8817]: 2021-11-07 21:10:03,204 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:10:06 wikitech-static check_icinga[8817]: 2021-11-07 21:10:06,207 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:10:06 wikitech-static check_icinga[8816]: 2021-11-07 21:10:06,583 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:12:01 wikitech-static CRON[8895]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:12:01 wikitech-static CRON[8896]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:12:02 wikitech-static check_icinga[8898]: 2021-11-07 21:12:02,717 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:12:02 wikitech-static check_icinga[8897]: 2021-11-07 21:12:02,745 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:12:05 wikitech-static check_icinga[8897]: 2021-11-07 21:12:05,652 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:12:05 wikitech-static check_icinga[8898]: 2021-11-07 21:12:05,854 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:14:01 wikitech-static CRON[8973]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:14:01 wikitech-static CRON[8974]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:14:02 wikitech-static check_icinga[8976]: 2021-11-07 21:14:02,995 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:14:03 wikitech-static check_icinga[8975]: 2021-11-07 21:14:03,059 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:14:06 wikitech-static check_icinga[8976]: 2021-11-07 21:14:06,089 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:14:06 wikitech-static check_icinga[8975]: 2021-11-07 21:14:06,170 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:16:01 wikitech-static CRON[9049]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:16:01 wikitech-static CRON[9050]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:16:02 wikitech-static check_icinga[9051]: 2021-11-07 21:16:02,389 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:16:02 wikitech-static check_icinga[9052]: 2021-11-07 21:16:02,397 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:16:05 wikitech-static check_icinga[9051]: 2021-11-07 21:16:05,586 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:16:05 wikitech-static check_icinga[9052]: 2021-11-07 21:16:05,652 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:17:01 wikitech-static CRON[9117]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 21:18:01 wikitech-static CRON[9148]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:18:01 wikitech-static CRON[9149]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:18:02 wikitech-static check_icinga[9150]: 2021-11-07 21:18:02,842 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:18:02 wikitech-static check_icinga[9151]: 2021-11-07 21:18:02,846 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:18:05 wikitech-static check_icinga[9150]: 2021-11-07 21:18:05,929 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:18:05 wikitech-static check_icinga[9151]: 2021-11-07 21:18:05,977 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:20:01 wikitech-static CRON[9227]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:20:01 wikitech-static CRON[9228]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:20:02 wikitech-static check_icinga[9229]: 2021-11-07 21:20:02,156 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:20:02 wikitech-static check_icinga[9230]: 2021-11-07 21:20:02,160 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:20:05 wikitech-static check_icinga[9229]: 2021-11-07 21:20:05,228 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:20:05 wikitech-static check_icinga[9230]: 2021-11-07 21:20:05,391 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:22:01 wikitech-static CRON[9306]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:22:01 wikitech-static CRON[9307]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:22:02 wikitech-static check_icinga[9309]: 2021-11-07 21:22:02,545 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:22:02 wikitech-static check_icinga[9308]: 2021-11-07 21:22:02,552 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:22:05 wikitech-static check_icinga[9309]: 2021-11-07 21:22:05,740 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:22:05 wikitech-static check_icinga[9308]: 2021-11-07 21:22:05,878 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:24:01 wikitech-static CRON[9386]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:24:01 wikitech-static CRON[9387]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:24:03 wikitech-static check_icinga[9389]: 2021-11-07 21:24:03,186 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:24:03 wikitech-static check_icinga[9388]: 2021-11-07 21:24:03,187 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:24:06 wikitech-static check_icinga[9388]: 2021-11-07 21:24:06,056 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:24:06 wikitech-static check_icinga[9389]: 2021-11-07 21:24:06,370 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:26:01 wikitech-static CRON[9467]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:26:01 wikitech-static CRON[9468]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:26:02 wikitech-static check_icinga[9469]: 2021-11-07 21:26:02,547 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:26:02 wikitech-static check_icinga[9470]: 2021-11-07 21:26:02,567 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:26:05 wikitech-static check_icinga[9469]: 2021-11-07 21:26:05,500 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:26:06 wikitech-static check_icinga[9470]: 2021-11-07 21:26:06,014 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:28:01 wikitech-static CRON[9544]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:28:01 wikitech-static CRON[9545]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:28:02 wikitech-static check_icinga[9547]: 2021-11-07 21:28:02,161 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:28:02 wikitech-static check_icinga[9546]: 2021-11-07 21:28:02,164 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:28:05 wikitech-static check_icinga[9546]: 2021-11-07 21:28:05,189 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:28:05 wikitech-static check_icinga[9547]: 2021-11-07 21:28:05,277 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:30:01 wikitech-static CRON[9625]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:30:01 wikitech-static CRON[9626]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:30:02 wikitech-static check_icinga[9627]: 2021-11-07 21:30:02,467 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:30:02 wikitech-static check_icinga[9628]: 2021-11-07 21:30:02,469 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:30:05 wikitech-static check_icinga[9627]: 2021-11-07 21:30:05,533 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:30:05 wikitech-static check_icinga[9628]: 2021-11-07 21:30:05,955 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:32:01 wikitech-static CRON[9704]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:32:01 wikitech-static CRON[9705]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:32:02 wikitech-static check_icinga[9706]: 2021-11-07 21:32:02,131 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:32:02 wikitech-static check_icinga[9707]: 2021-11-07 21:32:02,135 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:32:05 wikitech-static check_icinga[9706]: 2021-11-07 21:32:05,138 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:32:05 wikitech-static check_icinga[9707]: 2021-11-07 21:32:05,299 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:34:01 wikitech-static CRON[9779]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:34:01 wikitech-static CRON[9780]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:34:02 wikitech-static check_icinga[9781]: 2021-11-07 21:34:02,413 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:34:02 wikitech-static check_icinga[9782]: 2021-11-07 21:34:02,435 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:34:03 wikitech-static check_icinga[9782]: 2021-11-07 21:34:03,809 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ["Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)']
Nov 7 21:34:05 wikitech-static check_icinga[9781]: 2021-11-07 21:34:05,591 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:34:13 wikitech-static check_icinga[9782]: 2021-11-07 21:34:13,823 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:34:16 wikitech-static check_icinga[9782]: 2021-11-07 21:34:16,502 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:36:01 wikitech-static CRON[9856]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:36:01 wikitech-static CRON[9857]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:36:02 wikitech-static check_icinga[9859]: 2021-11-07 21:36:02,656 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:36:02 wikitech-static check_icinga[9858]: 2021-11-07 21:36:02,664 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:36:05 wikitech-static check_icinga[9858]: 2021-11-07 21:36:05,457 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:36:05 wikitech-static check_icinga[9859]: 2021-11-07 21:36:05,713 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:38:01 wikitech-static CRON[9931]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:38:01 wikitech-static CRON[9932]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:38:02 wikitech-static check_icinga[9934]: 2021-11-07 21:38:02,852 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:38:02 wikitech-static check_icinga[9933]: 2021-11-07 21:38:02,853 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:38:05 wikitech-static check_icinga[9933]: 2021-11-07 21:38:05,564 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:38:06 wikitech-static check_icinga[9934]: 2021-11-07 21:38:06,242 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:39:01 wikitech-static CRON[9982]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 21:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 21:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 21:40:01 wikitech-static CRON[10106]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:40:01 wikitech-static CRON[10107]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:40:02 wikitech-static check_icinga[10108]: 2021-11-07 21:40:02,408 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:40:02 wikitech-static check_icinga[10109]: 2021-11-07 21:40:02,415 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:40:05 wikitech-static check_icinga[10108]: 2021-11-07 21:40:05,279 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:40:05 wikitech-static check_icinga[10109]: 2021-11-07 21:40:05,634 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:42:01 wikitech-static CRON[10183]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:42:01 wikitech-static CRON[10185]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:42:02 wikitech-static check_icinga[10184]: 2021-11-07 21:42:02,776 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:42:02 wikitech-static check_icinga[10186]: 2021-11-07 21:42:02,789 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:42:05 wikitech-static check_icinga[10184]: 2021-11-07 21:42:05,535 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:42:05 wikitech-static check_icinga[10186]: 2021-11-07 21:42:05,974 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:44:01 wikitech-static CRON[10260]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:44:01 wikitech-static CRON[10261]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:44:02 wikitech-static check_icinga[10263]: 2021-11-07 21:44:02,212 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:44:02 wikitech-static check_icinga[10262]: 2021-11-07 21:44:02,219 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:44:05 wikitech-static check_icinga[10263]: 2021-11-07 21:44:05,214 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:44:05 wikitech-static check_icinga[10262]: 2021-11-07 21:44:05,365 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:46:01 wikitech-static CRON[10337]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:46:01 wikitech-static CRON[10338]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:46:02 wikitech-static check_icinga[10339]: 2021-11-07 21:46:02,649 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:46:02 wikitech-static check_icinga[10340]: 2021-11-07 21:46:02,715 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:46:05 wikitech-static check_icinga[10339]: 2021-11-07 21:46:05,529 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:46:05 wikitech-static check_icinga[10340]: 2021-11-07 21:46:05,822 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:48:01 wikitech-static CRON[10418]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:48:01 wikitech-static CRON[10419]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:48:02 wikitech-static check_icinga[10420]: 2021-11-07 21:48:02,939 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:48:02 wikitech-static check_icinga[10421]: 2021-11-07 21:48:02,963 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:48:05 wikitech-static check_icinga[10420]: 2021-11-07 21:48:05,825 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:48:06 wikitech-static check_icinga[10421]: 2021-11-07 21:48:06,276 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:50:01 wikitech-static CRON[10497]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:50:01 wikitech-static CRON[10498]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:50:02 wikitech-static check_icinga[10499]: 2021-11-07 21:50:02,378 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:50:02 wikitech-static check_icinga[10500]: 2021-11-07 21:50:02,404 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:50:05 wikitech-static check_icinga[10500]: 2021-11-07 21:50:05,335 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:50:05 wikitech-static check_icinga[10499]: 2021-11-07 21:50:05,805 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:52:01 wikitech-static CRON[10572]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:52:01 wikitech-static CRON[10573]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:52:02 wikitech-static check_icinga[10574]: 2021-11-07 21:52:02,905 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:52:03 wikitech-static check_icinga[10575]: 2021-11-07 21:52:03,002 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:52:06 wikitech-static check_icinga[10574]: 2021-11-07 21:52:06,083 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:52:06 wikitech-static check_icinga[10575]: 2021-11-07 21:52:06,292 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:54:01 wikitech-static CRON[10647]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:54:01 wikitech-static CRON[10648]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:54:02 wikitech-static check_icinga[10650]: 2021-11-07 21:54:02,479 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:54:02 wikitech-static check_icinga[10649]: 2021-11-07 21:54:02,543 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:54:05 wikitech-static check_icinga[10649]: 2021-11-07 21:54:05,536 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:54:05 wikitech-static check_icinga[10650]: 2021-11-07 21:54:05,541 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:56:01 wikitech-static CRON[10725]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:56:01 wikitech-static CRON[10726]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:56:02 wikitech-static check_icinga[10727]: 2021-11-07 21:56:02,766 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:56:02 wikitech-static check_icinga[10728]: 2021-11-07 21:56:02,795 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:56:05 wikitech-static check_icinga[10727]: 2021-11-07 21:56:05,553 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:56:05 wikitech-static check_icinga[10728]: 2021-11-07 21:56:05,820 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 21:58:01 wikitech-static CRON[10800]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 21:58:01 wikitech-static CRON[10801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 21:58:02 wikitech-static check_icinga[10802]: 2021-11-07 21:58:02,932 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 21:58:02 wikitech-static check_icinga[10803]: 2021-11-07 21:58:02,937 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 21:58:05 wikitech-static check_icinga[10802]: 2021-11-07 21:58:05,797 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 21:58:06 wikitech-static check_icinga[10803]: 2021-11-07 21:58:06,124 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:00:01 wikitech-static CRON[10886]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:00:01 wikitech-static CRON[10887]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:00:02 wikitech-static check_icinga[10889]: 2021-11-07 22:00:02,270 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:00:02 wikitech-static check_icinga[10888]: 2021-11-07 22:00:02,273 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:00:05 wikitech-static check_icinga[10888]: 2021-11-07 22:00:05,475 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:00:05 wikitech-static check_icinga[10889]: 2021-11-07 22:00:05,511 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:02:01 wikitech-static CRON[10966]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:02:01 wikitech-static CRON[10967]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:02:02 wikitech-static check_icinga[10969]: 2021-11-07 22:02:02,730 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:02:02 wikitech-static check_icinga[10968]: 2021-11-07 22:02:02,737 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:02:05 wikitech-static check_icinga[10968]: 2021-11-07 22:02:05,570 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:02:05 wikitech-static check_icinga[10969]: 2021-11-07 22:02:05,807 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:04:01 wikitech-static CRON[11043]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:04:01 wikitech-static CRON[11044]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:04:02 wikitech-static check_icinga[11046]: 2021-11-07 22:04:02,917 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:04:02 wikitech-static check_icinga[11045]: 2021-11-07 22:04:02,963 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:04:05 wikitech-static check_icinga[11046]: 2021-11-07 22:04:05,752 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:04:06 wikitech-static check_icinga[11045]: 2021-11-07 22:04:06,199 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:06:01 wikitech-static CRON[11131]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:06:01 wikitech-static CRON[11132]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:06:02 wikitech-static check_icinga[11133]: 2021-11-07 22:06:02,312 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:06:02 wikitech-static check_icinga[11134]: 2021-11-07 22:06:02,342 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:06:05 wikitech-static check_icinga[11134]: 2021-11-07 22:06:05,266 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:06:05 wikitech-static check_icinga[11133]: 2021-11-07 22:06:05,517 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:08:01 wikitech-static CRON[11208]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:08:01 wikitech-static CRON[11209]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:08:02 wikitech-static check_icinga[11210]: 2021-11-07 22:08:02,649 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:08:02 wikitech-static check_icinga[11211]: 2021-11-07 22:08:02,680 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:08:05 wikitech-static check_icinga[11210]: 2021-11-07 22:08:05,487 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:08:05 wikitech-static check_icinga[11211]: 2021-11-07 22:08:05,917 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:09:01 wikitech-static CRON[11262]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 22:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 22:09:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 22:10:02 wikitech-static CRON[11400]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:10:02 wikitech-static CRON[11401]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:10:03 wikitech-static check_icinga[11402]: 2021-11-07 22:10:03,079 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:10:03 wikitech-static check_icinga[11403]: 2021-11-07 22:10:03,152 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:10:05 wikitech-static check_icinga[11402]: 2021-11-07 22:10:05,942 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:10:06 wikitech-static check_icinga[11403]: 2021-11-07 22:10:06,468 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:11:01 wikitech-static CRON[11447]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh)
Nov 7 22:11:02 wikitech-static check_icinga_validate_config[11448]: Valid config, nothing to do.
Nov 7 22:12:01 wikitech-static CRON[11487]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:12:01 wikitech-static CRON[11488]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:12:02 wikitech-static check_icinga[11489]: 2021-11-07 22:12:02,158 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:12:02 wikitech-static check_icinga[11490]: 2021-11-07 22:12:02,194 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:12:05 wikitech-static check_icinga[11489]: 2021-11-07 22:12:05,125 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:12:05 wikitech-static check_icinga[11490]: 2021-11-07 22:12:05,214 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:14:01 wikitech-static CRON[11569]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:14:01 wikitech-static CRON[11570]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:14:02 wikitech-static check_icinga[11572]: 2021-11-07 22:14:02,337 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:14:02 wikitech-static check_icinga[11571]: 2021-11-07 22:14:02,363 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:14:05 wikitech-static check_icinga[11571]: 2021-11-07 22:14:05,455 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:14:05 wikitech-static check_icinga[11572]: 2021-11-07 22:14:05,468 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:16:01 wikitech-static CRON[11647]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:16:01 wikitech-static CRON[11648]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:16:02 wikitech-static check_icinga[11650]: 2021-11-07 22:16:02,726 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:16:02 wikitech-static check_icinga[11649]: 2021-11-07 22:16:02,729 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:16:05 wikitech-static check_icinga[11649]: 2021-11-07 22:16:05,655 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:16:05 wikitech-static check_icinga[11650]: 2021-11-07 22:16:05,865 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:17:01 wikitech-static CRON[11701]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 22:18:01 wikitech-static CRON[11734]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:18:01 wikitech-static CRON[11735]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:18:03 wikitech-static check_icinga[11737]: 2021-11-07 22:18:03,017 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:18:03 wikitech-static check_icinga[11736]: 2021-11-07 22:18:03,018 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:18:06 wikitech-static check_icinga[11737]: 2021-11-07 22:18:06,151 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:18:06 wikitech-static check_icinga[11736]: 2021-11-07 22:18:06,217 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:20:01 wikitech-static CRON[11838]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:20:01 wikitech-static CRON[11839]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:20:02 wikitech-static check_icinga[11841]: 2021-11-07 22:20:02,391 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:20:02 wikitech-static check_icinga[11840]: 2021-11-07 22:20:02,393 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:20:05 wikitech-static check_icinga[11840]: 2021-11-07 22:20:05,362 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:20:05 wikitech-static check_icinga[11841]: 2021-11-07 22:20:05,466 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:22:01 wikitech-static CRON[11934]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:22:01 wikitech-static CRON[11935]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:22:02 wikitech-static check_icinga[11937]: 2021-11-07 22:22:02,636 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:22:02 wikitech-static check_icinga[11936]: 2021-11-07 22:22:02,641 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:22:05 wikitech-static check_icinga[11936]: 2021-11-07 22:22:05,566 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:22:06 wikitech-static check_icinga[11937]: 2021-11-07 22:22:06,056 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:24:01 wikitech-static CRON[12015]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:24:01 wikitech-static CRON[12016]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:24:02 wikitech-static check_icinga[12017]: 2021-11-07 22:24:02,207 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:24:02 wikitech-static check_icinga[12018]: 2021-11-07 22:24:02,277 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:24:05 wikitech-static check_icinga[12017]: 2021-11-07 22:24:05,243 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:24:05 wikitech-static check_icinga[12018]: 2021-11-07 22:24:05,372 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:26:01 wikitech-static CRON[12091]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:26:01 wikitech-static CRON[12092]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:26:02 wikitech-static check_icinga[12093]: 2021-11-07 22:26:02,530 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:26:02 wikitech-static check_icinga[12094]: 2021-11-07 22:26:02,604 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:26:05 wikitech-static check_icinga[12093]: 2021-11-07 22:26:05,347 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:26:05 wikitech-static check_icinga[12094]: 2021-11-07 22:26:05,950 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:28:01 wikitech-static CRON[12218]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:28:01 wikitech-static CRON[12219]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:28:02 wikitech-static check_icinga[12221]: 2021-11-07 22:28:02,106 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:28:02 wikitech-static check_icinga[12220]: 2021-11-07 22:28:02,173 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:28:05 wikitech-static check_icinga[12220]: 2021-11-07 22:28:05,049 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:28:05 wikitech-static check_icinga[12221]: 2021-11-07 22:28:05,352 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:30:01 wikitech-static CRON[12297]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:30:01 wikitech-static CRON[12298]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:30:02 wikitech-static check_icinga[12300]: 2021-11-07 22:30:02,526 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:30:02 wikitech-static check_icinga[12299]: 2021-11-07 22:30:02,527 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:30:05 wikitech-static check_icinga[12299]: 2021-11-07 22:30:05,460 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:30:05 wikitech-static check_icinga[12300]: 2021-11-07 22:30:05,610 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:32:01 wikitech-static CRON[12376]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:32:01 wikitech-static CRON[12377]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:32:02 wikitech-static check_icinga[12378]: 2021-11-07 22:32:02,701 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:32:02 wikitech-static check_icinga[12379]: 2021-11-07 22:32:02,752 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:32:05 wikitech-static check_icinga[12378]: 2021-11-07 22:32:05,676 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:32:05 wikitech-static check_icinga[12379]: 2021-11-07 22:32:05,756 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:34:01 wikitech-static CRON[12451]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:34:01 wikitech-static CRON[12452]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:34:02 wikitech-static check_icinga[12453]: 2021-11-07 22:34:02,921 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:34:02 wikitech-static check_icinga[12454]: 2021-11-07 22:34:02,926 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:34:04 wikitech-static check_icinga[12453]: 2021-11-07 22:34:04,312 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Service Checks Being Executed? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)']
Nov 7 22:34:06 wikitech-static check_icinga[12454]: 2021-11-07 22:34:06,132 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:34:14 wikitech-static check_icinga[12453]: 2021-11-07 22:34:14,322 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:34:17 wikitech-static check_icinga[12453]: 2021-11-07 22:34:17,043 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:36:01 wikitech-static CRON[12531]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:36:01 wikitech-static CRON[12532]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:36:02 wikitech-static check_icinga[12534]: 2021-11-07 22:36:02,204 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:36:02 wikitech-static check_icinga[12533]: 2021-11-07 22:36:02,209 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:36:05 wikitech-static check_icinga[12533]: 2021-11-07 22:36:05,027 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:36:05 wikitech-static check_icinga[12534]: 2021-11-07 22:36:05,530 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:38:01 wikitech-static CRON[12613]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:38:01 wikitech-static CRON[12614]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:38:02 wikitech-static check_icinga[12616]: 2021-11-07 22:38:02,639 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:38:02 wikitech-static check_icinga[12615]: 2021-11-07 22:38:02,666 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:38:05 wikitech-static check_icinga[12615]: 2021-11-07 22:38:05,454 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:38:05 wikitech-static check_icinga[12616]: 2021-11-07 22:38:05,679 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:39:01 wikitech-static CRON[12695]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 22:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 22:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 22:40:01 wikitech-static CRON[12820]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:40:01 wikitech-static CRON[12821]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:40:02 wikitech-static check_icinga[12823]: 2021-11-07 22:40:02,897 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:40:02 wikitech-static check_icinga[12822]: 2021-11-07 22:40:02,898 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:40:05 wikitech-static check_icinga[12822]: 2021-11-07 22:40:05,745 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:40:06 wikitech-static check_icinga[12823]: 2021-11-07 22:40:06,191 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:42:01 wikitech-static CRON[12898]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:42:01 wikitech-static CRON[12899]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:42:02 wikitech-static check_icinga[12900]: 2021-11-07 22:42:02,357 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:42:02 wikitech-static check_icinga[12901]: 2021-11-07 22:42:02,367 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:42:05 wikitech-static check_icinga[12900]: 2021-11-07 22:42:05,138 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:42:05 wikitech-static check_icinga[12901]: 2021-11-07 22:42:05,548 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:44:01 wikitech-static CRON[12973]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:44:01 wikitech-static CRON[12974]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:44:02 wikitech-static check_icinga[12975]: 2021-11-07 22:44:02,678 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:44:02 wikitech-static check_icinga[12976]: 2021-11-07 22:44:02,682 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:44:05 wikitech-static check_icinga[12975]: 2021-11-07 22:44:05,426 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:44:05 wikitech-static check_icinga[12976]: 2021-11-07 22:44:05,801 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:46:01 wikitech-static CRON[13051]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:46:01 wikitech-static CRON[13052]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:46:02 wikitech-static check_icinga[13053]: 2021-11-07 22:46:02,957 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:46:02 wikitech-static check_icinga[13054]: 2021-11-07 22:46:02,972 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:46:05 wikitech-static check_icinga[13053]: 2021-11-07 22:46:05,934 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:46:06 wikitech-static check_icinga[13054]: 2021-11-07 22:46:06,259 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:48:01 wikitech-static CRON[13129]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:48:01 wikitech-static CRON[13130]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:48:02 wikitech-static check_icinga[13131]: 2021-11-07 22:48:02,414 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:48:02 wikitech-static check_icinga[13132]: 2021-11-07 22:48:02,417 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:48:05 wikitech-static check_icinga[13131]: 2021-11-07 22:48:05,326 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:48:05 wikitech-static check_icinga[13132]: 2021-11-07 22:48:05,746 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:50:01 wikitech-static CRON[13207]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:50:01 wikitech-static CRON[13208]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:50:02 wikitech-static check_icinga[13210]: 2021-11-07 22:50:02,886 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:50:02 wikitech-static check_icinga[13209]: 2021-11-07 22:50:02,956 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:50:05 wikitech-static check_icinga[13210]: 2021-11-07 22:50:05,898 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:50:06 wikitech-static check_icinga[13209]: 2021-11-07 22:50:06,159 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:52:01 wikitech-static CRON[13283]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:52:01 wikitech-static CRON[13284]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:52:02 wikitech-static check_icinga[13286]: 2021-11-07 22:52:02,288 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:52:02 wikitech-static check_icinga[13285]: 2021-11-07 22:52:02,314 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:52:05 wikitech-static check_icinga[13286]: 2021-11-07 22:52:05,384 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:52:05 wikitech-static check_icinga[13285]: 2021-11-07 22:52:05,405 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:54:01 wikitech-static CRON[13361]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:54:01 wikitech-static CRON[13362]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:54:02 wikitech-static check_icinga[13364]: 2021-11-07 22:54:02,641 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:54:02 wikitech-static check_icinga[13363]: 2021-11-07 22:54:02,720 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:54:05 wikitech-static check_icinga[13364]: 2021-11-07 22:54:05,827 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:54:05 wikitech-static check_icinga[13363]: 2021-11-07 22:54:05,839 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:56:01 wikitech-static CRON[13436]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:56:01 wikitech-static CRON[13437]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:56:03 wikitech-static check_icinga[13438]: 2021-11-07 22:56:03,041 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:56:03 wikitech-static check_icinga[13439]: 2021-11-07 22:56:03,048 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:56:06 wikitech-static check_icinga[13439]: 2021-11-07 22:56:06,218 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 22:56:06 wikitech-static check_icinga[13438]: 2021-11-07 22:56:06,248 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:58:01 wikitech-static CRON[13532]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 22:58:01 wikitech-static CRON[13533]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 22:58:02 wikitech-static check_icinga[13534]: 2021-11-07 22:58:02,456 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 22:58:02 wikitech-static check_icinga[13535]: 2021-11-07 22:58:02,487 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 22:58:05 wikitech-static check_icinga[13534]: 2021-11-07 22:58:05,484 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 22:58:05 wikitech-static check_icinga[13535]: 2021-11-07 22:58:05,653 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:00:01 wikitech-static CRON[13620]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:00:01 wikitech-static CRON[13621]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:00:02 wikitech-static check_icinga[13622]: 2021-11-07 23:00:02,822 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:00:02 wikitech-static check_icinga[13623]: 2021-11-07 23:00:02,894 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:00:05 wikitech-static check_icinga[13622]: 2021-11-07 23:00:05,765 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:00:06 wikitech-static check_icinga[13623]: 2021-11-07 23:00:06,150 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:02:01 wikitech-static CRON[13721]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:02:01 wikitech-static CRON[13722]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:02:02 wikitech-static check_icinga[13723]: 2021-11-07 23:02:02,378 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:02:02 wikitech-static check_icinga[13724]: 2021-11-07 23:02:02,386 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:02:05 wikitech-static check_icinga[13724]: 2021-11-07 23:02:05,390 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:02:05 wikitech-static check_icinga[13723]: 2021-11-07 23:02:05,688 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:04:01 wikitech-static CRON[13799]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:04:01 wikitech-static CRON[13800]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:04:02 wikitech-static check_icinga[13801]: 2021-11-07 23:04:02,824 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:04:02 wikitech-static check_icinga[13802]: 2021-11-07 23:04:02,825 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:04:05 wikitech-static check_icinga[13801]: 2021-11-07 23:04:05,825 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:04:05 wikitech-static check_icinga[13802]: 2021-11-07 23:04:05,853 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:06:02 wikitech-static CRON[13877]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:06:02 wikitech-static CRON[13878]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:06:03 wikitech-static check_icinga[13879]: 2021-11-07 23:06:03,142 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:06:03 wikitech-static check_icinga[13880]: 2021-11-07 23:06:03,170 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:06:06 wikitech-static check_icinga[13879]: 2021-11-07 23:06:06,292 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:06:06 wikitech-static check_icinga[13880]: 2021-11-07 23:06:06,484 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:08:01 wikitech-static CRON[13956]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:08:01 wikitech-static CRON[13957]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:08:02 wikitech-static check_icinga[13958]: 2021-11-07 23:08:02,609 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:08:02 wikitech-static check_icinga[13959]: 2021-11-07 23:08:02,612 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:08:05 wikitech-static check_icinga[13958]: 2021-11-07 23:08:05,666 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:08:05 wikitech-static check_icinga[13959]: 2021-11-07 23:08:05,796 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:09:01 wikitech-static CRON[14003]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 23:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 23:09:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 23:10:01 wikitech-static CRON[14157]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:10:01 wikitech-static CRON[14158]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:10:02 wikitech-static check_icinga[14159]: 2021-11-07 23:10:02,966 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:10:02 wikitech-static check_icinga[14160]: 2021-11-07 23:10:02,969 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:10:06 wikitech-static check_icinga[14159]: 2021-11-07 23:10:06,094 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:10:06 wikitech-static check_icinga[14160]: 2021-11-07 23:10:06,179 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:12:01 wikitech-static CRON[14238]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:12:01 wikitech-static CRON[14239]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:12:02 wikitech-static check_icinga[14241]: 2021-11-07 23:12:02,341 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:12:02 wikitech-static check_icinga[14240]: 2021-11-07 23:12:02,345 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:12:05 wikitech-static check_icinga[14240]: 2021-11-07 23:12:05,598 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:12:05 wikitech-static check_icinga[14241]: 2021-11-07 23:12:05,657 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:14:01 wikitech-static CRON[14313]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:14:01 wikitech-static CRON[14314]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:14:02 wikitech-static check_icinga[14315]: 2021-11-07 23:14:02,777 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:14:02 wikitech-static check_icinga[14316]: 2021-11-07 23:14:02,801 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:14:05 wikitech-static check_icinga[14316]: 2021-11-07 23:14:05,972 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:14:06 wikitech-static check_icinga[14315]: 2021-11-07 23:14:06,069 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:16:01 wikitech-static CRON[14388]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:16:01 wikitech-static CRON[14389]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:16:02 wikitech-static check_icinga[14391]: 2021-11-07 23:16:02,945 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:16:02 wikitech-static check_icinga[14390]: 2021-11-07 23:16:02,966 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:16:06 wikitech-static check_icinga[14390]: 2021-11-07 23:16:06,133 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:16:06 wikitech-static check_icinga[14391]: 2021-11-07 23:16:06,183 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:17:01 wikitech-static CRON[14466]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 7 23:18:01 wikitech-static CRON[14497]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:18:01 wikitech-static CRON[14498]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:18:02 wikitech-static check_icinga[14499]: 2021-11-07 23:18:02,850 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:18:02 wikitech-static check_icinga[14500]: 2021-11-07 23:18:02,853 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:18:06 wikitech-static check_icinga[14499]: 2021-11-07 23:18:06,041 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:18:06 wikitech-static check_icinga[14500]: 2021-11-07 23:18:06,140 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:20:01 wikitech-static CRON[14584]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:20:01 wikitech-static CRON[14585]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:20:02 wikitech-static check_icinga[14587]: 2021-11-07 23:20:02,290 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:20:02 wikitech-static check_icinga[14586]: 2021-11-07 23:20:02,296 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:20:05 wikitech-static check_icinga[14586]: 2021-11-07 23:20:05,418 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:20:05 wikitech-static check_icinga[14587]: 2021-11-07 23:20:05,498 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:22:01 wikitech-static CRON[14683]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:22:01 wikitech-static CRON[14684]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:22:02 wikitech-static check_icinga[14685]: 2021-11-07 23:22:02,621 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:22:02 wikitech-static check_icinga[14686]: 2021-11-07 23:22:02,648 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:22:05 wikitech-static check_icinga[14685]: 2021-11-07 23:22:05,639 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:22:05 wikitech-static check_icinga[14686]: 2021-11-07 23:22:05,733 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:24:01 wikitech-static CRON[14763]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:24:01 wikitech-static CRON[14764]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:24:02 wikitech-static check_icinga[14766]: 2021-11-07 23:24:02,886 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:24:02 wikitech-static check_icinga[14765]: 2021-11-07 23:24:02,894 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:24:06 wikitech-static check_icinga[14766]: 2021-11-07 23:24:06,013 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:24:06 wikitech-static check_icinga[14765]: 2021-11-07 23:24:06,223 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:26:01 wikitech-static CRON[14856]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:26:01 wikitech-static CRON[14857]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:26:02 wikitech-static check_icinga[14858]: 2021-11-07 23:26:02,367 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:26:02 wikitech-static check_icinga[14859]: 2021-11-07 23:26:02,373 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:26:05 wikitech-static check_icinga[14858]: 2021-11-07 23:26:05,587 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:26:05 wikitech-static check_icinga[14859]: 2021-11-07 23:26:05,674 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:28:01 wikitech-static CRON[14954]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:28:01 wikitech-static CRON[14955]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:28:02 wikitech-static check_icinga[14956]: 2021-11-07 23:28:02,817 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:28:02 wikitech-static check_icinga[14957]: 2021-11-07 23:28:02,820 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:28:05 wikitech-static check_icinga[14956]: 2021-11-07 23:28:05,884 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:28:06 wikitech-static check_icinga[14957]: 2021-11-07 23:28:06,160 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:30:01 wikitech-static CRON[15029]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:30:01 wikitech-static CRON[15030]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:30:02 wikitech-static check_icinga[15032]: 2021-11-07 23:30:02,320 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:30:02 wikitech-static check_icinga[15031]: 2021-11-07 23:30:02,324 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:30:05 wikitech-static check_icinga[15031]: 2021-11-07 23:30:05,396 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:30:05 wikitech-static check_icinga[15032]: 2021-11-07 23:30:05,610 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:32:01 wikitech-static CRON[15105]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:32:01 wikitech-static CRON[15106]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:32:02 wikitech-static check_icinga[15108]: 2021-11-07 23:32:02,729 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:32:02 wikitech-static check_icinga[15107]: 2021-11-07 23:32:02,764 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:32:05 wikitech-static check_icinga[15107]: 2021-11-07 23:32:05,684 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:32:05 wikitech-static check_icinga[15108]: 2021-11-07 23:32:05,930 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:34:01 wikitech-static CRON[15181]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:34:01 wikitech-static CRON[15182]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:34:02 wikitech-static check_icinga[15183]: 2021-11-07 23:34:02,095 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:34:02 wikitech-static check_icinga[15184]: 2021-11-07 23:34:02,168 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:34:03 wikitech-static check_icinga[15183]: 2021-11-07 23:34:03,484 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)']
Nov 7 23:34:05 wikitech-static check_icinga[15184]: 2021-11-07 23:34:05,323 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:34:13 wikitech-static check_icinga[15183]: 2021-11-07 23:34:13,595 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:34:16 wikitech-static check_icinga[15183]: 2021-11-07 23:34:16,144 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:36:01 wikitech-static CRON[15258]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:36:01 wikitech-static CRON[15259]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:36:02 wikitech-static check_icinga[15261]: 2021-11-07 23:36:02,282 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:36:02 wikitech-static check_icinga[15260]: 2021-11-07 23:36:02,285 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:36:04 wikitech-static check_icinga[15260]: 2021-11-07 23:36:04,975 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:36:05 wikitech-static check_icinga[15261]: 2021-11-07 23:36:05,668 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:38:01 wikitech-static CRON[15333]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:38:01 wikitech-static CRON[15334]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:38:02 wikitech-static check_icinga[15335]: 2021-11-07 23:38:02,949 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:38:02 wikitech-static check_icinga[15336]: 2021-11-07 23:38:02,953 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:38:05 wikitech-static check_icinga[15335]: 2021-11-07 23:38:05,781 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:38:06 wikitech-static check_icinga[15336]: 2021-11-07 23:38:06,201 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:39:01 wikitech-static CRON[15380]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 7 23:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 7 23:39:06 wikitech-static systemd[1]: Started Clean php session files.
Nov 7 23:40:01 wikitech-static CRON[15521]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:40:01 wikitech-static CRON[15522]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:40:02 wikitech-static check_icinga[15524]: 2021-11-07 23:40:02,626 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:40:02 wikitech-static check_icinga[15523]: 2021-11-07 23:40:02,697 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:40:05 wikitech-static check_icinga[15523]: 2021-11-07 23:40:05,470 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:40:05 wikitech-static check_icinga[15524]: 2021-11-07 23:40:05,912 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:42:01 wikitech-static CRON[15596]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:42:01 wikitech-static CRON[15597]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:42:03 wikitech-static check_icinga[15599]: 2021-11-07 23:42:03,021 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:42:03 wikitech-static check_icinga[15598]: 2021-11-07 23:42:03,118 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:42:05 wikitech-static check_icinga[15598]: 2021-11-07 23:42:05,906 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:42:06 wikitech-static check_icinga[15599]: 2021-11-07 23:42:06,278 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:44:01 wikitech-static CRON[15677]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:44:01 wikitech-static CRON[15678]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:44:02 wikitech-static check_icinga[15680]: 2021-11-07 23:44:02,389 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:44:02 wikitech-static check_icinga[15679]: 2021-11-07 23:44:02,428 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:44:05 wikitech-static check_icinga[15679]: 2021-11-07 23:44:05,286 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:44:05 wikitech-static check_icinga[15680]: 2021-11-07 23:44:05,564 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:46:01 wikitech-static CRON[15801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:46:01 wikitech-static CRON[15802]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:46:03 wikitech-static check_icinga[15804]: 2021-11-07 23:46:03,192 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:46:03 wikitech-static check_icinga[15803]: 2021-11-07 23:46:03,194 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:46:06 wikitech-static check_icinga[15803]: 2021-11-07 23:46:06,162 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:46:06 wikitech-static check_icinga[15804]: 2021-11-07 23:46:06,326 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:48:01 wikitech-static CRON[15893]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:48:01 wikitech-static CRON[15894]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:48:02 wikitech-static check_icinga[15896]: 2021-11-07 23:48:02,460 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:48:02 wikitech-static check_icinga[15895]: 2021-11-07 23:48:02,469 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:48:05 wikitech-static check_icinga[15895]: 2021-11-07 23:48:05,369 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:48:05 wikitech-static check_icinga[15896]: 2021-11-07 23:48:05,682 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:50:01 wikitech-static CRON[15972]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:50:01 wikitech-static CRON[15973]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:50:02 wikitech-static check_icinga[15974]: 2021-11-07 23:50:02,821 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:50:02 wikitech-static check_icinga[15975]: 2021-11-07 23:50:02,828 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:50:05 wikitech-static check_icinga[15974]: 2021-11-07 23:50:05,747 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:50:05 wikitech-static check_icinga[15975]: 2021-11-07 23:50:05,875 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:52:01 wikitech-static CRON[16054]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:52:01 wikitech-static CRON[16055]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:52:03 wikitech-static check_icinga[16057]: 2021-11-07 23:52:03,102 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:52:03 wikitech-static check_icinga[16056]: 2021-11-07 23:52:03,105 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:52:05 wikitech-static check_icinga[16056]: 2021-11-07 23:52:05,975 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:52:06 wikitech-static check_icinga[16057]: 2021-11-07 23:52:06,332 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:54:01 wikitech-static CRON[16136]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:54:01 wikitech-static CRON[16137]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:54:02 wikitech-static check_icinga[16138]: 2021-11-07 23:54:02,478 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:54:02 wikitech-static check_icinga[16139]: 2021-11-07 23:54:02,508 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:54:05 wikitech-static check_icinga[16138]: 2021-11-07 23:54:05,270 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:54:05 wikitech-static check_icinga[16139]: 2021-11-07 23:54:05,657 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:56:01 wikitech-static CRON[16213]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:56:01 wikitech-static CRON[16214]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:56:02 wikitech-static check_icinga[16215]: 2021-11-07 23:56:02,808 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:56:02 wikitech-static check_icinga[16216]: 2021-11-07 23:56:02,839 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:56:05 wikitech-static check_icinga[16215]: 2021-11-07 23:56:05,852 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 7 23:56:05 wikitech-static check_icinga[16216]: 2021-11-07 23:56:05,952 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:58:01 wikitech-static CRON[16294]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 7 23:58:01 wikitech-static CRON[16295]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 7 23:58:02 wikitech-static check_icinga[16296]: 2021-11-07 23:58:02,114 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 7 23:58:02 wikitech-static check_icinga[16297]: 2021-11-07 23:58:02,117 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 7 23:58:05 wikitech-static check_icinga[16297]: 2021-11-07 23:58:05,364 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 7 23:58:05 wikitech-static check_icinga[16296]: 2021-11-07 23:58:05,427 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:00:01 wikitech-static CRON[16377]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:00:01 wikitech-static CRON[16378]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:00:02 wikitech-static check_icinga[16380]: 2021-11-08 00:00:02,597 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:00:02 wikitech-static check_icinga[16379]: 2021-11-08 00:00:02,627 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:00:05 wikitech-static check_icinga[16379]: 2021-11-08 00:00:05,409 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:00:05 wikitech-static check_icinga[16380]: 2021-11-08 00:00:05,725 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:02:01 wikitech-static CRON[16456]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:02:01 wikitech-static CRON[16457]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:02:02 wikitech-static check_icinga[16459]: 2021-11-08 00:02:02,837 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:02:02 wikitech-static check_icinga[16458]: 2021-11-08 00:02:02,840 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:02:05 wikitech-static check_icinga[16458]: 2021-11-08 00:02:05,679 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:02:06 wikitech-static check_icinga[16459]: 2021-11-08 00:02:06,162 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:04:01 wikitech-static CRON[16541]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:04:01 wikitech-static CRON[16542]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:04:02 wikitech-static check_icinga[16544]: 2021-11-08 00:04:02,291 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:04:02 wikitech-static check_icinga[16543]: 2021-11-08 00:04:02,377 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:04:05 wikitech-static check_icinga[16544]: 2021-11-08 00:04:05,293 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:04:05 wikitech-static check_icinga[16543]: 2021-11-08 00:04:05,378 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:06:01 wikitech-static CRON[16620]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:06:01 wikitech-static CRON[16621]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:06:02 wikitech-static check_icinga[16622]: 2021-11-08 00:06:02,530 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:06:02 wikitech-static check_icinga[16623]: 2021-11-08 00:06:02,552 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:06:05 wikitech-static check_icinga[16622]: 2021-11-08 00:06:05,626 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:06:05 wikitech-static check_icinga[16623]: 2021-11-08 00:06:05,768 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:08:01 wikitech-static CRON[16698]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:08:01 wikitech-static CRON[16699]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:08:02 wikitech-static check_icinga[16700]: 2021-11-08 00:08:02,881 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:08:02 wikitech-static check_icinga[16701]: 2021-11-08 00:08:02,982 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:08:05 wikitech-static check_icinga[16700]: 2021-11-08 00:08:05,837 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:08:06 wikitech-static check_icinga[16701]: 2021-11-08 00:08:06,207 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:09:01 wikitech-static CRON[16748]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 8 00:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 8 00:09:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 8 00:10:01 wikitech-static CRON[16870]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:10:01 wikitech-static CRON[16871]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:10:02 wikitech-static check_icinga[16872]: 2021-11-08 00:10:02,414 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:10:02 wikitech-static check_icinga[16873]: 2021-11-08 00:10:02,418 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:10:05 wikitech-static check_icinga[16872]: 2021-11-08 00:10:05,346 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:10:05 wikitech-static check_icinga[16873]: 2021-11-08 00:10:05,474 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:11:01 wikitech-static CRON[16934]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh)
Nov 8 00:11:02 wikitech-static check_icinga_validate_config[16935]: Valid config, nothing to do.
Nov 8 00:12:01 wikitech-static CRON[16967]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:12:01 wikitech-static CRON[16968]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:12:02 wikitech-static check_icinga[16969]: 2021-11-08 00:12:02,335 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:12:02 wikitech-static check_icinga[16970]: 2021-11-08 00:12:02,338 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:12:05 wikitech-static check_icinga[16969]: 2021-11-08 00:12:05,437 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:12:05 wikitech-static check_icinga[16970]: 2021-11-08 00:12:05,547 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:14:01 wikitech-static CRON[17043]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:14:01 wikitech-static CRON[17044]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:14:02 wikitech-static check_icinga[17046]: 2021-11-08 00:14:02,669 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:14:02 wikitech-static check_icinga[17045]: 2021-11-08 00:14:02,671 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:14:05 wikitech-static check_icinga[17045]: 2021-11-08 00:14:05,674 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:14:05 wikitech-static check_icinga[17046]: 2021-11-08 00:14:05,895 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:16:01 wikitech-static CRON[17118]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:16:01 wikitech-static CRON[17119]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:16:03 wikitech-static check_icinga[17120]: 2021-11-08 00:16:03,039 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:16:03 wikitech-static check_icinga[17121]: 2021-11-08 00:16:03,071 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:16:06 wikitech-static check_icinga[17120]: 2021-11-08 00:16:06,021 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:16:06 wikitech-static check_icinga[17121]: 2021-11-08 00:16:06,343 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:17:01 wikitech-static CRON[17172]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 8 00:18:01 wikitech-static CRON[17205]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:18:01 wikitech-static CRON[17206]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:18:02 wikitech-static check_icinga[17207]: 2021-11-08 00:18:02,482 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:18:02 wikitech-static check_icinga[17208]: 2021-11-08 00:18:02,505 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:18:05 wikitech-static check_icinga[17207]: 2021-11-08 00:18:05,367 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:18:05 wikitech-static check_icinga[17208]: 2021-11-08 00:18:05,479 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:20:01 wikitech-static CRON[17286]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:20:01 wikitech-static CRON[17287]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:20:02 wikitech-static check_icinga[17288]: 2021-11-08 00:20:02,610 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:20:02 wikitech-static check_icinga[17289]: 2021-11-08 00:20:02,613 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:20:05 wikitech-static check_icinga[17289]: 2021-11-08 00:20:05,718 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:20:05 wikitech-static check_icinga[17288]: 2021-11-08 00:20:05,975 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:22:01 wikitech-static CRON[17361]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:22:01 wikitech-static CRON[17362]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:22:02 wikitech-static check_icinga[17364]: 2021-11-08 00:22:02,117 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:22:02 wikitech-static check_icinga[17363]: 2021-11-08 00:22:02,143 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:22:05 wikitech-static check_icinga[17363]: 2021-11-08 00:22:05,176 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:22:05 wikitech-static check_icinga[17364]: 2021-11-08 00:22:05,273 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:24:01 wikitech-static CRON[17436]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:24:01 wikitech-static CRON[17437]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:24:02 wikitech-static check_icinga[17438]: 2021-11-08 00:24:02,404 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:24:02 wikitech-static check_icinga[17439]: 2021-11-08 00:24:02,409 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:24:05 wikitech-static check_icinga[17438]: 2021-11-08 00:24:05,462 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:24:05 wikitech-static check_icinga[17439]: 2021-11-08 00:24:05,577 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:26:01 wikitech-static CRON[17514]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:26:01 wikitech-static CRON[17515]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:26:02 wikitech-static check_icinga[17516]: 2021-11-08 00:26:02,716 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:26:02 wikitech-static check_icinga[17517]: 2021-11-08 00:26:02,729 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:26:05 wikitech-static check_icinga[17516]: 2021-11-08 00:26:05,833 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:26:05 wikitech-static check_icinga[17517]: 2021-11-08 00:26:05,888 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:28:02 wikitech-static CRON[17592]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:28:02 wikitech-static CRON[17593]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:28:03 wikitech-static check_icinga[17594]: 2021-11-08 00:28:03,093 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:28:03 wikitech-static check_icinga[17595]: 2021-11-08 00:28:03,118 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:28:06 wikitech-static check_icinga[17594]: 2021-11-08 00:28:06,154 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:28:06 wikitech-static check_icinga[17595]: 2021-11-08 00:28:06,257 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:30:01 wikitech-static CRON[17669]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:30:01 wikitech-static CRON[17670]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:30:02 wikitech-static check_icinga[17671]: 2021-11-08 00:30:02,393 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:30:02 wikitech-static check_icinga[17672]: 2021-11-08 00:30:02,397 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:30:05 wikitech-static check_icinga[17671]: 2021-11-08 00:30:05,415 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:30:05 wikitech-static check_icinga[17672]: 2021-11-08 00:30:05,502 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:32:01 wikitech-static CRON[17744]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:32:01 wikitech-static CRON[17745]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:32:02 wikitech-static check_icinga[17747]: 2021-11-08 00:32:02,593 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:32:02 wikitech-static check_icinga[17746]: 2021-11-08 00:32:02,619 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:32:05 wikitech-static check_icinga[17747]: 2021-11-08 00:32:05,731 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:32:05 wikitech-static check_icinga[17746]: 2021-11-08 00:32:05,801 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:34:01 wikitech-static CRON[17839]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:34:01 wikitech-static CRON[17840]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:34:03 wikitech-static check_icinga[17842]: 2021-11-08 00:34:03,017 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:34:03 wikitech-static check_icinga[17841]: 2021-11-08 00:34:03,025 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:34:04 wikitech-static check_icinga[17841]: 2021-11-08 00:34:04,424 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)']
Nov 8 00:34:06 wikitech-static check_icinga[17842]: 2021-11-08 00:34:06,162 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:34:14 wikitech-static check_icinga[17841]: 2021-11-08 00:34:14,463 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:34:17 wikitech-static check_icinga[17841]: 2021-11-08 00:34:17,328 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:36:01 wikitech-static CRON[17934]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:36:01 wikitech-static CRON[17935]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:36:02 wikitech-static check_icinga[17936]: 2021-11-08 00:36:02,433 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:36:02 wikitech-static check_icinga[17937]: 2021-11-08 00:36:02,431 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:36:05 wikitech-static check_icinga[17936]: 2021-11-08 00:36:05,179 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:36:05 wikitech-static check_icinga[17937]: 2021-11-08 00:36:05,609 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:38:01 wikitech-static CRON[18010]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:38:01 wikitech-static CRON[18011]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:38:02 wikitech-static check_icinga[18012]: 2021-11-08 00:38:02,750 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:38:02 wikitech-static check_icinga[18013]: 2021-11-08 00:38:02,753 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:38:05 wikitech-static check_icinga[18012]: 2021-11-08 00:38:05,501 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:38:05 wikitech-static check_icinga[18013]: 2021-11-08 00:38:05,966 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:39:01 wikitech-static CRON[18057]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 8 00:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 8 00:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 8 00:40:01 wikitech-static CRON[18179]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:40:01 wikitech-static CRON[18180]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:40:02 wikitech-static check_icinga[18181]: 2021-11-08 00:40:02,132 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:40:02 wikitech-static check_icinga[18182]: 2021-11-08 00:40:02,153 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:40:04 wikitech-static check_icinga[18181]: 2021-11-08 00:40:04,803 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:40:05 wikitech-static check_icinga[18182]: 2021-11-08 00:40:05,521 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:42:01 wikitech-static CRON[18254]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:42:01 wikitech-static CRON[18255]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:42:02 wikitech-static check_icinga[18256]: 2021-11-08 00:42:02,653 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:42:02 wikitech-static check_icinga[18257]: 2021-11-08 00:42:02,657 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:42:05 wikitech-static check_icinga[18256]: 2021-11-08 00:42:05,339 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:42:05 wikitech-static check_icinga[18257]: 2021-11-08 00:42:05,920 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:44:01 wikitech-static CRON[18334]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:44:01 wikitech-static CRON[18335]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:44:03 wikitech-static check_icinga[18337]: 2021-11-08 00:44:03,079 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:44:03 wikitech-static check_icinga[18336]: 2021-11-08 00:44:03,085 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:44:05 wikitech-static check_icinga[18336]: 2021-11-08 00:44:05,836 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:44:06 wikitech-static check_icinga[18337]: 2021-11-08 00:44:06,215 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:46:01 wikitech-static CRON[18409]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:46:01 wikitech-static CRON[18410]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:46:02 wikitech-static check_icinga[18412]: 2021-11-08 00:46:02,661 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:46:02 wikitech-static check_icinga[18411]: 2021-11-08 00:46:02,753 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:46:05 wikitech-static check_icinga[18412]: 2021-11-08 00:46:05,599 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:46:06 wikitech-static check_icinga[18411]: 2021-11-08 00:46:06,195 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:48:01 wikitech-static CRON[18488]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:48:01 wikitech-static CRON[18489]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:48:02 wikitech-static check_icinga[18491]: 2021-11-08 00:48:02,347 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:48:02 wikitech-static check_icinga[18490]: 2021-11-08 00:48:02,422 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:48:05 wikitech-static check_icinga[18490]: 2021-11-08 00:48:05,438 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:48:05 wikitech-static check_icinga[18491]: 2021-11-08 00:48:05,571 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:50:01 wikitech-static CRON[18563]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:50:01 wikitech-static CRON[18564]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:50:02 wikitech-static check_icinga[18566]: 2021-11-08 00:50:02,694 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:50:02 wikitech-static check_icinga[18565]: 2021-11-08 00:50:02,723 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:50:05 wikitech-static check_icinga[18565]: 2021-11-08 00:50:05,920 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:50:06 wikitech-static check_icinga[18566]: 2021-11-08 00:50:06,035 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:52:01 wikitech-static CRON[18643]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:52:01 wikitech-static CRON[18645]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:52:02 wikitech-static check_icinga[18644]: 2021-11-08 00:52:02,167 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:52:02 wikitech-static check_icinga[18646]: 2021-11-08 00:52:02,212 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:52:05 wikitech-static check_icinga[18644]: 2021-11-08 00:52:05,291 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:52:05 wikitech-static check_icinga[18646]: 2021-11-08 00:52:05,552 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:54:01 wikitech-static CRON[18722]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:54:01 wikitech-static CRON[18723]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:54:02 wikitech-static check_icinga[18724]: 2021-11-08 00:54:02,667 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:54:02 wikitech-static check_icinga[18725]: 2021-11-08 00:54:02,669 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:54:05 wikitech-static check_icinga[18724]: 2021-11-08 00:54:05,686 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:54:05 wikitech-static check_icinga[18725]: 2021-11-08 00:54:05,771 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:56:01 wikitech-static CRON[18801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:56:01 wikitech-static CRON[18802]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:56:02 wikitech-static check_icinga[18804]: 2021-11-08 00:56:02,910 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:56:02 wikitech-static check_icinga[18803]: 2021-11-08 00:56:02,916 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:56:05 wikitech-static check_icinga[18803]: 2021-11-08 00:56:05,892 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 00:56:05 wikitech-static check_icinga[18804]: 2021-11-08 00:56:05,939 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:58:01 wikitech-static CRON[18876]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 00:58:01 wikitech-static CRON[18877]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 00:58:02 wikitech-static check_icinga[18878]: 2021-11-08 00:58:02,150 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 00:58:02 wikitech-static check_icinga[18879]: 2021-11-08 00:58:02,154 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 00:58:05 wikitech-static check_icinga[18878]: 2021-11-08 00:58:05,205 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 00:58:05 wikitech-static check_icinga[18879]: 2021-11-08 00:58:05,336 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:00:01 wikitech-static CRON[18954]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:00:01 wikitech-static CRON[18955]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:00:02 wikitech-static check_icinga[18956]: 2021-11-08 01:00:02,454 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:00:02 wikitech-static check_icinga[18957]: 2021-11-08 01:00:02,464 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:00:05 wikitech-static check_icinga[18956]: 2021-11-08 01:00:05,576 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:00:05 wikitech-static check_icinga[18957]: 2021-11-08 01:00:05,663 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:02:01 wikitech-static CRON[19110]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:02:01 wikitech-static CRON[19111]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:02:03 wikitech-static check_icinga[19112]: 2021-11-08 01:02:03,285 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:02:03 wikitech-static check_icinga[19113]: 2021-11-08 01:02:03,308 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:02:06 wikitech-static check_icinga[19113]: 2021-11-08 01:02:06,278 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:02:06 wikitech-static check_icinga[19112]: 2021-11-08 01:02:06,488 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:04:01 wikitech-static CRON[19204]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:04:01 wikitech-static CRON[19205]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:04:02 wikitech-static check_icinga[19207]: 2021-11-08 01:04:02,881 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:04:02 wikitech-static check_icinga[19206]: 2021-11-08 01:04:02,882 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:04:05 wikitech-static check_icinga[19207]: 2021-11-08 01:04:05,912 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:04:05 wikitech-static check_icinga[19206]: 2021-11-08 01:04:05,972 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:06:01 wikitech-static CRON[19282]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:06:01 wikitech-static CRON[19283]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:06:02 wikitech-static check_icinga[19284]: 2021-11-08 01:06:02,164 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:06:02 wikitech-static check_icinga[19285]: 2021-11-08 01:06:02,169 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:06:05 wikitech-static check_icinga[19285]: 2021-11-08 01:06:05,276 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:06:05 wikitech-static check_icinga[19284]: 2021-11-08 01:06:05,500 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:08:01 wikitech-static CRON[19361]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:08:01 wikitech-static CRON[19362]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:08:02 wikitech-static check_icinga[19363]: 2021-11-08 01:08:02,658 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:08:02 wikitech-static check_icinga[19364]: 2021-11-08 01:08:02,660 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:08:05 wikitech-static check_icinga[19364]: 2021-11-08 01:08:05,765 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:08:05 wikitech-static check_icinga[19363]: 2021-11-08 01:08:05,770 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:09:01 wikitech-static CRON[19408]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 8 01:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 8 01:09:07 wikitech-static systemd[1]: Started Clean php session files.
Nov 8 01:10:01 wikitech-static CRON[19531]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:10:01 wikitech-static CRON[19532]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:10:02 wikitech-static check_icinga[19534]: 2021-11-08 01:10:02,993 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:10:03 wikitech-static check_icinga[19533]: 2021-11-08 01:10:03,090 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:10:06 wikitech-static check_icinga[19533]: 2021-11-08 01:10:06,180 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:10:06 wikitech-static check_icinga[19534]: 2021-11-08 01:10:06,252 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:12:01 wikitech-static CRON[19606]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:12:01 wikitech-static CRON[19607]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:12:02 wikitech-static check_icinga[19608]: 2021-11-08 01:12:02,403 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:12:02 wikitech-static check_icinga[19609]: 2021-11-08 01:12:02,407 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:12:05 wikitech-static check_icinga[19608]: 2021-11-08 01:12:05,420 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:12:05 wikitech-static check_icinga[19609]: 2021-11-08 01:12:05,700 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:14:01 wikitech-static CRON[19681]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:14:01 wikitech-static CRON[19682]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:14:02 wikitech-static check_icinga[19683]: 2021-11-08 01:14:02,829 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:14:02 wikitech-static check_icinga[19684]: 2021-11-08 01:14:02,846 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:14:05 wikitech-static check_icinga[19683]: 2021-11-08 01:14:05,807 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:14:05 wikitech-static check_icinga[19684]: 2021-11-08 01:14:05,964 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:16:01 wikitech-static CRON[19756]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:16:01 wikitech-static CRON[19757]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:16:02 wikitech-static check_icinga[19758]: 2021-11-08 01:16:02,113 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:16:02 wikitech-static check_icinga[19759]: 2021-11-08 01:16:02,178 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:16:05 wikitech-static check_icinga[19759]: 2021-11-08 01:16:05,283 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:16:05 wikitech-static check_icinga[19758]: 2021-11-08 01:16:05,357 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:17:01 wikitech-static CRON[19803]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 8 01:18:01 wikitech-static CRON[19837]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:18:01 wikitech-static CRON[19838]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:18:02 wikitech-static check_icinga[19840]: 2021-11-08 01:18:02,563 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:18:02 wikitech-static check_icinga[19839]: 2021-11-08 01:18:02,624 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:18:05 wikitech-static check_icinga[19839]: 2021-11-08 01:18:05,697 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:18:05 wikitech-static check_icinga[19840]: 2021-11-08 01:18:05,730 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:20:01 wikitech-static CRON[19915]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:20:01 wikitech-static CRON[19916]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:20:02 wikitech-static check_icinga[19917]: 2021-11-08 01:20:02,922 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:20:02 wikitech-static check_icinga[19918]: 2021-11-08 01:20:02,924 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:20:05 wikitech-static check_icinga[19917]: 2021-11-08 01:20:05,930 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:20:06 wikitech-static check_icinga[19918]: 2021-11-08 01:20:06,241 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:22:01 wikitech-static CRON[19990]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:22:01 wikitech-static CRON[19991]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:22:02 wikitech-static check_icinga[19992]: 2021-11-08 01:22:02,414 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:22:02 wikitech-static check_icinga[19993]: 2021-11-08 01:22:02,419 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:22:05 wikitech-static check_icinga[19992]: 2021-11-08 01:22:05,560 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:22:05 wikitech-static check_icinga[19993]: 2021-11-08 01:22:05,609 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:24:01 wikitech-static CRON[20069]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:24:01 wikitech-static CRON[20070]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:24:02 wikitech-static check_icinga[20071]: 2021-11-08 01:24:02,794 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:24:02 wikitech-static check_icinga[20072]: 2021-11-08 01:24:02,798 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:24:05 wikitech-static check_icinga[20071]: 2021-11-08 01:24:05,757 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:24:06 wikitech-static check_icinga[20072]: 2021-11-08 01:24:06,037 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:25:05 wikitech-static systemd[1]: Starting Certbot...
Nov 8 01:25:08 wikitech-static systemd[1]: Started Certbot.
Nov 8 01:25:08 wikitech-static systemd[1]: certbot.timer: Adding 11h 22min 36.158011s random time.
Nov 8 01:25:08 wikitech-static systemd[1]: certbot.timer: Adding 9h 34min 27.917606s random time.
Nov 8 01:26:01 wikitech-static CRON[20159]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:26:01 wikitech-static CRON[20160]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:26:02 wikitech-static check_icinga[20162]: 2021-11-08 01:26:02,205 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:26:02 wikitech-static check_icinga[20161]: 2021-11-08 01:26:02,208 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:26:05 wikitech-static check_icinga[20161]: 2021-11-08 01:26:05,339 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:26:05 wikitech-static check_icinga[20162]: 2021-11-08 01:26:05,391 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:28:01 wikitech-static CRON[20234]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:28:01 wikitech-static CRON[20235]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:28:02 wikitech-static check_icinga[20237]: 2021-11-08 01:28:02,581 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:28:02 wikitech-static check_icinga[20236]: 2021-11-08 01:28:02,611 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:28:05 wikitech-static check_icinga[20236]: 2021-11-08 01:28:05,705 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:28:05 wikitech-static check_icinga[20237]: 2021-11-08 01:28:05,776 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:30:01 wikitech-static CRON[20392]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:30:01 wikitech-static CRON[20393]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:30:02 wikitech-static check_icinga[20394]: 2021-11-08 01:30:02,919 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:30:02 wikitech-static check_icinga[20395]: 2021-11-08 01:30:02,925 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:30:05 wikitech-static check_icinga[20395]: 2021-11-08 01:30:05,915 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:30:06 wikitech-static check_icinga[20394]: 2021-11-08 01:30:06,165 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:32:01 wikitech-static CRON[20470]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:32:01 wikitech-static CRON[20471]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:32:02 wikitech-static check_icinga[20473]: 2021-11-08 01:32:02,287 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:32:02 wikitech-static check_icinga[20472]: 2021-11-08 01:32:02,314 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:32:05 wikitech-static check_icinga[20473]: 2021-11-08 01:32:05,365 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:32:05 wikitech-static check_icinga[20472]: 2021-11-08 01:32:05,433 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:34:01 wikitech-static CRON[20545]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:34:01 wikitech-static CRON[20546]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:34:02 wikitech-static check_icinga[20548]: 2021-11-08 01:34:02,557 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:34:02 wikitech-static check_icinga[20547]: 2021-11-08 01:34:02,583 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:34:03 wikitech-static check_icinga[20547]: 2021-11-08 01:34:03,966 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Event Handlers Enabled? MISSING_KEY (expected No)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Service Checks Being Executed? MISSING_KEY (expected YES)']
Nov 8 01:34:05 wikitech-static check_icinga[20548]: 2021-11-08 01:34:05,705 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:34:14 wikitech-static check_icinga[20547]: 2021-11-08 01:34:14,005 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:34:16 wikitech-static check_icinga[20547]: 2021-11-08 01:34:16,987 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:36:01 wikitech-static CRON[20623]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:36:01 wikitech-static CRON[20624]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:36:02 wikitech-static check_icinga[20625]: 2021-11-08 01:36:02,146 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:36:02 wikitech-static check_icinga[20626]: 2021-11-08 01:36:02,149 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:36:04 wikitech-static check_icinga[20625]: 2021-11-08 01:36:04,816 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:36:05 wikitech-static check_icinga[20626]: 2021-11-08 01:36:05,346 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:38:01 wikitech-static CRON[20726]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:38:01 wikitech-static CRON[20727]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:38:02 wikitech-static check_icinga[20729]: 2021-11-08 01:38:02,463 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:38:02 wikitech-static check_icinga[20728]: 2021-11-08 01:38:02,490 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:38:05 wikitech-static check_icinga[20729]: 2021-11-08 01:38:05,287 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:38:05 wikitech-static check_icinga[20728]: 2021-11-08 01:38:05,653 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:39:01 wikitech-static CRON[20773]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 8 01:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 8 01:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 8 01:40:01 wikitech-static CRON[20898]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:40:01 wikitech-static CRON[20899]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:40:02 wikitech-static check_icinga[20900]: 2021-11-08 01:40:02,776 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:40:02 wikitech-static check_icinga[20901]: 2021-11-08 01:40:02,800 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:40:05 wikitech-static check_icinga[20900]: 2021-11-08 01:40:05,645 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:40:05 wikitech-static check_icinga[20901]: 2021-11-08 01:40:05,850 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:42:01 wikitech-static CRON[20975]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:42:01 wikitech-static CRON[20976]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:42:03 wikitech-static check_icinga[20978]: 2021-11-08 01:42:03,070 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:42:03 wikitech-static check_icinga[20977]: 2021-11-08 01:42:03,075 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:42:05 wikitech-static check_icinga[20977]: 2021-11-08 01:42:05,963 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:42:06 wikitech-static check_icinga[20978]: 2021-11-08 01:42:06,295 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:44:01 wikitech-static CRON[21050]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:44:01 wikitech-static CRON[21051]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:44:02 wikitech-static check_icinga[21052]: 2021-11-08 01:44:02,454 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:44:02 wikitech-static check_icinga[21053]: 2021-11-08 01:44:02,520 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:44:05 wikitech-static check_icinga[21052]: 2021-11-08 01:44:05,336 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:44:05 wikitech-static check_icinga[21053]: 2021-11-08 01:44:05,658 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:46:01 wikitech-static CRON[21128]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:46:01 wikitech-static CRON[21129]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:46:02 wikitech-static check_icinga[21131]: 2021-11-08 01:46:02,802 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:46:02 wikitech-static check_icinga[21130]: 2021-11-08 01:46:02,806 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:46:05 wikitech-static check_icinga[21130]: 2021-11-08 01:46:05,764 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:46:05 wikitech-static check_icinga[21131]: 2021-11-08 01:46:05,966 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:48:01 wikitech-static CRON[21211]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:48:01 wikitech-static CRON[21212]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:48:02 wikitech-static check_icinga[21214]: 2021-11-08 01:48:02,157 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:48:02 wikitech-static check_icinga[21213]: 2021-11-08 01:48:02,187 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:48:05 wikitech-static check_icinga[21213]: 2021-11-08 01:48:05,307 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:48:05 wikitech-static check_icinga[21214]: 2021-11-08 01:48:05,362 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:50:01 wikitech-static CRON[21286]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:50:01 wikitech-static CRON[21287]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:50:02 wikitech-static check_icinga[21289]: 2021-11-08 01:50:02,536 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:50:02 wikitech-static check_icinga[21288]: 2021-11-08 01:50:02,566 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:50:05 wikitech-static check_icinga[21288]: 2021-11-08 01:50:05,593 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:50:05 wikitech-static check_icinga[21289]: 2021-11-08 01:50:05,738 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:52:01 wikitech-static CRON[21364]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:52:01 wikitech-static CRON[21365]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:52:02 wikitech-static check_icinga[21367]: 2021-11-08 01:52:02,854 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:52:02 wikitech-static check_icinga[21366]: 2021-11-08 01:52:02,953 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:52:06 wikitech-static check_icinga[21367]: 2021-11-08 01:52:06,014 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:52:06 wikitech-static check_icinga[21366]: 2021-11-08 01:52:06,104 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:54:01 wikitech-static CRON[21439]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:54:01 wikitech-static CRON[21440]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:54:02 wikitech-static check_icinga[21442]: 2021-11-08 01:54:02,267 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:54:02 wikitech-static check_icinga[21441]: 2021-11-08 01:54:02,270 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:54:05 wikitech-static check_icinga[21442]: 2021-11-08 01:54:05,471 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:54:05 wikitech-static check_icinga[21441]: 2021-11-08 01:54:05,486 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:56:01 wikitech-static CRON[21518]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:56:01 wikitech-static CRON[21519]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:56:02 wikitech-static check_icinga[21520]: 2021-11-08 01:56:02,681 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:56:02 wikitech-static check_icinga[21521]: 2021-11-08 01:56:02,796 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:56:06 wikitech-static check_icinga[21521]: 2021-11-08 01:56:06,006 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:56:06 wikitech-static check_icinga[21520]: 2021-11-08 01:56:06,105 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 01:58:01 wikitech-static CRON[21597]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 01:58:01 wikitech-static CRON[21598]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 01:58:02 wikitech-static check_icinga[21599]: 2021-11-08 01:58:02,269 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 01:58:02 wikitech-static check_icinga[21600]: 2021-11-08 01:58:02,370 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 01:58:05 wikitech-static check_icinga[21599]: 2021-11-08 01:58:05,493 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 01:58:05 wikitech-static check_icinga[21600]: 2021-11-08 01:58:05,720 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:00:01 wikitech-static CRON[21672]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:00:01 wikitech-static CRON[21673]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:00:02 wikitech-static check_icinga[21675]: 2021-11-08 02:00:02,878 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:00:02 wikitech-static check_icinga[21674]: 2021-11-08 02:00:02,901 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:00:06 wikitech-static check_icinga[21674]: 2021-11-08 02:00:06,147 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:00:06 wikitech-static check_icinga[21675]: 2021-11-08 02:00:06,230 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:02:01 wikitech-static CRON[21747]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:02:01 wikitech-static CRON[21748]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:02:02 wikitech-static check_icinga[21749]: 2021-11-08 02:02:02,393 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:02:02 wikitech-static check_icinga[21750]: 2021-11-08 02:02:02,394 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:02:05 wikitech-static check_icinga[21749]: 2021-11-08 02:02:05,504 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:02:05 wikitech-static check_icinga[21750]: 2021-11-08 02:02:05,587 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:04:01 wikitech-static CRON[21830]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:04:01 wikitech-static CRON[21832]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:04:02 wikitech-static check_icinga[21831]: 2021-11-08 02:04:02,704 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:04:02 wikitech-static check_icinga[21833]: 2021-11-08 02:04:02,719 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:04:06 wikitech-static check_icinga[21831]: 2021-11-08 02:04:06,008 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:04:06 wikitech-static check_icinga[21833]: 2021-11-08 02:04:06,062 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:04:06 wikitech-static systemd[1]: Starting Cleanup of Temporary Directories...
Nov 8 02:04:06 wikitech-static systemd[1]: Started Cleanup of Temporary Directories.
Nov 8 02:06:01 wikitech-static CRON[21908]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:06:01 wikitech-static CRON[21909]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:06:02 wikitech-static check_icinga[21910]: 2021-11-08 02:06:02,216 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:06:02 wikitech-static check_icinga[21911]: 2021-11-08 02:06:02,247 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:06:05 wikitech-static check_icinga[21910]: 2021-11-08 02:06:05,452 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:06:05 wikitech-static check_icinga[21911]: 2021-11-08 02:06:05,458 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:08:01 wikitech-static CRON[21995]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:08:01 wikitech-static CRON[21996]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:08:02 wikitech-static check_icinga[21997]: 2021-11-08 02:08:02,716 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:08:02 wikitech-static check_icinga[21998]: 2021-11-08 02:08:02,724 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:08:05 wikitech-static check_icinga[21997]: 2021-11-08 02:08:05,808 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:08:05 wikitech-static check_icinga[21998]: 2021-11-08 02:08:05,937 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:09:01 wikitech-static CRON[22050]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 8 02:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 8 02:09:06 wikitech-static systemd[1]: Started Clean php session files.
Nov 8 02:10:01 wikitech-static CRON[22172]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:10:01 wikitech-static CRON[22173]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:10:02 wikitech-static check_icinga[22174]: 2021-11-08 02:10:02,646 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:10:02 wikitech-static check_icinga[22175]: 2021-11-08 02:10:02,652 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:10:05 wikitech-static check_icinga[22174]: 2021-11-08 02:10:05,832 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:10:05 wikitech-static check_icinga[22175]: 2021-11-08 02:10:05,890 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:11:01 wikitech-static CRON[22223]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh)
Nov 8 02:11:02 wikitech-static check_icinga_validate_config[22224]: Valid config, nothing to do.
Nov 8 02:12:01 wikitech-static CRON[22279]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:12:01 wikitech-static CRON[22280]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:12:02 wikitech-static check_icinga[22281]: 2021-11-08 02:12:02,778 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:12:02 wikitech-static check_icinga[22282]: 2021-11-08 02:12:02,853 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:12:06 wikitech-static check_icinga[22282]: 2021-11-08 02:12:06,095 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:12:06 wikitech-static check_icinga[22281]: 2021-11-08 02:12:06,132 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:14:01 wikitech-static CRON[22369]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:14:01 wikitech-static CRON[22370]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:14:02 wikitech-static check_icinga[22371]: 2021-11-08 02:14:02,311 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:14:02 wikitech-static check_icinga[22372]: 2021-11-08 02:14:02,408 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:14:05 wikitech-static check_icinga[22371]: 2021-11-08 02:14:05,393 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:14:05 wikitech-static check_icinga[22372]: 2021-11-08 02:14:05,698 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:16:01 wikitech-static CRON[22453]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:16:01 wikitech-static CRON[22454]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:16:02 wikitech-static check_icinga[22456]: 2021-11-08 02:16:02,869 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:16:02 wikitech-static check_icinga[22455]: 2021-11-08 02:16:02,898 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:16:06 wikitech-static check_icinga[22455]: 2021-11-08 02:16:06,128 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:16:06 wikitech-static check_icinga[22456]: 2021-11-08 02:16:06,247 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:17:01 wikitech-static CRON[22500]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 8 02:18:01 wikitech-static CRON[22534]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:18:01 wikitech-static CRON[22535]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:18:02 wikitech-static check_icinga[22537]: 2021-11-08 02:18:02,652 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:18:02 wikitech-static check_icinga[22536]: 2021-11-08 02:18:02,655 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:18:05 wikitech-static check_icinga[22536]: 2021-11-08 02:18:05,764 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:18:05 wikitech-static check_icinga[22537]: 2021-11-08 02:18:05,968 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:20:01 wikitech-static CRON[22609]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:20:01 wikitech-static CRON[22610]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:20:02 wikitech-static check_icinga[22611]: 2021-11-08 02:20:02,116 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:20:02 wikitech-static check_icinga[22612]: 2021-11-08 02:20:02,121 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:20:05 wikitech-static check_icinga[22612]: 2021-11-08 02:20:05,355 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:20:05 wikitech-static check_icinga[22611]: 2021-11-08 02:20:05,487 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:22:01 wikitech-static CRON[22684]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:22:01 wikitech-static CRON[22685]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:22:02 wikitech-static check_icinga[22687]: 2021-11-08 02:22:02,649 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:22:02 wikitech-static check_icinga[22686]: 2021-11-08 02:22:02,654 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:22:05 wikitech-static check_icinga[22686]: 2021-11-08 02:22:05,684 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:22:05 wikitech-static check_icinga[22687]: 2021-11-08 02:22:05,811 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:24:01 wikitech-static CRON[22763]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:24:01 wikitech-static CRON[22764]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:24:02 wikitech-static check_icinga[22766]: 2021-11-08 02:24:02,954 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:24:02 wikitech-static check_icinga[22765]: 2021-11-08 02:24:02,957 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:24:06 wikitech-static check_icinga[22766]: 2021-11-08 02:24:06,075 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:24:06 wikitech-static check_icinga[22765]: 2021-11-08 02:24:06,082 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:26:01 wikitech-static CRON[22838]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:26:01 wikitech-static CRON[22839]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:26:02 wikitech-static check_icinga[22841]: 2021-11-08 02:26:02,310 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:26:02 wikitech-static check_icinga[22840]: 2021-11-08 02:26:02,315 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:26:05 wikitech-static check_icinga[22841]: 2021-11-08 02:26:05,284 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:26:05 wikitech-static check_icinga[22840]: 2021-11-08 02:26:05,553 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:28:01 wikitech-static CRON[22913]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:28:01 wikitech-static CRON[22914]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:28:02 wikitech-static check_icinga[22916]: 2021-11-08 02:28:02,712 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:28:02 wikitech-static check_icinga[22915]: 2021-11-08 02:28:02,717 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:28:05 wikitech-static check_icinga[22916]: 2021-11-08 02:28:05,820 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:28:05 wikitech-static check_icinga[22915]: 2021-11-08 02:28:05,999 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:30:01 wikitech-static CRON[22989]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:30:01 wikitech-static CRON[22990]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:30:02 wikitech-static check_icinga[22991]: 2021-11-08 02:30:02,146 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:30:02 wikitech-static check_icinga[22992]: 2021-11-08 02:30:02,149 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:30:05 wikitech-static check_icinga[22992]: 2021-11-08 02:30:05,257 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:30:05 wikitech-static check_icinga[22991]: 2021-11-08 02:30:05,306 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:32:01 wikitech-static CRON[23066]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:32:01 wikitech-static CRON[23068]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:32:02 wikitech-static check_icinga[23067]: 2021-11-08 02:32:02,485 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:32:02 wikitech-static check_icinga[23069]: 2021-11-08 02:32:02,596 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:32:05 wikitech-static check_icinga[23067]: 2021-11-08 02:32:05,621 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:32:05 wikitech-static check_icinga[23069]: 2021-11-08 02:32:05,843 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:34:01 wikitech-static CRON[23233]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:34:01 wikitech-static CRON[23234]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:34:02 wikitech-static check_icinga[23235]: 2021-11-08 02:34:02,963 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:34:02 wikitech-static check_icinga[23236]: 2021-11-08 02:34:02,965 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:34:04 wikitech-static check_icinga[23235]: 2021-11-08 02:34:04,365 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Service Checks Being Executed? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')"]
Nov 8 02:34:06 wikitech-static check_icinga[23236]: 2021-11-08 02:34:06,263 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:34:14 wikitech-static check_icinga[23235]: 2021-11-08 02:34:14,378 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:34:17 wikitech-static check_icinga[23235]: 2021-11-08 02:34:17,093 [ERROR] Check for host alert2001.wikimedia.org (2/3) failed: ["Last External Command Check: N/A (expected failed to calculate expected value: time data 'N/A' does not match format '%Y-%m-%d %H:%M:%S')"]
Nov 8 02:34:27 wikitech-static check_icinga[23235]: 2021-11-08 02:34:27,132 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:34:30 wikitech-static check_icinga[23235]: 2021-11-08 02:34:30,060 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:36:01 wikitech-static CRON[23308]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:36:01 wikitech-static CRON[23309]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:36:02 wikitech-static check_icinga[23310]: 2021-11-08 02:36:02,188 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:36:02 wikitech-static check_icinga[23311]: 2021-11-08 02:36:02,212 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:36:04 wikitech-static check_icinga[23310]: 2021-11-08 02:36:04,876 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:36:05 wikitech-static check_icinga[23311]: 2021-11-08 02:36:05,355 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:38:01 wikitech-static CRON[23383]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:38:01 wikitech-static CRON[23384]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:38:02 wikitech-static check_icinga[23386]: 2021-11-08 02:38:02,535 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:38:02 wikitech-static check_icinga[23385]: 2021-11-08 02:38:02,540 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:38:05 wikitech-static check_icinga[23385]: 2021-11-08 02:38:05,269 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:38:05 wikitech-static check_icinga[23386]: 2021-11-08 02:38:05,883 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:39:01 wikitech-static CRON[23430]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 8 02:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 8 02:39:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 8 02:40:01 wikitech-static CRON[23552]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:40:01 wikitech-static CRON[23553]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:40:03 wikitech-static check_icinga[23554]: 2021-11-08 02:40:03,001 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:40:03 wikitech-static check_icinga[23555]: 2021-11-08 02:40:03,004 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:40:05 wikitech-static check_icinga[23554]: 2021-11-08 02:40:05,896 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:40:06 wikitech-static check_icinga[23555]: 2021-11-08 02:40:06,220 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:42:01 wikitech-static CRON[23630]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:42:01 wikitech-static CRON[23631]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:42:02 wikitech-static check_icinga[23632]: 2021-11-08 02:42:02,382 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:42:02 wikitech-static check_icinga[23633]: 2021-11-08 02:42:02,389 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:42:05 wikitech-static check_icinga[23632]: 2021-11-08 02:42:05,135 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:42:05 wikitech-static check_icinga[23633]: 2021-11-08 02:42:05,656 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:44:01 wikitech-static CRON[23705]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:44:01 wikitech-static CRON[23706]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:44:02 wikitech-static check_icinga[23707]: 2021-11-08 02:44:02,777 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:44:02 wikitech-static check_icinga[23708]: 2021-11-08 02:44:02,794 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:44:05 wikitech-static check_icinga[23707]: 2021-11-08 02:44:05,570 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:44:06 wikitech-static check_icinga[23708]: 2021-11-08 02:44:06,253 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:46:01 wikitech-static CRON[23780]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:46:01 wikitech-static CRON[23781]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:46:02 wikitech-static check_icinga[23782]: 2021-11-08 02:46:02,465 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:46:02 wikitech-static check_icinga[23783]: 2021-11-08 02:46:02,573 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:46:05 wikitech-static check_icinga[23782]: 2021-11-08 02:46:05,365 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:46:05 wikitech-static check_icinga[23783]: 2021-11-08 02:46:05,698 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:48:01 wikitech-static CRON[23858]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:48:01 wikitech-static CRON[23859]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:48:02 wikitech-static check_icinga[23860]: 2021-11-08 02:48:02,865 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:48:02 wikitech-static check_icinga[23861]: 2021-11-08 02:48:02,869 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:48:05 wikitech-static check_icinga[23861]: 2021-11-08 02:48:05,910 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:48:05 wikitech-static check_icinga[23860]: 2021-11-08 02:48:05,935 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:50:01 wikitech-static CRON[23956]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:50:01 wikitech-static CRON[23957]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:50:02 wikitech-static check_icinga[23958]: 2021-11-08 02:50:02,167 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:50:02 wikitech-static check_icinga[23959]: 2021-11-08 02:50:02,193 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:50:05 wikitech-static check_icinga[23958]: 2021-11-08 02:50:05,141 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:50:05 wikitech-static check_icinga[23959]: 2021-11-08 02:50:05,460 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:52:01 wikitech-static CRON[24035]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:52:01 wikitech-static CRON[24036]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:52:02 wikitech-static check_icinga[24038]: 2021-11-08 02:52:02,600 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:52:02 wikitech-static check_icinga[24037]: 2021-11-08 02:52:02,667 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:52:05 wikitech-static check_icinga[24037]: 2021-11-08 02:52:05,747 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:52:05 wikitech-static check_icinga[24038]: 2021-11-08 02:52:05,853 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:54:01 wikitech-static CRON[24110]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:54:01 wikitech-static CRON[24111]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:54:02 wikitech-static check_icinga[24112]: 2021-11-08 02:54:02,965 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:54:02 wikitech-static check_icinga[24113]: 2021-11-08 02:54:02,994 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:54:06 wikitech-static check_icinga[24113]: 2021-11-08 02:54:06,075 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:54:06 wikitech-static check_icinga[24112]: 2021-11-08 02:54:06,143 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:56:01 wikitech-static CRON[24186]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:56:01 wikitech-static CRON[24187]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:56:02 wikitech-static check_icinga[24188]: 2021-11-08 02:56:02,374 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:56:02 wikitech-static check_icinga[24189]: 2021-11-08 02:56:02,398 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:56:05 wikitech-static check_icinga[24188]: 2021-11-08 02:56:05,527 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:56:05 wikitech-static check_icinga[24189]: 2021-11-08 02:56:05,703 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 02:58:01 wikitech-static CRON[24262]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 02:58:01 wikitech-static CRON[24263]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 02:58:02 wikitech-static check_icinga[24265]: 2021-11-08 02:58:02,919 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 02:58:02 wikitech-static check_icinga[24264]: 2021-11-08 02:58:02,925 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 02:58:06 wikitech-static check_icinga[24264]: 2021-11-08 02:58:06,087 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 02:58:06 wikitech-static check_icinga[24265]: 2021-11-08 02:58:06,130 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:00:01 wikitech-static CRON[24337]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:00:01 wikitech-static CRON[24339]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:00:02 wikitech-static check_icinga[24338]: 2021-11-08 03:00:02,325 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:00:02 wikitech-static check_icinga[24340]: 2021-11-08 03:00:02,373 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:00:05 wikitech-static check_icinga[24338]: 2021-11-08 03:00:05,384 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:00:05 wikitech-static check_icinga[24340]: 2021-11-08 03:00:05,590 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:02:01 wikitech-static CRON[24416]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:02:01 wikitech-static CRON[24417]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:02:02 wikitech-static check_icinga[24419]: 2021-11-08 03:02:02,756 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:02:02 wikitech-static check_icinga[24418]: 2021-11-08 03:02:02,761 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:02:05 wikitech-static check_icinga[24419]: 2021-11-08 03:02:05,924 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:02:05 wikitech-static check_icinga[24418]: 2021-11-08 03:02:05,931 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:04:01 wikitech-static CRON[24491]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:04:01 wikitech-static CRON[24492]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:04:02 wikitech-static check_icinga[24494]: 2021-11-08 03:04:02,149 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:04:02 wikitech-static check_icinga[24493]: 2021-11-08 03:04:02,259 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:04:05 wikitech-static check_icinga[24494]: 2021-11-08 03:04:05,482 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:04:05 wikitech-static check_icinga[24493]: 2021-11-08 03:04:05,525 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:06:01 wikitech-static CRON[24566]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:06:01 wikitech-static CRON[24567]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:06:02 wikitech-static check_icinga[24568]: 2021-11-08 03:06:02,714 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:06:02 wikitech-static check_icinga[24569]: 2021-11-08 03:06:02,745 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:06:05 wikitech-static check_icinga[24569]: 2021-11-08 03:06:05,759 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:06:05 wikitech-static check_icinga[24568]: 2021-11-08 03:06:05,867 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:08:01 wikitech-static CRON[24641]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:08:01 wikitech-static CRON[24642]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:08:02 wikitech-static check_icinga[24643]: 2021-11-08 03:08:02,996 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:08:03 wikitech-static check_icinga[24644]: 2021-11-08 03:08:03,001 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:08:06 wikitech-static check_icinga[24644]: 2021-11-08 03:08:06,000 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:08:06 wikitech-static check_icinga[24643]: 2021-11-08 03:08:06,050 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:09:01 wikitech-static CRON[24688]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 8 03:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 8 03:09:05 wikitech-static systemd[1]: Started Clean php session files.
Nov 8 03:10:01 wikitech-static CRON[24811]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:10:01 wikitech-static CRON[24812]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:10:02 wikitech-static check_icinga[24814]: 2021-11-08 03:10:02,388 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:10:02 wikitech-static check_icinga[24813]: 2021-11-08 03:10:02,391 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:10:05 wikitech-static check_icinga[24813]: 2021-11-08 03:10:05,639 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:10:05 wikitech-static check_icinga[24814]: 2021-11-08 03:10:05,688 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:12:01 wikitech-static CRON[24887]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:12:01 wikitech-static CRON[24888]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:12:02 wikitech-static check_icinga[24889]: 2021-11-08 03:12:02,988 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:12:03 wikitech-static check_icinga[24890]: 2021-11-08 03:12:03,019 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:12:06 wikitech-static check_icinga[24890]: 2021-11-08 03:12:06,163 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:12:06 wikitech-static check_icinga[24889]: 2021-11-08 03:12:06,198 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:14:01 wikitech-static CRON[24966]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:14:01 wikitech-static CRON[24967]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:14:02 wikitech-static check_icinga[24968]: 2021-11-08 03:14:02,412 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:14:02 wikitech-static check_icinga[24969]: 2021-11-08 03:14:02,435 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:14:05 wikitech-static check_icinga[24968]: 2021-11-08 03:14:05,573 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:14:05 wikitech-static check_icinga[24969]: 2021-11-08 03:14:05,713 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:16:01 wikitech-static CRON[25041]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:16:01 wikitech-static CRON[25042]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:16:03 wikitech-static check_icinga[25043]: 2021-11-08 03:16:03,066 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:16:03 wikitech-static check_icinga[25044]: 2021-11-08 03:16:03,092 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:16:06 wikitech-static check_icinga[25044]: 2021-11-08 03:16:06,192 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:16:06 wikitech-static check_icinga[25043]: 2021-11-08 03:16:06,259 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:17:01 wikitech-static CRON[25091]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 8 03:18:01 wikitech-static CRON[25122]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:18:01 wikitech-static CRON[25123]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:18:02 wikitech-static check_icinga[25125]: 2021-11-08 03:18:02,433 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:18:02 wikitech-static check_icinga[25124]: 2021-11-08 03:18:02,472 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:18:05 wikitech-static check_icinga[25124]: 2021-11-08 03:18:05,634 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:18:05 wikitech-static check_icinga[25125]: 2021-11-08 03:18:05,706 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:20:01 wikitech-static CRON[25197]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:20:01 wikitech-static CRON[25199]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:20:02 wikitech-static check_icinga[25198]: 2021-11-08 03:20:02,903 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:20:02 wikitech-static check_icinga[25200]: 2021-11-08 03:20:02,919 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:20:06 wikitech-static check_icinga[25198]: 2021-11-08 03:20:06,028 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:20:06 wikitech-static check_icinga[25200]: 2021-11-08 03:20:06,179 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:22:01 wikitech-static CRON[25274]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:22:01 wikitech-static CRON[25275]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:22:02 wikitech-static check_icinga[25277]: 2021-11-08 03:22:02,348 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:22:02 wikitech-static check_icinga[25276]: 2021-11-08 03:22:02,353 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:22:05 wikitech-static check_icinga[25276]: 2021-11-08 03:22:05,486 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:22:05 wikitech-static check_icinga[25277]: 2021-11-08 03:22:05,565 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:24:01 wikitech-static CRON[25352]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:24:01 wikitech-static CRON[25353]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:24:02 wikitech-static check_icinga[25355]: 2021-11-08 03:24:02,798 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:24:02 wikitech-static check_icinga[25354]: 2021-11-08 03:24:02,805 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:24:05 wikitech-static check_icinga[25355]: 2021-11-08 03:24:05,980 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:24:06 wikitech-static check_icinga[25354]: 2021-11-08 03:24:06,064 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:26:01 wikitech-static CRON[25432]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:26:01 wikitech-static CRON[25433]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:26:02 wikitech-static check_icinga[25434]: 2021-11-08 03:26:02,257 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:26:02 wikitech-static check_icinga[25435]: 2021-11-08 03:26:02,261 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:26:05 wikitech-static check_icinga[25435]: 2021-11-08 03:26:05,337 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:26:05 wikitech-static check_icinga[25434]: 2021-11-08 03:26:05,676 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:28:01 wikitech-static CRON[25513]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:28:01 wikitech-static CRON[25514]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:28:02 wikitech-static check_icinga[25516]: 2021-11-08 03:28:02,895 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:28:02 wikitech-static check_icinga[25515]: 2021-11-08 03:28:02,929 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:28:05 wikitech-static check_icinga[25515]: 2021-11-08 03:28:05,935 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:28:06 wikitech-static check_icinga[25516]: 2021-11-08 03:28:06,083 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:30:01 wikitech-static CRON[25615]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:30:01 wikitech-static CRON[25617]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:30:02 wikitech-static check_icinga[25616]: 2021-11-08 03:30:02,231 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:30:02 wikitech-static check_icinga[25618]: 2021-11-08 03:30:02,239 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:30:05 wikitech-static check_icinga[25616]: 2021-11-08 03:30:05,381 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:30:05 wikitech-static check_icinga[25618]: 2021-11-08 03:30:05,628 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:32:01 wikitech-static CRON[25711]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:32:01 wikitech-static CRON[25713]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:32:02 wikitech-static check_icinga[25712]: 2021-11-08 03:32:02,787 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:32:02 wikitech-static check_icinga[25714]: 2021-11-08 03:32:02,800 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:32:05 wikitech-static check_icinga[25714]: 2021-11-08 03:32:05,880 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:32:06 wikitech-static check_icinga[25712]: 2021-11-08 03:32:06,020 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:34:01 wikitech-static CRON[25786]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:34:01 wikitech-static CRON[25787]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:34:02 wikitech-static check_icinga[25788]: 2021-11-08 03:34:02,197 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:34:02 wikitech-static check_icinga[25789]: 2021-11-08 03:34:02,204 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:34:03 wikitech-static check_icinga[25789]: 2021-11-08 03:34:03,584 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ["Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)', 'Event Handlers Enabled? MISSING_KEY (expected No)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Notifications Enabled? MISSING_KEY (expected NO)', 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)']
Nov 8 03:34:05 wikitech-static check_icinga[25788]: 2021-11-08 03:34:05,295 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:34:13 wikitech-static check_icinga[25789]: 2021-11-08 03:34:13,598 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:34:16 wikitech-static check_icinga[25789]: 2021-11-08 03:34:16,435 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:36:01 wikitech-static CRON[25868]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:36:01 wikitech-static CRON[25870]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:36:02 wikitech-static check_icinga[25871]: 2021-11-08 03:36:02,594 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:36:02 wikitech-static check_icinga[25869]: 2021-11-08 03:36:02,597 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:36:05 wikitech-static check_icinga[25869]: 2021-11-08 03:36:05,363 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:36:05 wikitech-static check_icinga[25871]: 2021-11-08 03:36:05,749 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:38:01 wikitech-static CRON[25945]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:38:01 wikitech-static CRON[25946]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:38:02 wikitech-static check_icinga[25948]: 2021-11-08 03:38:02,935 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:38:02 wikitech-static check_icinga[25947]: 2021-11-08 03:38:02,940 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:38:05 wikitech-static check_icinga[25947]: 2021-11-08 03:38:05,872 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:38:06 wikitech-static check_icinga[25948]: 2021-11-08 03:38:06,130 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:39:01 wikitech-static CRON[25992]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 8 03:39:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 8 03:39:07 wikitech-static systemd[1]: Started Clean php session files.
Nov 8 03:40:01 wikitech-static CRON[26126]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:40:01 wikitech-static CRON[26127]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:40:02 wikitech-static check_icinga[26128]: 2021-11-08 03:40:02,329 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:40:02 wikitech-static check_icinga[26129]: 2021-11-08 03:40:02,340 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:40:05 wikitech-static check_icinga[26129]: 2021-11-08 03:40:05,130 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:40:05 wikitech-static check_icinga[26128]: 2021-11-08 03:40:05,511 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:42:01 wikitech-static CRON[26204]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:42:01 wikitech-static CRON[26205]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:42:02 wikitech-static check_icinga[26207]: 2021-11-08 03:42:02,619 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:42:02 wikitech-static check_icinga[26206]: 2021-11-08 03:42:02,643 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:42:05 wikitech-static check_icinga[26206]: 2021-11-08 03:42:05,443 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:42:05 wikitech-static check_icinga[26207]: 2021-11-08 03:42:05,772 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:44:01 wikitech-static CRON[26282]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:44:01 wikitech-static CRON[26283]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:44:02 wikitech-static check_icinga[26285]: 2021-11-08 03:44:02,976 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:44:02 wikitech-static check_icinga[26284]: 2021-11-08 03:44:02,997 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:44:05 wikitech-static check_icinga[26284]: 2021-11-08 03:44:05,865 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:44:06 wikitech-static check_icinga[26285]: 2021-11-08 03:44:06,167 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:46:01 wikitech-static CRON[26361]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:46:01 wikitech-static CRON[26362]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:46:02 wikitech-static check_icinga[26364]: 2021-11-08 03:46:02,457 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:46:02 wikitech-static check_icinga[26363]: 2021-11-08 03:46:02,460 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:46:05 wikitech-static check_icinga[26364]: 2021-11-08 03:46:05,242 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:46:05 wikitech-static check_icinga[26363]: 2021-11-08 03:46:05,553 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:48:01 wikitech-static CRON[26436]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:48:01 wikitech-static CRON[26437]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:48:02 wikitech-static check_icinga[26438]: 2021-11-08 03:48:02,697 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:48:02 wikitech-static check_icinga[26439]: 2021-11-08 03:48:02,698 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:48:05 wikitech-static check_icinga[26438]: 2021-11-08 03:48:05,617 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:48:05 wikitech-static check_icinga[26439]: 2021-11-08 03:48:05,877 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:50:01 wikitech-static CRON[26514]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:50:01 wikitech-static CRON[26516]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:50:03 wikitech-static check_icinga[26515]: 2021-11-08 03:50:03,020 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:50:03 wikitech-static check_icinga[26517]: 2021-11-08 03:50:03,034 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:50:05 wikitech-static check_icinga[26515]: 2021-11-08 03:50:05,959 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:50:06 wikitech-static check_icinga[26517]: 2021-11-08 03:50:06,221 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:52:01 wikitech-static CRON[26592]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:52:01 wikitech-static CRON[26593]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:52:02 wikitech-static check_icinga[26594]: 2021-11-08 03:52:02,335 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:52:02 wikitech-static check_icinga[26595]: 2021-11-08 03:52:02,425 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:52:05 wikitech-static check_icinga[26594]: 2021-11-08 03:52:05,353 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:52:05 wikitech-static check_icinga[26595]: 2021-11-08 03:52:05,607 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:54:01 wikitech-static CRON[26669]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:54:01 wikitech-static CRON[26670]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:54:02 wikitech-static check_icinga[26672]: 2021-11-08 03:54:02,706 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:54:02 wikitech-static check_icinga[26671]: 2021-11-08 03:54:02,731 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:54:05 wikitech-static check_icinga[26671]: 2021-11-08 03:54:05,875 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:54:05 wikitech-static check_icinga[26672]: 2021-11-08 03:54:05,923 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:56:01 wikitech-static CRON[26744]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:56:01 wikitech-static CRON[26746]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:56:02 wikitech-static check_icinga[26745]: 2021-11-08 03:56:02,105 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:56:02 wikitech-static check_icinga[26747]: 2021-11-08 03:56:02,132 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:56:05 wikitech-static check_icinga[26747]: 2021-11-08 03:56:05,152 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:56:05 wikitech-static check_icinga[26745]: 2021-11-08 03:56:05,196 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 03:58:01 wikitech-static CRON[26826]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 03:58:01 wikitech-static CRON[26827]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 03:58:02 wikitech-static check_icinga[26829]: 2021-11-08 03:58:02,375 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 03:58:02 wikitech-static check_icinga[26828]: 2021-11-08 03:58:02,487 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 03:58:05 wikitech-static check_icinga[26829]: 2021-11-08 03:58:05,604 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 03:58:05 wikitech-static check_icinga[26828]: 2021-11-08 03:58:05,739 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:00:01 wikitech-static CRON[26938]: (root) CMD (/usr/bin/systemd-cat -t "import-wikitech.sh" /wikitech-static/wikitechsync/import-wikitech.sh)
Nov 8 04:00:01 wikitech-static CRON[26939]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:00:01 wikitech-static CRON[26940]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: --2021-11-08 04:00:02-- https://wikitech.wikimedia.org/dumps/labswiki-20211108.xml.gz
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: Resolving wikitech.wikimedia.org (wikitech.wikimedia.org)... 208.80.154.224
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: Connecting to wikitech.wikimedia.org (wikitech.wikimedia.org)|208.80.154.224|:443... connected.
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: HTTP request sent, awaiting response... 200 OK
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: Length: 15805956 (15M) [application/x-gzip]
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: Saving to: ‘/srv/imports/labswiki-20211108.xml.gz’
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 0K .......... .......... .......... .......... .......... 0% 1.06M 14s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 50K .......... .......... .......... .......... .......... 0% 1.72M 11s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 100K .......... .......... .......... .......... .......... 0% 2.90M 9s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 150K .......... .......... .......... .......... .......... 1% 3.15M 8s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 200K .......... .......... .......... .......... .......... 1% 4.95M 7s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 250K .......... .......... .......... .......... .......... 1% 8.63M 6s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 300K .......... .......... .......... .......... .......... 2% 8.05M 6s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 350K .......... .......... .......... .......... .......... 2% 8.77M 5s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 400K .......... .......... .......... .......... .......... 2% 11.4M 5s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 450K .......... .......... .......... .......... .......... 3% 11.1M 4s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 500K .......... .......... .......... .......... .......... 3% 10.3M 4s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 550K .......... .......... .......... .......... .......... 3% 9.92M 4s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 600K .......... .......... .......... .......... .......... 4% 18.6M 4s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 650K .......... .......... .......... .......... .......... 4% 14.0M 3s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 700K .......... .......... .......... .......... .......... 4% 23.1M 3s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 750K .......... .......... .......... .......... .......... 5% 18.4M 3s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 800K .......... .......... .......... .......... .......... 5% 15.4M 3s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 850K .......... .......... .......... .......... .......... 5% 19.1M 3s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 900K .......... .......... .......... .......... .......... 6% 10.3M 3s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 950K .......... .......... .......... .......... .......... 6% 8.80M 3s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1000K .......... .......... .......... .......... .......... 6% 16.8M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1050K .......... .......... .......... .......... .......... 7% 32.8M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1100K .......... .......... .......... .......... .......... 7% 27.6M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1150K .......... .......... .......... .......... .......... 7% 30.3M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1200K .......... .......... .......... .......... .......... 8% 41.2M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1250K .......... .......... .......... .......... .......... 8% 24.0M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1300K .......... .......... .......... .......... .......... 8% 41.0M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1350K .......... .......... .......... .......... .......... 9% 23.3M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1400K .......... .......... .......... .......... .......... 9% 27.5M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1450K .......... .......... .......... .......... .......... 9% 37.8M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1500K .......... .......... .......... .......... .......... 10% 25.4M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1550K .......... .......... .......... .......... .......... 10% 20.1M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1600K .......... .......... .......... .......... .......... 10% 134M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1650K .......... .......... .......... .......... .......... 11% 13.3M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1700K .......... .......... .......... .......... .......... 11% 87.5M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1750K .......... .......... .......... .......... .......... 11% 14.3M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1800K .......... .......... .......... .......... .......... 11% 42.9M 2s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1850K .......... .......... .......... .......... .......... 12% 142M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1900K .......... .......... .......... .......... .......... 12% 32.4M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 1950K .......... .......... .......... .......... .......... 12% 9.83M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2000K .......... .......... .......... .......... .......... 13% 132M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2050K .......... .......... .......... .......... .......... 13% 145M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2100K .......... .......... .......... .......... .......... 13% 128M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2150K .......... .......... .......... .......... .......... 14% 13.9M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2200K .......... .......... .......... .......... .......... 14% 36.1M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2250K .......... .......... .......... .......... .......... 14% 24.7M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2300K .......... .......... .......... .......... .......... 15% 118M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2350K .......... .......... .......... .......... .......... 15% 29.6M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2400K .......... .......... .......... .......... .......... 15% 34.7M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2450K .......... .......... .......... .......... .......... 16% 9.65M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2500K .......... .......... .......... .......... .......... 16% 144M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2550K .......... .......... .......... .......... .......... 16% 129M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2600K .......... .......... .......... .......... .......... 17% 12.9M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2650K .......... .......... .......... .......... .......... 17% 152M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2700K .......... .......... .......... .......... .......... 17% 38.0M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2750K .......... .......... .......... .......... .......... 18% 135M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2800K .......... .......... .......... .......... .......... 18% 9.29M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2850K .......... .......... .......... .......... .......... 18% 95.7M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2900K .......... .......... .......... .......... .......... 19% 125M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 2950K .......... .......... .......... .......... .......... 19% 12.6M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3000K .......... .......... .......... .......... .......... 19% 142M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3050K .......... .......... .......... .......... .......... 20% 111M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3100K .......... .......... .......... .......... .......... 20% 7.91M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3150K .......... .......... .......... .......... .......... 20% 131M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3200K .......... .......... .......... .......... .......... 21% 147M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3250K .......... .......... .......... .......... .......... 21% 161M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3300K .......... .......... .......... .......... .......... 21% 70.1M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3350K .......... .......... .......... .......... .......... 22% 15.6M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3400K .......... .......... .......... .......... .......... 22% 12.5M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3450K .......... .......... .......... .......... .......... 22% 128M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3500K .......... .......... .......... .......... .......... 22% 143M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3550K .......... .......... .......... .......... .......... 23% 65.2M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3600K .......... .......... .......... .......... .......... 23% 7.10M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3650K .......... .......... .......... .......... .......... 23% 133M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3700K .......... .......... .......... .......... .......... 24% 149M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3750K .......... .......... .......... .......... .......... 24% 109M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3800K .......... .......... .......... .......... .......... 24% 19.9M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3850K .......... .......... .......... .......... .......... 25% 117M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3900K .......... .......... .......... .......... .......... 25% 142M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 3950K .......... .......... .......... .......... .......... 25% 12.2M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4000K .......... .......... .......... .......... .......... 26% 144M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4050K .......... .......... .......... .......... .......... 26% 26.5M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4100K .......... .......... .......... .......... .......... 26% 5.84M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4150K .......... .......... .......... .......... .......... 27% 112M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4200K .......... .......... .......... .......... .......... 27% 31.5M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4250K .......... .......... .......... .......... .......... 27% 136M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4300K .......... .......... .......... .......... .......... 28% 155M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4350K .......... .......... .......... .......... .......... 28% 140M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4400K .......... .......... .......... .......... .......... 28% 160M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4450K .......... .......... .......... .......... .......... 29% 21.5M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4500K .......... .......... .......... .......... .......... 29% 78.2M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4550K .......... .......... .......... .......... .......... 29% 23.4M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4600K .......... .......... .......... .......... .......... 30% 6.28M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4650K .......... .......... .......... .......... .......... 30% 62.8M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4700K .......... .......... .......... .......... .......... 30% 136M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4750K .......... .......... .......... .......... .......... 31% 134M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4800K .......... .......... .......... .......... .......... 31% 154M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4850K .......... .......... .......... .......... .......... 31% 153M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4900K .......... .......... .......... .......... .......... 32% 19.0M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 4950K .......... .......... .......... .......... .......... 32% 85.6M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5000K .......... .......... .......... .......... .......... 32% 6.75M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5050K .......... .......... .......... .......... .......... 33% 146M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5100K .......... .......... .......... .......... .......... 33% 147M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5150K .......... .......... .......... .......... .......... 33% 90.9M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5200K .......... .......... .......... .......... .......... 34% 161M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5250K .......... .......... .......... .......... .......... 34% 7.13M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5300K .......... .......... .......... .......... .......... 34% 155M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5350K .......... .......... .......... .......... .......... 34% 94.0M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5400K .......... .......... .......... .......... .......... 35% 102M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5450K .......... .......... .......... .......... .......... 35% 156M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5500K .......... .......... .......... .......... .......... 35% 7.60M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5550K .......... .......... .......... .......... .......... 36% 137M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5600K .......... .......... .......... .......... .......... 36% 147M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5650K .......... .......... .......... .......... .......... 36% 166M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5700K .......... .......... .......... .......... .......... 37% 27.9M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5750K .......... .......... .......... .......... .......... 37% 9.29M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5800K .......... .......... .......... .......... .......... 37% 109M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5850K .......... .......... .......... .......... .......... 38% 142M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5900K .......... .......... .......... .......... .......... 38% 146M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 5950K .......... .......... .......... .......... .......... 38% 7.00M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6000K .......... .......... .......... .......... .......... 39% 110M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6050K .......... .......... .......... .......... .......... 39% 130M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6100K .......... .......... .......... .......... .......... 39% 153M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6150K .......... .......... .......... .......... .......... 40% 93.6M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6200K .......... .......... .......... .......... .......... 40% 8.21M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6250K .......... .......... .......... .......... .......... 40% 144M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6300K .......... .......... .......... .......... .......... 41% 150M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6350K .......... .......... .......... .......... .......... 41% 85.2M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6400K .......... .......... .......... .......... .......... 41% 89.7M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6450K .......... .......... .......... .......... .......... 42% 7.27M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6500K .......... .......... .......... .......... .......... 42% 139M 1s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6550K .......... .......... .......... .......... .......... 42% 114M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6600K .......... .......... .......... .......... .......... 43% 96.2M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6650K .......... .......... .......... .......... .......... 43% 151M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6700K .......... .......... .......... .......... .......... 43% 7.60M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6750K .......... .......... .......... .......... .......... 44% 90.4M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6800K .......... .......... .......... .......... .......... 44% 154M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6850K .......... .......... .......... .......... .......... 44% 151M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6900K .......... .......... .......... .......... .......... 45% 94.3M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 6950K .......... .......... .......... .......... .......... 45% 6.46M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7000K .......... .......... .......... .......... .......... 45% 142M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7050K .......... .......... .......... .......... .......... 45% 160M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7100K .......... .......... .......... .......... .......... 46% 97.7M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7150K .......... .......... .......... .......... .......... 46% 8.52M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7200K .......... .......... .......... .......... .......... 46% 131M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7250K .......... .......... .......... .......... .......... 47% 118M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7300K .......... .......... .......... .......... .......... 47% 106M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7350K .......... .......... .......... .......... .......... 47% 108M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7400K .......... .......... .......... .......... .......... 48% 5.04M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7450K .......... .......... .......... .......... .......... 48% 133M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7500K .......... .......... .......... .......... .......... 48% 90.4M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7550K .......... .......... .......... .......... .......... 49% 121M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7600K .......... .......... .......... .......... .......... 49% 148M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7650K .......... .......... .......... .......... .......... 49% 124M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7700K .......... .......... .......... .......... .......... 50% 155M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7750K .......... .......... .......... .......... .......... 50% 5.46M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7800K .......... .......... .......... .......... .......... 50% 108M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7850K .......... .......... .......... .......... .......... 51% 145M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7900K .......... .......... .......... .......... .......... 51% 5.77M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 7950K .......... .......... .......... .......... .......... 51% 84.9M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8000K .......... .......... .......... .......... .......... 52% 149M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8050K .......... .......... .......... .......... .......... 52% 118M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8100K .......... .......... .......... .......... .......... 52% 100M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8150K .......... .......... .......... .......... .......... 53% 123M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8200K .......... .......... .......... .......... .......... 53% 2.31M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8250K .......... .......... .......... .......... .......... 53% 87.4M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8300K .......... .......... .......... .......... .......... 54% 146M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8350K .......... .......... .......... .......... .......... 54% 113M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8400K .......... .......... .......... .......... .......... 54% 105M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8450K .......... .......... .......... .......... .......... 55% 125M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8500K .......... .......... .......... .......... .......... 55% 90.8M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8550K .......... .......... .......... .......... .......... 55% 99.2M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8600K .......... .......... .......... .......... .......... 56% 2.60M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8650K .......... .......... .......... .......... .......... 56% 152M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8700K .......... .......... .......... .......... .......... 56% 142M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8750K .......... .......... .......... .......... .......... 57% 115M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8800K .......... .......... .......... .......... .......... 57% 5.51M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8850K .......... .......... .......... .......... .......... 57% 97.3M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8900K .......... .......... .......... .......... .......... 57% 145M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 8950K .......... .......... .......... .......... .......... 58% 110M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9000K .......... .......... .......... .......... .......... 58% 109M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9050K .......... .......... .......... .......... .......... 58% 146M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9100K .......... .......... .......... .......... .......... 59% 104M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9150K .......... .......... .......... .......... .......... 59% 121M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9200K .......... .......... .......... .......... .......... 59% 146M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9250K .......... .......... .......... .......... .......... 60% 3.02M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9300K .......... .......... .......... .......... .......... 60% 104M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9350K .......... .......... .......... .......... .......... 60% 124M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9400K .......... .......... .......... .......... .......... 61% 107M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9450K .......... .......... .......... .......... .......... 61% 121M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9500K .......... .......... .......... .......... .......... 61% 118M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9550K .......... .......... .......... .......... .......... 62% 137M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9600K .......... .......... .......... .......... .......... 62% 98.9M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9650K .......... .......... .......... .......... .......... 62% 157M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9700K .......... .......... .......... .......... .......... 63% 135M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9750K .......... .......... .......... .......... .......... 63% 2.83M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9800K .......... .......... .......... .......... .......... 63% 155M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9850K .......... .......... .......... .......... .......... 64% 145M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9900K .......... .......... .......... .......... .......... 64% 132M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 9950K .......... .......... .......... .......... .......... 64% 117M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10000K .......... .......... .......... .......... .......... 65% 133M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10050K .......... .......... .......... .......... .......... 65% 125M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10100K .......... .......... .......... .......... .......... 65% 139M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10150K .......... .......... .......... .......... .......... 66% 2.70M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10200K .......... .......... .......... .......... .......... 66% 115M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10250K .......... .......... .......... .......... .......... 66% 117M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10300K .......... .......... .......... .......... .......... 67% 143M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10350K .......... .......... .......... .......... .......... 67% 25.1M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10400K .......... .......... .......... .......... .......... 67% 145M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10450K .......... .......... .......... .......... .......... 68% 153M 0s
Nov 8 04:00:02 wikitech-static import-wikitech.sh[26942]: 10500K .......... .......... .......... .......... .......... 68% 142M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10550K .......... .......... .......... .......... .......... 68% 121M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10600K .......... .......... .......... .......... .......... 68% 158M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10650K .......... .......... .......... .......... .......... 69% 142M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10700K .......... .......... .......... .......... .......... 69% 153M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10750K .......... .......... .......... .......... .......... 69% 132M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10800K .......... .......... .......... .......... .......... 70% 144M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10850K .......... .......... .......... .......... .......... 70% 4.50M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10900K .......... .......... .......... .......... .......... 70% 147M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 10950K .......... .......... .......... .......... .......... 71% 93.6M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11000K .......... .......... .......... .......... .......... 71% 2.39M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11050K .......... .......... .......... .......... .......... 71% 51.4M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11100K .......... .......... .......... .......... .......... 72% 142M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11150K .......... .......... .......... .......... .......... 72% 141M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11200K .......... .......... .......... .......... .......... 72% 98.0M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11250K .......... .......... .......... .......... .......... 73% 155M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11300K .......... .......... .......... .......... .......... 73% 144M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11350K .......... .......... .......... .......... .......... 73% 124M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11400K .......... .......... .......... .......... .......... 74% 159M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11450K .......... .......... .......... .......... .......... 74% 144M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11500K .......... .......... .......... .......... .......... 74% 5.06M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11550K .......... .......... .......... .......... .......... 75% 102M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11600K .......... .......... .......... .......... .......... 75% 4.74M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11650K .......... .......... .......... .......... .......... 75% 142M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11700K .......... .......... .......... .......... .......... 76% 160M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11750K .......... .......... .......... .......... .......... 76% 123M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11800K .......... .......... .......... .......... .......... 76% 148M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11850K .......... .......... .......... .......... .......... 77% 156M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11900K .......... .......... .......... .......... .......... 77% 151M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 11950K .......... .......... .......... .......... .......... 77% 139M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12000K .......... .......... .......... .......... .......... 78% 147M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12050K .......... .......... .......... .......... .......... 78% 155M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12100K .......... .......... .......... .......... .......... 78% 148M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12150K .......... .......... .......... .......... .......... 79% 120M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12200K .......... .......... .......... .......... .......... 79% 5.47M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12250K .......... .......... .......... .......... .......... 79% 120M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12300K .......... .......... .......... .......... .......... 80% 136M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12350K .......... .......... .......... .......... .......... 80% 128M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12400K .......... .......... .......... .......... .......... 80% 115M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12450K .......... .......... .......... .......... .......... 80% 143M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12500K .......... .......... .......... .......... .......... 81% 143M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12550K .......... .......... .......... .......... .......... 81% 93.5M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12600K .......... .......... .......... .......... .......... 81% 142M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12650K .......... .......... .......... .......... .......... 82% 3.39M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12700K .......... .......... .......... .......... .......... 82% 108M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12750K .......... .......... .......... .......... .......... 82% 128M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12800K .......... .......... .......... .......... .......... 83% 120M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12850K .......... .......... .......... .......... .......... 83% 8.70M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12900K .......... .......... .......... .......... .......... 83% 103M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 12950K .......... .......... .......... .......... .......... 84% 124M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13000K .......... .......... .......... .......... .......... 84% 151M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13050K .......... .......... .......... .......... .......... 84% 109M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13100K .......... .......... .......... .......... .......... 85% 158M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13150K .......... .......... .......... .......... .......... 85% 132M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13200K .......... .......... .......... .......... .......... 85% 4.86M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13250K .......... .......... .......... .......... .......... 86% 95.5M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13300K .......... .......... .......... .......... .......... 86% 158M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13350K .......... .......... .......... .......... .......... 86% 110M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13400K .......... .......... .......... .......... .......... 87% 4.91M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13450K .......... .......... .......... .......... .......... 87% 130M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13500K .......... .......... .......... .......... .......... 87% 129M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13550K .......... .......... .......... .......... .......... 88% 117M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13600K .......... .......... .......... .......... .......... 88% 144M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13650K .......... .......... .......... .......... .......... 88% 111M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13700K .......... .......... .......... .......... .......... 89% 150M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13750K .......... .......... .......... .......... .......... 89% 118M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13800K .......... .......... .......... .......... .......... 89% 114M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13850K .......... .......... .......... .......... .......... 90% 3.92M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13900K .......... .......... .......... .......... .......... 90% 12.9M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 13950K .......... .......... .......... .......... .......... 90% 107M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14000K .......... .......... .......... .......... .......... 91% 133M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14050K .......... .......... .......... .......... .......... 91% 149M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14100K .......... .......... .......... .......... .......... 91% 94.1M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14150K .......... .......... .......... .......... .......... 91% 124M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14200K .......... .......... .......... .......... .......... 92% 135M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14250K .......... .......... .......... .......... .......... 92% 104M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14300K .......... .......... .......... .......... .......... 92% 147M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14350K .......... .......... .......... .......... .......... 93% 79.2M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14400K .......... .......... .......... .......... .......... 93% 3.32M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14450K .......... .......... .......... .......... .......... 93% 158M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14500K .......... .......... .......... .......... .......... 94% 149M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14550K .......... .......... .......... .......... .......... 94% 117M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14600K .......... .......... .......... .......... .......... 94% 5.71M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14650K .......... .......... .......... .......... .......... 95% 135M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14700K .......... .......... .......... .......... .......... 95% 119M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14750K .......... .......... .......... .......... .......... 95% 104M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14800K .......... .......... .......... .......... .......... 96% 143M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14850K .......... .......... .......... .......... .......... 96% 150M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14900K .......... .......... .......... .......... .......... 96% 151M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 14950K .......... .......... .......... .......... .......... 97% 126M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15000K .......... .......... .......... .......... .......... 97% 149M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15050K .......... .......... .......... .......... .......... 97% 149M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15100K .......... .......... .......... .......... .......... 98% 142M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15150K .......... .......... .......... .......... .......... 98% 3.93M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15200K .......... .......... .......... .......... .......... 98% 146M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15250K .......... .......... .......... .......... .......... 99% 157M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15300K .......... .......... .......... .......... .......... 99% 153M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15350K .......... .......... .......... .......... .......... 99% 125M 0s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 15400K .......... .......... .......... ..... 100% 172M=0.7s
Nov 8 04:00:03 wikitech-static import-wikitech.sh[26942]: 2021-11-08 04:00:03 (20.6 MB/s) - ‘/srv/imports/labswiki-20211108.xml.gz’ saved [15805956/15805956]
Nov 8 04:00:03 wikitech-static check_icinga[26943]: 2021-11-08 04:00:03,545 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:00:03 wikitech-static check_icinga[26941]: 2021-11-08 04:00:03,553 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:00:06 wikitech-static check_icinga[26941]: 2021-11-08 04:00:06,823 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:00:06 wikitech-static check_icinga[26943]: 2021-11-08 04:00:06,912 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:00:09 wikitech-static import-wikitech.sh[26942]: 100 (46.30 pages/sec 46.30 revs/sec)
Nov 8 04:00:10 wikitech-static import-wikitech.sh[26942]: 200 (62.19 pages/sec 62.19 revs/sec)
Nov 8 04:00:11 wikitech-static import-wikitech.sh[26942]: 300 (80.62 pages/sec 80.62 revs/sec)
Nov 8 04:00:11 wikitech-static import-wikitech.sh[26942]: 400 (96.82 pages/sec 96.82 revs/sec)
Nov 8 04:00:11 wikitech-static import-wikitech.sh[26942]: 500 (108.41 pages/sec 108.41 revs/sec)
Nov 8 04:00:12 wikitech-static import-wikitech.sh[26942]: 600 (116.28 pages/sec 116.28 revs/sec)
Nov 8 04:00:23 wikitech-static import-wikitech.sh[26942]: 700 (42.15 pages/sec 42.15 revs/sec)
Nov 8 04:00:24 wikitech-static import-wikitech.sh[26942]: 800 (46.84 pages/sec 46.84 revs/sec)
Nov 8 04:00:24 wikitech-static import-wikitech.sh[26942]: 900 (51.61 pages/sec 51.61 revs/sec)
Nov 8 04:00:25 wikitech-static import-wikitech.sh[26942]: 1000 (56.08 pages/sec 56.08 revs/sec)
Nov 8 04:00:38 wikitech-static import-wikitech.sh[26942]: 1100 (35.05 pages/sec 35.05 revs/sec)
Nov 8 04:00:39 wikitech-static import-wikitech.sh[26942]: 1200 (37.91 pages/sec 37.91 revs/sec)
Nov 8 04:00:39 wikitech-static import-wikitech.sh[26942]: 1300 (40.62 pages/sec 40.62 revs/sec)
Nov 8 04:00:39 wikitech-static import-wikitech.sh[26942]: 1400 (43.07 pages/sec 43.07 revs/sec)
Nov 8 04:00:40 wikitech-static import-wikitech.sh[26942]: 1500 (45.50 pages/sec 45.50 revs/sec)
Nov 8 04:00:40 wikitech-static import-wikitech.sh[26942]: 1600 (48.14 pages/sec 48.14 revs/sec)
Nov 8 04:00:40 wikitech-static import-wikitech.sh[26942]: 1700 (50.59 pages/sec 50.59 revs/sec)
Nov 8 04:00:41 wikitech-static import-wikitech.sh[26942]: 1800 (52.85 pages/sec 52.85 revs/sec)
Nov 8 04:00:48 wikitech-static import-wikitech.sh[26942]: 1900 (45.81 pages/sec 45.81 revs/sec)
Nov 8 04:00:49 wikitech-static import-wikitech.sh[26942]: 2000 (47.90 pages/sec 47.90 revs/sec)
Nov 8 04:00:49 wikitech-static import-wikitech.sh[26942]: 2100 (49.84 pages/sec 49.84 revs/sec)
Nov 8 04:00:49 wikitech-static import-wikitech.sh[26942]: 2200 (51.65 pages/sec 51.65 revs/sec)
Nov 8 04:00:50 wikitech-static import-wikitech.sh[26942]: 2300 (53.40 pages/sec 53.40 revs/sec)
Nov 8 04:00:50 wikitech-static import-wikitech.sh[26942]: 2400 (55.18 pages/sec 55.18 revs/sec)
Nov 8 04:00:51 wikitech-static import-wikitech.sh[26942]: 2500 (57.15 pages/sec 57.15 revs/sec)
Nov 8 04:00:51 wikitech-static import-wikitech.sh[26942]: 2600 (59.05 pages/sec 59.05 revs/sec)
Nov 8 04:00:51 wikitech-static import-wikitech.sh[26942]: 2700 (60.99 pages/sec 60.99 revs/sec)
Nov 8 04:00:51 wikitech-static import-wikitech.sh[26942]: 2800 (62.89 pages/sec 62.89 revs/sec)
Nov 8 04:00:52 wikitech-static import-wikitech.sh[26942]: 2900 (64.50 pages/sec 64.50 revs/sec)
Nov 8 04:00:52 wikitech-static import-wikitech.sh[26942]: 3000 (66.28 pages/sec 66.28 revs/sec)
Nov 8 04:00:52 wikitech-static import-wikitech.sh[26942]: 3100 (68.15 pages/sec 68.15 revs/sec)
Nov 8 04:00:53 wikitech-static import-wikitech.sh[26942]: 3200 (69.89 pages/sec 69.89 revs/sec)
Nov 8 04:00:53 wikitech-static import-wikitech.sh[26942]: 3300 (71.71 pages/sec 71.71 revs/sec)
Nov 8 04:00:53 wikitech-static import-wikitech.sh[26942]: 3400 (73.43 pages/sec 73.43 revs/sec)
Nov 8 04:00:57 wikitech-static import-wikitech.sh[26942]: 3500 (69.49 pages/sec 69.49 revs/sec)
Nov 8 04:00:58 wikitech-static import-wikitech.sh[26942]: 3600 (71.02 pages/sec 71.02 revs/sec)
Nov 8 04:00:58 wikitech-static import-wikitech.sh[26942]: 3700 (72.52 pages/sec 72.52 revs/sec)
Nov 8 04:00:58 wikitech-static import-wikitech.sh[26942]: 3800 (74.09 pages/sec 74.09 revs/sec)
Nov 8 04:00:58 wikitech-static import-wikitech.sh[26942]: 3900 (75.57 pages/sec 75.57 revs/sec)
Nov 8 04:00:59 wikitech-static import-wikitech.sh[26942]: 4000 (77.01 pages/sec 77.01 revs/sec)
Nov 8 04:00:59 wikitech-static import-wikitech.sh[26942]: 4100 (78.37 pages/sec 78.37 revs/sec)
Nov 8 04:00:59 wikitech-static import-wikitech.sh[26942]: 4200 (79.92 pages/sec 79.92 revs/sec)
Nov 8 04:01:00 wikitech-static import-wikitech.sh[26942]: 4300 (81.00 pages/sec 81.00 revs/sec)
Nov 8 04:01:00 wikitech-static import-wikitech.sh[26942]: 4400 (82.35 pages/sec 82.35 revs/sec)
Nov 8 04:01:01 wikitech-static import-wikitech.sh[26942]: 4500 (83.56 pages/sec 83.56 revs/sec)
Nov 8 04:01:01 wikitech-static import-wikitech.sh[26942]: 4600 (85.04 pages/sec 85.04 revs/sec)
Nov 8 04:01:01 wikitech-static import-wikitech.sh[26942]: 4700 (86.27 pages/sec 86.27 revs/sec)
Nov 8 04:01:02 wikitech-static import-wikitech.sh[26942]: 4800 (87.18 pages/sec 87.18 revs/sec)
Nov 8 04:01:02 wikitech-static import-wikitech.sh[26942]: 4900 (88.50 pages/sec 88.50 revs/sec)
Nov 8 04:01:03 wikitech-static import-wikitech.sh[26942]: 5000 (89.86 pages/sec 89.86 revs/sec)
Nov 8 04:01:03 wikitech-static import-wikitech.sh[26942]: 5100 (91.04 pages/sec 91.04 revs/sec)
Nov 8 04:01:03 wikitech-static import-wikitech.sh[26942]: 5200 (92.32 pages/sec 92.32 revs/sec)
Nov 8 04:01:04 wikitech-static import-wikitech.sh[26942]: 5300 (93.20 pages/sec 93.20 revs/sec)
Nov 8 04:01:04 wikitech-static import-wikitech.sh[26942]: 5400 (94.02 pages/sec 94.02 revs/sec)
Nov 8 04:01:05 wikitech-static import-wikitech.sh[26942]: 5500 (94.82 pages/sec 94.82 revs/sec)
Nov 8 04:01:05 wikitech-static import-wikitech.sh[26942]: 5600 (95.99 pages/sec 95.99 revs/sec)
Nov 8 04:01:06 wikitech-static import-wikitech.sh[26942]: 5700 (96.99 pages/sec 96.99 revs/sec)
Nov 8 04:01:06 wikitech-static import-wikitech.sh[26942]: 5800 (98.12 pages/sec 98.12 revs/sec)
Nov 8 04:01:06 wikitech-static import-wikitech.sh[26942]: 5900 (99.29 pages/sec 99.29 revs/sec)
Nov 8 04:01:07 wikitech-static import-wikitech.sh[26942]: 6000 (100.52 pages/sec 100.52 revs/sec)
Nov 8 04:01:07 wikitech-static import-wikitech.sh[26942]: 6100 (101.30 pages/sec 101.30 revs/sec)
Nov 8 04:01:07 wikitech-static import-wikitech.sh[26942]: 6200 (102.45 pages/sec 102.45 revs/sec)
Nov 8 04:01:08 wikitech-static import-wikitech.sh[26942]: 6300 (103.55 pages/sec 103.55 revs/sec)
Nov 8 04:01:08 wikitech-static import-wikitech.sh[26942]: 6400 (104.73 pages/sec 104.73 revs/sec)
Nov 8 04:01:08 wikitech-static import-wikitech.sh[26942]: 6500 (105.55 pages/sec 105.55 revs/sec)
Nov 8 04:01:09 wikitech-static import-wikitech.sh[26942]: 6600 (106.24 pages/sec 106.24 revs/sec)
Nov 8 04:01:09 wikitech-static import-wikitech.sh[26942]: 6700 (107.43 pages/sec 107.43 revs/sec)
Nov 8 04:01:10 wikitech-static import-wikitech.sh[26942]: 6800 (108.50 pages/sec 108.50 revs/sec)
Nov 8 04:01:10 wikitech-static import-wikitech.sh[26942]: 6900 (109.40 pages/sec 109.40 revs/sec)
Nov 8 04:01:10 wikitech-static import-wikitech.sh[26942]: 7000 (110.42 pages/sec 110.42 revs/sec)
Nov 8 04:01:11 wikitech-static import-wikitech.sh[26942]: 7100 (111.32 pages/sec 111.32 revs/sec)
Nov 8 04:01:11 wikitech-static import-wikitech.sh[26942]: 7200 (112.36 pages/sec 112.36 revs/sec)
Nov 8 04:01:11 wikitech-static import-wikitech.sh[26942]: 7300 (113.46 pages/sec 113.46 revs/sec)
Nov 8 04:01:12 wikitech-static import-wikitech.sh[26942]: 7400 (114.41 pages/sec 114.41 revs/sec)
Nov 8 04:01:12 wikitech-static import-wikitech.sh[26942]: 7500 (115.47 pages/sec 115.47 revs/sec)
Nov 8 04:01:12 wikitech-static import-wikitech.sh[26942]: 7600 (116.52 pages/sec 116.52 revs/sec)
Nov 8 04:01:12 wikitech-static import-wikitech.sh[26942]: 7700 (117.59 pages/sec 117.59 revs/sec)
Nov 8 04:01:13 wikitech-static import-wikitech.sh[26942]: 7800 (118.54 pages/sec 118.54 revs/sec)
Nov 8 04:01:13 wikitech-static import-wikitech.sh[26942]: 7900 (118.97 pages/sec 118.97 revs/sec)
Nov 8 04:01:14 wikitech-static import-wikitech.sh[26942]: 8000 (120.00 pages/sec 120.00 revs/sec)
Nov 8 04:01:14 wikitech-static import-wikitech.sh[26942]: 8100 (120.96 pages/sec 120.96 revs/sec)
Nov 8 04:01:14 wikitech-static import-wikitech.sh[26942]: 8200 (121.98 pages/sec 121.98 revs/sec)
Nov 8 04:01:14 wikitech-static import-wikitech.sh[26942]: 8300 (122.85 pages/sec 122.85 revs/sec)
Nov 8 04:01:15 wikitech-static import-wikitech.sh[26942]: 8400 (123.91 pages/sec 123.91 revs/sec)
Nov 8 04:01:15 wikitech-static import-wikitech.sh[26942]: 8500 (124.93 pages/sec 124.93 revs/sec)
Nov 8 04:01:15 wikitech-static import-wikitech.sh[26942]: 8600 (125.96 pages/sec 125.96 revs/sec)
Nov 8 04:01:15 wikitech-static import-wikitech.sh[26942]: 8700 (127.01 pages/sec 127.01 revs/sec)
Nov 8 04:01:16 wikitech-static import-wikitech.sh[26942]: 8800 (127.94 pages/sec 127.94 revs/sec)
Nov 8 04:01:16 wikitech-static import-wikitech.sh[26942]: 8900 (128.84 pages/sec 128.84 revs/sec)
Nov 8 04:01:17 wikitech-static import-wikitech.sh[26942]: 9000 (129.27 pages/sec 129.27 revs/sec)
Nov 8 04:01:17 wikitech-static import-wikitech.sh[26942]: 9100 (130.25 pages/sec 130.25 revs/sec)
Nov 8 04:01:17 wikitech-static import-wikitech.sh[26942]: 9200 (131.21 pages/sec 131.21 revs/sec)
Nov 8 04:01:17 wikitech-static import-wikitech.sh[26942]: 9300 (132.15 pages/sec 132.15 revs/sec)
Nov 8 04:01:18 wikitech-static import-wikitech.sh[26942]: 9400 (132.89 pages/sec 132.89 revs/sec)
Nov 8 04:01:18 wikitech-static import-wikitech.sh[26942]: 9500 (133.77 pages/sec 133.77 revs/sec)
Nov 8 04:01:18 wikitech-static import-wikitech.sh[26942]: 9600 (134.67 pages/sec 134.67 revs/sec)
Nov 8 04:01:24 wikitech-static import-wikitech.sh[26942]: 9700 (125.48 pages/sec 125.48 revs/sec)
Nov 8 04:01:24 wikitech-static import-wikitech.sh[26942]: 9800 (126.35 pages/sec 126.35 revs/sec)
Nov 8 04:01:25 wikitech-static import-wikitech.sh[26942]: 9900 (127.14 pages/sec 127.14 revs/sec)
Nov 8 04:01:25 wikitech-static import-wikitech.sh[26942]: 10000 (128.03 pages/sec 128.03 revs/sec)
Nov 8 04:01:25 wikitech-static import-wikitech.sh[26942]: 10100 (128.92 pages/sec 128.92 revs/sec)
Nov 8 04:01:26 wikitech-static import-wikitech.sh[26942]: 10200 (129.73 pages/sec 129.73 revs/sec)
Nov 8 04:01:26 wikitech-static import-wikitech.sh[26942]: 10300 (130.47 pages/sec 130.47 revs/sec)
Nov 8 04:01:26 wikitech-static import-wikitech.sh[26942]: 10400 (131.32 pages/sec 131.32 revs/sec)
Nov 8 04:01:26 wikitech-static import-wikitech.sh[26942]: 10500 (132.12 pages/sec 132.12 revs/sec)
Nov 8 04:01:27 wikitech-static import-wikitech.sh[26942]: 10600 (132.79 pages/sec 132.79 revs/sec)
Nov 8 04:01:27 wikitech-static import-wikitech.sh[26942]: 10700 (133.70 pages/sec 133.70 revs/sec)
Nov 8 04:01:27 wikitech-static import-wikitech.sh[26942]: 10800 (134.56 pages/sec 134.56 revs/sec)
Nov 8 04:01:27 wikitech-static import-wikitech.sh[26942]: 10900 (135.29 pages/sec 135.29 revs/sec)
Nov 8 04:01:28 wikitech-static import-wikitech.sh[26942]: 11000 (136.10 pages/sec 136.10 revs/sec)
Nov 8 04:01:28 wikitech-static import-wikitech.sh[26942]: 11100 (136.88 pages/sec 136.88 revs/sec)
Nov 8 04:01:28 wikitech-static import-wikitech.sh[26942]: 11200 (137.74 pages/sec 137.74 revs/sec)
Nov 8 04:01:28 wikitech-static import-wikitech.sh[26942]: 11300 (138.52 pages/sec 138.52 revs/sec)
Nov 8 04:01:29 wikitech-static import-wikitech.sh[26942]: 11400 (139.36 pages/sec 139.36 revs/sec)
Nov 8 04:01:29 wikitech-static import-wikitech.sh[26942]: 11500 (140.14 pages/sec 140.14 revs/sec)
Nov 8 04:01:29 wikitech-static import-wikitech.sh[26942]: 11600 (140.95 pages/sec 140.95 revs/sec)
Nov 8 04:01:29 wikitech-static import-wikitech.sh[26942]: 11700 (141.75 pages/sec 141.75 revs/sec)
Nov 8 04:01:30 wikitech-static import-wikitech.sh[26942]: 11800 (142.56 pages/sec 142.56 revs/sec)
Nov 8 04:01:30 wikitech-static import-wikitech.sh[26942]: 11900 (143.27 pages/sec 143.27 revs/sec)
Nov 8 04:01:30 wikitech-static import-wikitech.sh[26942]: 12000 (144.07 pages/sec 144.07 revs/sec)
Nov 8 04:01:30 wikitech-static import-wikitech.sh[26942]: 12100 (144.80 pages/sec 144.80 revs/sec)
Nov 8 04:01:31 wikitech-static import-wikitech.sh[26942]: 12200 (145.28 pages/sec 145.28 revs/sec)
Nov 8 04:01:31 wikitech-static import-wikitech.sh[26942]: 12300 (145.97 pages/sec 145.97 revs/sec)
Nov 8 04:01:32 wikitech-static import-wikitech.sh[26942]: 12400 (146.52 pages/sec 146.52 revs/sec)
Nov 8 04:01:32 wikitech-static import-wikitech.sh[26942]: 12500 (147.22 pages/sec 147.22 revs/sec)
Nov 8 04:01:32 wikitech-static import-wikitech.sh[26942]: 12600 (147.96 pages/sec 147.96 revs/sec)
Nov 8 04:01:32 wikitech-static import-wikitech.sh[26942]: 12700 (148.73 pages/sec 148.73 revs/sec)
Nov 8 04:01:32 wikitech-static import-wikitech.sh[26942]: 12800 (149.53 pages/sec 149.53 revs/sec)
Nov 8 04:01:33 wikitech-static import-wikitech.sh[26942]: 12900 (150.20 pages/sec 150.20 revs/sec)
Nov 8 04:01:33 wikitech-static import-wikitech.sh[26942]: 13000 (150.82 pages/sec 150.82 revs/sec)
Nov 8 04:01:33 wikitech-static import-wikitech.sh[26942]: 13100 (151.57 pages/sec 151.57 revs/sec)
Nov 8 04:01:34 wikitech-static import-wikitech.sh[26942]: 13200 (152.28 pages/sec 152.28 revs/sec)
Nov 8 04:01:34 wikitech-static import-wikitech.sh[26942]: 13300 (152.96 pages/sec 152.96 revs/sec)
Nov 8 04:01:34 wikitech-static import-wikitech.sh[26942]: 13400 (153.59 pages/sec 153.59 revs/sec)
Nov 8 04:01:34 wikitech-static import-wikitech.sh[26942]: 13500 (154.32 pages/sec 154.32 revs/sec)
Nov 8 04:01:35 wikitech-static import-wikitech.sh[26942]: 13600 (155.07 pages/sec 155.07 revs/sec)
Nov 8 04:01:35 wikitech-static import-wikitech.sh[26942]: 13700 (155.66 pages/sec 155.66 revs/sec)
Nov 8 04:01:35 wikitech-static import-wikitech.sh[26942]: 13800 (156.33 pages/sec 156.33 revs/sec)
Nov 8 04:01:36 wikitech-static import-wikitech.sh[26942]: 13900 (156.84 pages/sec 156.84 revs/sec)
Nov 8 04:01:36 wikitech-static import-wikitech.sh[26942]: 14000 (157.40 pages/sec 157.40 revs/sec)
Nov 8 04:01:36 wikitech-static import-wikitech.sh[26942]: 14100 (157.99 pages/sec 157.99 revs/sec)
Nov 8 04:01:36 wikitech-static import-wikitech.sh[26942]: 14200 (158.69 pages/sec 158.69 revs/sec)
Nov 8 04:01:37 wikitech-static import-wikitech.sh[26942]: 14300 (159.28 pages/sec 159.28 revs/sec)
Nov 8 04:01:37 wikitech-static import-wikitech.sh[26942]: 14400 (159.36 pages/sec 159.36 revs/sec)
Nov 8 04:01:38 wikitech-static import-wikitech.sh[26942]: 14500 (159.90 pages/sec 159.90 revs/sec)
Nov 8 04:01:38 wikitech-static import-wikitech.sh[26942]: 14600 (160.20 pages/sec 160.20 revs/sec)
Nov 8 04:01:39 wikitech-static import-wikitech.sh[26942]: 14700 (160.23 pages/sec 160.23 revs/sec)
Nov 8 04:01:39 wikitech-static import-wikitech.sh[26942]: 14800 (160.58 pages/sec 160.58 revs/sec)
Nov 8 04:01:39 wikitech-static import-wikitech.sh[26942]: 14900 (160.96 pages/sec 160.96 revs/sec)
Nov 8 04:01:40 wikitech-static import-wikitech.sh[26942]: 15000 (160.87 pages/sec 160.87 revs/sec)
Nov 8 04:01:44 wikitech-static import-wikitech.sh[26942]: 15100 (155.83 pages/sec 155.83 revs/sec)
Nov 8 04:01:45 wikitech-static import-wikitech.sh[26942]: 15200 (155.69 pages/sec 155.69 revs/sec)
Nov 8 04:01:45 wikitech-static import-wikitech.sh[26942]: 15300 (156.15 pages/sec 156.15 revs/sec)
Nov 8 04:01:45 wikitech-static import-wikitech.sh[26942]: 15400 (156.18 pages/sec 156.18 revs/sec)
Nov 8 04:01:46 wikitech-static import-wikitech.sh[26942]: 15500 (155.61 pages/sec 155.61 revs/sec)
Nov 8 04:01:48 wikitech-static import-wikitech.sh[26942]: 15600 (154.59 pages/sec 154.59 revs/sec)
Nov 8 04:01:49 wikitech-static import-wikitech.sh[26942]: 15700 (154.32 pages/sec 154.32 revs/sec)
Nov 8 04:01:49 wikitech-static import-wikitech.sh[26942]: 15800 (154.34 pages/sec 154.34 revs/sec)
Nov 8 04:01:50 wikitech-static import-wikitech.sh[26942]: 15900 (154.08 pages/sec 154.08 revs/sec)
Nov 8 04:01:52 wikitech-static import-wikitech.sh[26942]: 16000 (152.79 pages/sec 152.79 revs/sec)
Nov 8 04:01:52 wikitech-static import-wikitech.sh[26942]: 16100 (153.29 pages/sec 153.29 revs/sec)
Nov 8 04:01:54 wikitech-static import-wikitech.sh[26942]: 16200 (151.69 pages/sec 151.69 revs/sec)
Nov 8 04:01:54 wikitech-static import-wikitech.sh[26942]: 16300 (151.66 pages/sec 151.66 revs/sec)
Nov 8 04:01:55 wikitech-static import-wikitech.sh[26942]: 16400 (151.70 pages/sec 151.70 revs/sec)
Nov 8 04:01:55 wikitech-static import-wikitech.sh[26942]: 16500 (152.18 pages/sec 152.18 revs/sec)
Nov 8 04:01:56 wikitech-static import-wikitech.sh[26942]: 16600 (152.72 pages/sec 152.72 revs/sec)
Nov 8 04:01:56 wikitech-static import-wikitech.sh[26942]: 16700 (153.12 pages/sec 153.12 revs/sec)
Nov 8 04:01:56 wikitech-static import-wikitech.sh[26942]: 16800 (153.62 pages/sec 153.62 revs/sec)
Nov 8 04:01:57 wikitech-static import-wikitech.sh[26942]: 16900 (154.09 pages/sec 154.09 revs/sec)
Nov 8 04:01:57 wikitech-static import-wikitech.sh[26942]: 17000 (154.25 pages/sec 154.25 revs/sec)
Nov 8 04:01:57 wikitech-static import-wikitech.sh[26942]: 17100 (154.68 pages/sec 154.68 revs/sec)
Nov 8 04:01:58 wikitech-static import-wikitech.sh[26942]: 17200 (155.26 pages/sec 155.26 revs/sec)
Nov 8 04:01:58 wikitech-static import-wikitech.sh[26942]: 17300 (155.81 pages/sec 155.81 revs/sec)
Nov 8 04:01:58 wikitech-static import-wikitech.sh[26942]: 17400 (156.27 pages/sec 156.27 revs/sec)
Nov 8 04:01:58 wikitech-static import-wikitech.sh[26942]: 17500 (156.81 pages/sec 156.81 revs/sec)
Nov 8 04:01:59 wikitech-static import-wikitech.sh[26942]: 17600 (157.06 pages/sec 157.06 revs/sec)
Nov 8 04:01:59 wikitech-static import-wikitech.sh[26942]: 17700 (157.52 pages/sec 157.52 revs/sec)
Nov 8 04:02:00 wikitech-static import-wikitech.sh[26942]: 17800 (157.67 pages/sec 157.67 revs/sec)
Nov 8 04:02:00 wikitech-static import-wikitech.sh[26942]: 17900 (158.14 pages/sec 158.14 revs/sec)
Nov 8 04:02:00 wikitech-static import-wikitech.sh[26942]: 18000 (158.64 pages/sec 158.64 revs/sec)
Nov 8 04:02:01 wikitech-static import-wikitech.sh[26942]: 18100 (159.13 pages/sec 159.13 revs/sec)
Nov 8 04:02:01 wikitech-static import-wikitech.sh[26942]: 18200 (159.59 pages/sec 159.59 revs/sec)
Nov 8 04:02:02 wikitech-static import-wikitech.sh[26942]: 18300 (159.52 pages/sec 159.52 revs/sec)
Nov 8 04:02:02 wikitech-static CRON[27111]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:02:02 wikitech-static CRON[27112]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:02:02 wikitech-static import-wikitech.sh[26942]: 18400 (159.45 pages/sec 159.45 revs/sec)
Nov 8 04:02:03 wikitech-static import-wikitech.sh[26942]: 18500 (159.55 pages/sec 159.55 revs/sec)
Nov 8 04:02:03 wikitech-static import-wikitech.sh[26942]: 18600 (160.01 pages/sec 160.01 revs/sec)
Nov 8 04:02:04 wikitech-static import-wikitech.sh[26942]: 18700 (160.14 pages/sec 160.14 revs/sec)
Nov 8 04:02:05 wikitech-static import-wikitech.sh[26942]: 18800 (159.45 pages/sec 159.45 revs/sec)
Nov 8 04:02:07 wikitech-static import-wikitech.sh[26942]: 18900 (157.45 pages/sec 157.45 revs/sec)
Nov 8 04:02:08 wikitech-static import-wikitech.sh[26942]: 19000 (156.47 pages/sec 156.47 revs/sec)
Nov 8 04:02:10 wikitech-static check_icinga[27114]: 2021-11-08 04:02:10,294 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:02:10 wikitech-static check_icinga[27113]: 2021-11-08 04:02:10,317 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:02:13 wikitech-static check_icinga[27113]: 2021-11-08 04:02:13,823 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:02:14 wikitech-static check_icinga[27114]: 2021-11-08 04:02:14,076 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:04:02 wikitech-static CRON[27202]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:04:02 wikitech-static CRON[27203]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:04:10 wikitech-static check_icinga[27204]: 2021-11-08 04:04:10,131 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:04:10 wikitech-static check_icinga[27205]: 2021-11-08 04:04:10,155 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:04:13 wikitech-static check_icinga[27205]: 2021-11-08 04:04:13,745 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:04:13 wikitech-static check_icinga[27204]: 2021-11-08 04:04:13,791 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:06:02 wikitech-static CRON[27323]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:06:02 wikitech-static CRON[27324]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:06:03 wikitech-static check_icinga[27325]: 2021-11-08 04:06:03,707 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:06:03 wikitech-static check_icinga[27326]: 2021-11-08 04:06:03,716 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:06:06 wikitech-static check_icinga[27326]: 2021-11-08 04:06:06,737 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:06:06 wikitech-static check_icinga[27325]: 2021-11-08 04:06:06,964 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:08:01 wikitech-static CRON[27402]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:08:01 wikitech-static CRON[27403]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:08:04 wikitech-static check_icinga[27404]: 2021-11-08 04:08:04,168 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:08:04 wikitech-static check_icinga[27405]: 2021-11-08 04:08:04,167 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:08:07 wikitech-static check_icinga[27404]: 2021-11-08 04:08:07,358 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:08:07 wikitech-static check_icinga[27405]: 2021-11-08 04:08:07,423 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:09:01 wikitech-static CRON[27450]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 8 04:09:05 wikitech-static systemd[1]: Starting Clean php session files...
Nov 8 04:09:09 wikitech-static systemd[1]: Started Clean php session files.
Nov 8 04:10:01 wikitech-static CRON[27579]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:10:01 wikitech-static CRON[27581]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:10:04 wikitech-static check_icinga[27580]: 2021-11-08 04:10:04,238 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:10:04 wikitech-static check_icinga[27582]: 2021-11-08 04:10:04,240 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:10:07 wikitech-static check_icinga[27580]: 2021-11-08 04:10:07,472 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:10:07 wikitech-static check_icinga[27582]: 2021-11-08 04:10:07,806 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:11:01 wikitech-static CRON[27627]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh)
Nov 8 04:11:03 wikitech-static check_icinga_validate_config[27628]: Valid config, nothing to do.
Nov 8 04:12:01 wikitech-static CRON[27668]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:12:01 wikitech-static CRON[27670]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:12:02 wikitech-static check_icinga[27669]: 2021-11-08 04:12:02,433 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:12:02 wikitech-static check_icinga[27671]: 2021-11-08 04:12:02,435 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:12:05 wikitech-static check_icinga[27669]: 2021-11-08 04:12:05,517 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:12:05 wikitech-static check_icinga[27671]: 2021-11-08 04:12:05,638 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:14:01 wikitech-static CRON[27746]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:14:01 wikitech-static CRON[27747]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:14:03 wikitech-static check_icinga[27748]: 2021-11-08 04:14:03,453 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:14:03 wikitech-static check_icinga[27749]: 2021-11-08 04:14:03,456 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:14:07 wikitech-static check_icinga[27748]: 2021-11-08 04:14:07,312 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:14:07 wikitech-static check_icinga[27749]: 2021-11-08 04:14:07,333 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:16:01 wikitech-static CRON[27825]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:16:01 wikitech-static CRON[27826]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:16:03 wikitech-static check_icinga[27828]: 2021-11-08 04:16:03,589 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:16:03 wikitech-static check_icinga[27827]: 2021-11-08 04:16:03,593 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:16:06 wikitech-static check_icinga[27827]: 2021-11-08 04:16:06,768 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:16:07 wikitech-static check_icinga[27828]: 2021-11-08 04:16:07,073 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:17:01 wikitech-static CRON[27874]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 8 04:18:01 wikitech-static CRON[27908]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:18:01 wikitech-static CRON[27910]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:18:02 wikitech-static check_icinga[27911]: 2021-11-08 04:18:02,344 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:18:02 wikitech-static check_icinga[27909]: 2021-11-08 04:18:02,364 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:18:05 wikitech-static check_icinga[27909]: 2021-11-08 04:18:05,427 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:18:05 wikitech-static check_icinga[27911]: 2021-11-08 04:18:05,478 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:18:25 wikitech-static import-wikitech.sh[26942]: 19100 (17.40 pages/sec 17.40 revs/sec)
Nov 8 04:18:33 wikitech-static import-wikitech.sh[26942]: 19200 (17.35 pages/sec 17.35 revs/sec)
Nov 8 04:18:43 wikitech-static import-wikitech.sh[26942]: 19300 (17.29 pages/sec 17.29 revs/sec)
Nov 8 04:18:51 wikitech-static import-wikitech.sh[26942]: 19400 (17.26 pages/sec 17.26 revs/sec)
Nov 8 04:18:55 wikitech-static import-wikitech.sh[26942]: 19500 (17.28 pages/sec 17.28 revs/sec)
Nov 8 04:18:59 wikitech-static import-wikitech.sh[26942]: 19600 (17.32 pages/sec 17.32 revs/sec)
Nov 8 04:19:02 wikitech-static import-wikitech.sh[26942]: 19700 (17.36 pages/sec 17.36 revs/sec)
Nov 8 04:19:04 wikitech-static import-wikitech.sh[26942]: 19800 (17.41 pages/sec 17.41 revs/sec)
Nov 8 04:19:07 wikitech-static import-wikitech.sh[26942]: 19900 (17.45 pages/sec 17.45 revs/sec)
Nov 8 04:19:25 wikitech-static import-wikitech.sh[26942]: 20000 (17.28 pages/sec 17.28 revs/sec)
Nov 8 04:19:29 wikitech-static import-wikitech.sh[26942]: 20100 (17.30 pages/sec 17.30 revs/sec)
Nov 8 04:19:32 wikitech-static import-wikitech.sh[26942]: 20200 (17.34 pages/sec 17.34 revs/sec)
Nov 8 04:19:36 wikitech-static import-wikitech.sh[26942]: 20300 (17.36 pages/sec 17.36 revs/sec)
Nov 8 04:19:40 wikitech-static import-wikitech.sh[26942]: 20400 (17.39 pages/sec 17.39 revs/sec)
Nov 8 04:19:42 wikitech-static import-wikitech.sh[26942]: 20500 (17.45 pages/sec 17.45 revs/sec)
Nov 8 04:19:45 wikitech-static import-wikitech.sh[26942]: 20600 (17.49 pages/sec 17.49 revs/sec)
Nov 8 04:19:47 wikitech-static import-wikitech.sh[26942]: 20700 (17.55 pages/sec 17.55 revs/sec)
Nov 8 04:19:48 wikitech-static import-wikitech.sh[26942]: 20800 (17.61 pages/sec 17.61 revs/sec)
Nov 8 04:19:51 wikitech-static import-wikitech.sh[26942]: 20900 (17.64 pages/sec 17.64 revs/sec)
Nov 8 04:19:54 wikitech-static import-wikitech.sh[26942]: 21000 (17.70 pages/sec 17.70 revs/sec)
Nov 8 04:19:54 wikitech-static import-wikitech.sh[26942]: 21100 (17.77 pages/sec 17.77 revs/sec)
Nov 8 04:19:55 wikitech-static import-wikitech.sh[26942]: 21200 (17.85 pages/sec 17.85 revs/sec)
Nov 8 04:19:55 wikitech-static import-wikitech.sh[26942]: 21300 (17.93 pages/sec 17.93 revs/sec)
Nov 8 04:19:55 wikitech-static import-wikitech.sh[26942]: 21400 (18.00 pages/sec 18.00 revs/sec)
Nov 8 04:19:57 wikitech-static import-wikitech.sh[26942]: 21500 (18.07 pages/sec 18.07 revs/sec)
Nov 8 04:19:58 wikitech-static import-wikitech.sh[26942]: 21600 (18.13 pages/sec 18.13 revs/sec)
Nov 8 04:20:00 wikitech-static import-wikitech.sh[26942]: 21700 (18.19 pages/sec 18.19 revs/sec)
Nov 8 04:20:01 wikitech-static import-wikitech.sh[26942]: 21800 (18.26 pages/sec 18.26 revs/sec)
Nov 8 04:20:01 wikitech-static CRON[27987]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:20:01 wikitech-static CRON[27988]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:20:03 wikitech-static import-wikitech.sh[26942]: 21900 (18.31 pages/sec 18.31 revs/sec)
Nov 8 04:20:05 wikitech-static import-wikitech.sh[26942]: 22000 (18.36 pages/sec 18.36 revs/sec)
Nov 8 04:20:07 wikitech-static import-wikitech.sh[26942]: 22100 (18.41 pages/sec 18.41 revs/sec)
Nov 8 04:20:09 wikitech-static check_icinga[27989]: 2021-11-08 04:20:09,308 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:20:09 wikitech-static check_icinga[27990]: 2021-11-08 04:20:09,310 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:20:09 wikitech-static import-wikitech.sh[26942]: 22200 (18.47 pages/sec 18.47 revs/sec)
Nov 8 04:20:10 wikitech-static import-wikitech.sh[26942]: 22300 (18.53 pages/sec 18.53 revs/sec)
Nov 8 04:20:11 wikitech-static import-wikitech.sh[26942]: 22400 (18.61 pages/sec 18.61 revs/sec)
Nov 8 04:20:11 wikitech-static import-wikitech.sh[26942]: 22500 (18.68 pages/sec 18.68 revs/sec)
Nov 8 04:20:12 wikitech-static import-wikitech.sh[26942]: 22600 (18.75 pages/sec 18.75 revs/sec)
Nov 8 04:20:12 wikitech-static check_icinga[27989]: 2021-11-08 04:20:12,957 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:20:13 wikitech-static check_icinga[27990]: 2021-11-08 04:20:13,207 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:20:13 wikitech-static import-wikitech.sh[26942]: 22700 (18.82 pages/sec 18.82 revs/sec)
Nov 8 04:20:13 wikitech-static import-wikitech.sh[26942]: 22800 (18.90 pages/sec 18.90 revs/sec)
Nov 8 04:20:14 wikitech-static import-wikitech.sh[26942]: 22900 (18.98 pages/sec 18.98 revs/sec)
Nov 8 04:20:14 wikitech-static import-wikitech.sh[26942]: 23000 (19.06 pages/sec 19.06 revs/sec)
Nov 8 04:20:14 wikitech-static import-wikitech.sh[26942]: 23100 (19.13 pages/sec 19.13 revs/sec)
Nov 8 04:20:15 wikitech-static import-wikitech.sh[26942]: 23200 (19.20 pages/sec 19.20 revs/sec)
Nov 8 04:20:16 wikitech-static import-wikitech.sh[26942]: 23300 (19.27 pages/sec 19.27 revs/sec)
Nov 8 04:20:16 wikitech-static import-wikitech.sh[26942]: 23400 (19.35 pages/sec 19.35 revs/sec)
Nov 8 04:20:17 wikitech-static import-wikitech.sh[26942]: 23500 (19.42 pages/sec 19.42 revs/sec)
Nov 8 04:20:17 wikitech-static import-wikitech.sh[26942]: 23600 (19.50 pages/sec 19.50 revs/sec)
Nov 8 04:20:18 wikitech-static import-wikitech.sh[26942]: 23700 (19.57 pages/sec 19.57 revs/sec)
Nov 8 04:20:19 wikitech-static import-wikitech.sh[26942]: 23800 (19.64 pages/sec 19.64 revs/sec)
Nov 8 04:20:19 wikitech-static import-wikitech.sh[26942]: 23900 (19.72 pages/sec 19.72 revs/sec)
Nov 8 04:20:19 wikitech-static import-wikitech.sh[26942]: 24000 (19.79 pages/sec 19.79 revs/sec)
Nov 8 04:20:20 wikitech-static import-wikitech.sh[26942]: 24100 (19.87 pages/sec 19.87 revs/sec)
Nov 8 04:20:37 wikitech-static import-wikitech.sh[26942]: Done!
Nov 8 04:20:37 wikitech-static import-wikitech.sh[26942]: You might want to run rebuildrecentchanges.php to regenerate RecentChanges,
Nov 8 04:20:37 wikitech-static import-wikitech.sh[26942]: and initSiteStats.php to update page and revision counts
Nov 8 04:20:49 wikitech-static import-wikitech.sh[26942]: 100 (25.31 pages/sec 25.31 revs/sec)
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: 200 (40.81 pages/sec 40.81 revs/sec)
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: MWException from line 974 of /srv/mediawiki/w/includes/import/WikiImporter.php: Missing text field in import.
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #0 /srv/mediawiki/w/includes/import/WikiImporter.php(1134): WikiImporter->makeContent(Object(Title), '830', Array)
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #1 /srv/mediawiki/w/includes/import/WikiImporter.php(1111): WikiImporter->processUpload(Array, Array)
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #2 /srv/mediawiki/w/includes/import/WikiImporter.php(863): WikiImporter->handleUpload(Array)
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #3 /srv/mediawiki/w/includes/import/WikiImporter.php(678): WikiImporter->handlePage()
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #4 /srv/mediawiki/w/maintenance/importDump.php(353): WikiImporter->doImport()
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #5 /srv/mediawiki/w/maintenance/importDump.php(286): BackupReader->importFromHandle(Resource id #741)
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #6 /srv/mediawiki/w/maintenance/importDump.php(130): BackupReader->importFromFile('compress.zlib:/...')
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #7 /srv/mediawiki/w/maintenance/doMaintenance.php(112): BackupReader->execute()
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #8 /srv/mediawiki/w/maintenance/importDump.php(358): require_once('/srv/mediawiki/...')
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: #9 {main}
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: Rebuilding $wgRCMaxAge=7776000 seconds (90 days)
Nov 8 04:20:50 wikitech-static import-wikitech.sh[26942]: Clearing recentchanges table for time range...
Nov 8 04:20:59 wikitech-static import-wikitech.sh[26942]: Loading from page and revision tables...
Nov 8 04:21:02 wikitech-static import-wikitech.sh[26942]: Inserting from page and revision tables...
Nov 8 04:22:01 wikitech-static CRON[28152]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:22:01 wikitech-static CRON[28153]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:22:02 wikitech-static check_icinga[28155]: 2021-11-08 04:22:02,712 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:22:02 wikitech-static check_icinga[28154]: 2021-11-08 04:22:02,729 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:22:05 wikitech-static check_icinga[28154]: 2021-11-08 04:22:05,572 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:22:05 wikitech-static check_icinga[28155]: 2021-11-08 04:22:05,862 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:22:19 wikitech-static import-wikitech.sh[26942]: Updating links and size differences...
Nov 8 04:22:43 wikitech-static import-wikitech.sh[26942]: Loading from user and logging tables...
Nov 8 04:22:43 wikitech-static import-wikitech.sh[26942]: Flagging bot account edits...
Nov 8 04:22:44 wikitech-static import-wikitech.sh[26942]: Flagging auto-patrolled edits...
Nov 8 04:22:44 wikitech-static import-wikitech.sh[26942]: Removing duplicate revision and logging entries...
Nov 8 04:22:44 wikitech-static import-wikitech.sh[26942]: Deleting feed timestamps.
Nov 8 04:22:44 wikitech-static import-wikitech.sh[26942]: Done.
Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: ERROR:root:Failed to get db server for wikitech
Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: last image dump for wikitech was: never
Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: running command: /usr/bin/php /srv/mediawiki/w/maintenance/getConfiguration.php --wiki=wikitech --format=json --regex=wgDBadminuser
Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: running command: /usr/bin/php /srv/mediawiki/w/maintenance/getConfiguration.php --wiki=wikitech --format=json --regex=wgDBuser
Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: running command: /usr/bin/php /srv/mediawiki/w/maintenance/getConfiguration.php --wiki=wikitech --format=json --regex=wgDBadminpassword
Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: running command: /usr/bin/php /srv/mediawiki/w/maintenance/getConfiguration.php --wiki=wikitech --format=json --regex=wgDBpassword
Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: db credentials acquired
Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: base url for image retrieval is https://upload.wikimedia.org/wikipedia/labs
Nov 8 04:23:17 wikitech-static import-wikitech.sh[26942]: running command /usr/bin/php /srv/mediawiki/w/maintenance/getSlaveServer.php --wiki=wikitech --group=dump
Nov 8 04:23:21 wikitech-static import-wikitech.sh[26942]: Reloading Apache httpd web server: apache2.
Nov 8 04:23:21 wikitech-static systemd[1]: Stopping memcached daemon...
Nov 8 04:23:21 wikitech-static systemd-memcached-wrapper[27630]: Signal handled: Terminated.
Nov 8 04:23:21 wikitech-static systemd[1]: Stopped memcached daemon.
Nov 8 04:23:21 wikitech-static systemd[1]: Started memcached daemon.
Nov 8 04:24:01 wikitech-static CRON[28285]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:24:01 wikitech-static CRON[28287]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:24:02 wikitech-static check_icinga[28286]: 2021-11-08 04:24:02,814 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:24:02 wikitech-static check_icinga[28288]: 2021-11-08 04:24:02,818 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:24:05 wikitech-static check_icinga[28286]: 2021-11-08 04:24:05,898 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:24:06 wikitech-static check_icinga[28288]: 2021-11-08 04:24:06,081 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:26:01 wikitech-static CRON[28442]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:26:01 wikitech-static CRON[28444]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:26:02 wikitech-static check_icinga[28445]: 2021-11-08 04:26:02,324 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:26:02 wikitech-static check_icinga[28443]: 2021-11-08 04:26:02,400 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:26:05 wikitech-static check_icinga[28445]: 2021-11-08 04:26:05,423 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:26:05 wikitech-static check_icinga[28443]: 2021-11-08 04:26:05,523 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:28:01 wikitech-static CRON[28519]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:28:01 wikitech-static CRON[28521]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:28:02 wikitech-static check_icinga[28520]: 2021-11-08 04:28:02,914 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:28:02 wikitech-static check_icinga[28522]: 2021-11-08 04:28:02,947 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:28:06 wikitech-static check_icinga[28522]: 2021-11-08 04:28:06,068 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:28:06 wikitech-static check_icinga[28520]: 2021-11-08 04:28:06,150 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:30:01 wikitech-static CRON[28598]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:30:01 wikitech-static CRON[28600]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:30:02 wikitech-static check_icinga[28601]: 2021-11-08 04:30:02,720 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:30:02 wikitech-static check_icinga[28599]: 2021-11-08 04:30:02,724 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:30:05 wikitech-static check_icinga[28599]: 2021-11-08 04:30:05,666 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:30:05 wikitech-static check_icinga[28601]: 2021-11-08 04:30:05,922 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:32:02 wikitech-static CRON[28685]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:32:02 wikitech-static CRON[28687]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:32:03 wikitech-static check_icinga[28686]: 2021-11-08 04:32:03,093 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:32:03 wikitech-static check_icinga[28688]: 2021-11-08 04:32:03,100 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:32:06 wikitech-static check_icinga[28688]: 2021-11-08 04:32:06,058 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:32:06 wikitech-static check_icinga[28686]: 2021-11-08 04:32:06,140 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:34:01 wikitech-static CRON[28760]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:34:01 wikitech-static CRON[28762]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:34:02 wikitech-static check_icinga[28761]: 2021-11-08 04:34:02,393 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:34:02 wikitech-static check_icinga[28763]: 2021-11-08 04:34:02,390 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:34:03 wikitech-static check_icinga[28761]: 2021-11-08 04:34:03,784 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ['Notifications Enabled? MISSING_KEY (expected NO)', 'Event Handlers Enabled? MISSING_KEY (expected No)', "Last External Command Check: MISSING_KEY (expected failed to calculate expected value: time data 'MISSING_KEY' does not match format '%Y-%m-%d %H:%M:%S')", 'Passive Service Checks Being Accepted? MISSING_KEY (expected YES)', 'Service Checks Being Executed? MISSING_KEY (expected YES)', 'Passive Host Checks Being Accepted? MISSING_KEY (expected YES)']
Nov 8 04:34:05 wikitech-static check_icinga[28763]: 2021-11-08 04:34:05,539 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:34:13 wikitech-static check_icinga[28761]: 2021-11-08 04:34:13,793 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:34:16 wikitech-static check_icinga[28761]: 2021-11-08 04:34:16,791 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:36:02 wikitech-static CRON[29000]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:36:02 wikitech-static CRON[29001]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:36:13 wikitech-static check_icinga[29003]: 2021-11-08 04:36:12,905 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:36:13 wikitech-static check_icinga[29002]: 2021-11-08 04:36:12,909 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:36:16 wikitech-static check_icinga[29002]: 2021-11-08 04:36:16,527 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:36:16 wikitech-static check_icinga[29003]: 2021-11-08 04:36:16,739 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:38:03 wikitech-static CRON[29084]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:38:03 wikitech-static CRON[29085]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:39:12 wikitech-static CRON[29140]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 8 04:39:16 wikitech-static systemd[1]: Starting Clean php session files...
Nov 8 04:40:00 wikitech-static check_icinga[29086]: 2021-11-08 04:40:00,028 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:40:00 wikitech-static check_icinga[29087]: 2021-11-08 04:39:59,994 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:40:04 wikitech-static CRON[29186]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:40:04 wikitech-static CRON[29185]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:40:09 wikitech-static check_icinga[29086]: 2021-11-08 04:40:09,251 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:40:09 wikitech-static check_icinga[29087]: 2021-11-08 04:40:09,915 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:40:15 wikitech-static systemd[1]: Started Clean php session files.
Nov 8 04:41:17 wikitech-static check_icinga[29188]: 2021-11-08 04:41:16,773 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 04:41:20 wikitech-static check_icinga[29187]: 2021-11-08 04:41:16,774 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 04:41:25 wikitech-static check_icinga[29187]: 2021-11-08 04:41:25,025 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 04:41:25 wikitech-static check_icinga[29188]: 2021-11-08 04:41:25,030 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 04:42:09 wikitech-static CRON[29349]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:42:09 wikitech-static CRON[29350]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:44:24 wikitech-static CRON[29406]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:44:24 wikitech-static CRON[29407]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:46:26 wikitech-static CRON[29458]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:46:26 wikitech-static CRON[29457]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:49:21 wikitech-static CRON[29491]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:49:28 wikitech-static CRON[29492]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:52:29 wikitech-static CRON[29522]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:53:27 wikitech-static CRON[29523]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:54:29 wikitech-static sshd[785]: /usr/sbin/sshd: error while loading shared libraries: libgcrypt.so.20: failed to map segment from shared object
Nov 8 04:55:00 wikitech-static CRON[29507]: (CRON) info (No MTA installed, discarding output)
Nov 8 04:57:35 wikitech-static CRON[29541]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 04:58:03 wikitech-static CRON[29542]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 04:58:31 wikitech-static cron[669]: Module is unknown
Nov 8 04:58:53 wikitech-static cron[669]: (CRON) error (can't fork)
Nov 8 04:58:55 wikitech-static kernel: [60933412.339095] check_icinga[29461]: segfault at 1dcb0 ip 000000000001dcb0 sp 00007ffcd0dbd6c8 error 14 in python3.5[558e772b1000+3f0000]
Nov 8 04:58:56 wikitech-static CRON[29533]: (CRON) info (No MTA installed, discarding output)
Nov 8 04:58:56 wikitech-static CRON[29532]: (CRON) info (No MTA installed, discarding output)
Nov 8 04:59:01 wikitech-static cron[669]: (CRON) error (can't fork)
Nov 8 04:59:01 wikitech-static cron[669]: (CRON) error (can't fork)
Nov 8 04:59:01 wikitech-static cron[669]: Authentication failure
Nov 8 04:59:03 wikitech-static CRON[29547]: Module is unknown
Nov 8 04:59:03 wikitech-static CRON[29454]: (CRON) info (No MTA installed, discarding output)
Nov 8 04:59:03 wikitech-static CRON[29557]: Authentication failure
Nov 8 04:59:05 wikitech-static CRON[29567]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 05:01:38 wikitech-static CRON[29585]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 05:01:38 wikitech-static CRON[29586]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 05:02:18 wikitech-static CRON[29602]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 05:02:18 wikitech-static CRON[29603]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 05:02:20 wikitech-static check_icinga[29355]: 2021-11-08 05:02:17,374 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 05:02:20 wikitech-static check_icinga[29356]: 2021-11-08 05:02:17,320 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 05:04:05 wikitech-static check_icinga[29356]: 2021-11-08 05:04:02,881 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ["('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))"]
Nov 8 05:04:06 wikitech-static check_icinga[29355]: 2021-11-08 05:04:03,826 [ERROR] Check for host alert1001.wikimedia.org (1/3) failed: ["('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))"]
Nov 8 05:04:18 wikitech-static check_icinga[29356]: 2021-11-08 05:04:18,217 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 05:04:19 wikitech-static check_icinga[29355]: 2021-11-08 05:04:19,433 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 05:04:39 wikitech-static CRON[29617]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 05:04:39 wikitech-static CRON[29618]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 05:05:06 wikitech-static check_icinga[29355]: 2021-11-08 05:05:02,357 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 05:05:06 wikitech-static check_icinga[29356]: 2021-11-08 05:05:02,357 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 05:06:35 wikitech-static CRON[29636]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 05:06:37 wikitech-static CRON[29637]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 05:08:18 wikitech-static CRON[29646]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 05:08:18 wikitech-static CRON[29647]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 05:09:27 wikitech-static systemd[1]: Starting Clean php session files...
Nov 8 05:09:51 wikitech-static CRON[29667]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 8 05:10:07 wikitech-static CRON[29675]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 05:10:07 wikitech-static CRON[29676]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 05:10:11 wikitech-static check_icinga[29493]: 2021-11-08 05:10:11,014 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 05:10:13 wikitech-static check_icinga[29527]: 2021-11-08 05:10:11,039 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 05:10:13 wikitech-static check_icinga[29411]: 2021-11-08 05:10:11,437 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 05:10:13 wikitech-static check_icinga[29460]: 2021-11-08 05:10:11,360 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 05:10:13 wikitech-static check_icinga[29412]: 2021-11-08 05:10:11,222 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 05:10:13 wikitech-static check_icinga[29494]: 2021-11-08 05:10:11,109 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 05:10:13 wikitech-static check_icinga[29587]: 2021-11-08 05:10:10,983 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 05:11:57 wikitech-static check_icinga[29494]: 2021-11-08 05:11:54,044 [ERROR] Check for host alert2001.wikimedia.org (1/3) failed: ["('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))"]
Nov 8 05:51:12 wikitech-static kernel: [60936548.020519] systemd invoked oom-killer: gfp_mask=0x24201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=0, order=0, oom_score_adj=0
Nov 8 05:51:14 wikitech-static kernel: [60936548.020522] systemd cpuset=/ mems_allowed=0
Nov 8 05:51:14 wikitech-static kernel: [60936548.020528] CPU: 0 PID: 1 Comm: systemd Not tainted 4.9.0-11-amd64 #1 Debian 4.9.189-3+deb9u2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020530] Hardware name: Xen HVM domU, BIOS 4.1.5 11/28/2013
Nov 8 05:51:14 wikitech-static kernel: [60936548.020533] 0000000000000000 ffffffff93936404 ffffaf52c01a3c10 ffff944999270ec0
Nov 8 05:51:14 wikitech-static kernel: [60936548.020537] ffffffff93809690 0000000000000000 0000000000000000 0000000c00000000
Nov 8 05:51:14 wikitech-static kernel: [60936548.020540] ffff9449bdaeed80 ffffffff9378d207 0000004200000000 0000000000000001
Nov 8 05:51:14 wikitech-static kernel: [60936548.020543] Call Trace:
Nov 8 05:51:14 wikitech-static kernel: [60936548.020551] [<ffffffff93936404>] ? dump_stack+0x5c/0x78
Nov 8 05:51:14 wikitech-static kernel: [60936548.020555] [<ffffffff93809690>] ? dump_header+0x78/0x1fd
Nov 8 05:51:14 wikitech-static kernel: [60936548.020558] [<ffffffff9378d207>] ? get_page_from_freelist+0x3f7/0xb20
Nov 8 05:51:14 wikitech-static kernel: [60936548.020561] [<ffffffff9378917a>] ? oom_kill_process+0x22a/0x3f0
Nov 8 05:51:14 wikitech-static kernel: [60936548.020564] [<ffffffff93789611>] ? out_of_memory+0x111/0x470
Nov 8 05:51:14 wikitech-static kernel: [60936548.020567] [<ffffffff9378e6ef>] ? __alloc_pages_slowpath+0xa1f/0xb30
Nov 8 05:51:14 wikitech-static kernel: [60936548.020570] [<ffffffff9378ea01>] ? __alloc_pages_nodemask+0x201/0x260
Nov 8 05:51:14 wikitech-static kernel: [60936548.020573] [<ffffffff937e0651>] ? alloc_pages_current+0x91/0x140
Nov 8 05:51:14 wikitech-static kernel: [60936548.020575] [<ffffffff937875a6>] ? filemap_fault+0x326/0x5d0
Nov 8 05:51:14 wikitech-static kernel: [60936548.020610] [<ffffffffc04d2ac1>] ? ext4_filemap_fault+0x31/0x50 [ext4]
Nov 8 05:51:14 wikitech-static kernel: [60936548.020613] [<ffffffff937b8979>] ? __do_fault+0xa9/0x1c0
Nov 8 05:51:14 wikitech-static kernel: [60936548.020616] [<ffffffff937bcb74>] ? handle_mm_fault+0xda4/0x1350
Nov 8 05:51:14 wikitech-static kernel: [60936548.020619] [<ffffffff938569d2>] ? ep_poll+0x192/0x350
Nov 8 05:51:14 wikitech-static kernel: [60936548.020622] [<ffffffff93663395>] ? __do_page_fault+0x255/0x4f0
Nov 8 05:51:14 wikitech-static kernel: [60936548.020625] [<ffffffff936ee0ad>] ? posix_ktime_get_ts+0xd/0x10
Nov 8 05:51:14 wikitech-static kernel: [60936548.020629] [<ffffffff93c1f7e8>] ? page_fault+0x28/0x30
Nov 8 05:51:14 wikitech-static kernel: [60936548.020631] Mem-Info:
Nov 8 05:51:14 wikitech-static kernel: [60936548.020636] active_anon:87514 inactive_anon:87578 isolated_anon:32
Nov 8 05:51:14 wikitech-static kernel: [60936548.020636] active_file:501 inactive_file:646 isolated_file:0
Nov 8 05:51:14 wikitech-static kernel: [60936548.020636] unevictable:0 dirty:0 writeback:1 unstable:0
Nov 8 05:51:14 wikitech-static kernel: [60936548.020636] slab_reclaimable:2835 slab_unreclaimable:12606
Nov 8 05:51:14 wikitech-static kernel: [60936548.020636] mapped:2791 shmem:6690 pagetables:11307 bounce:0
Nov 8 05:51:14 wikitech-static kernel: [60936548.020636] free:12214 free_pcp:14 free_cma:0
Nov 8 05:51:14 wikitech-static kernel: [60936548.020641] Node 0 active_anon:350056kB inactive_anon:350312kB active_file:2004kB inactive_file:2584kB unevictable:0kB isolated(anon):128kB isolated(file):0kB mapped:11164kB dirty:0kB writeback:4kB shmem:26760kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:42525 all_unreclaimable? yes
Nov 8 05:51:14 wikitech-static kernel: [60936548.020642] Node 0 DMA free:4524kB min:720kB low:900kB high:1080kB active_anon:3980kB inactive_anon:3864kB active_file:4kB inactive_file:12kB unevictable:0kB writepending:0kB present:15988kB managed:15904kB mlocked:0kB slab_reclaimable:40kB slab_unreclaimable:612kB kernel_stack:64kB pagetables:468kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Nov 8 05:51:14 wikitech-static kernel: [60936548.020649] lowmem_reserve[]: 0 951 951 951 951
Nov 8 05:51:14 wikitech-static kernel: [60936548.020653] Node 0 DMA32 free:44332kB min:44332kB low:55412kB high:66492kB active_anon:346076kB inactive_anon:346448kB active_file:2000kB inactive_file:2576kB unevictable:0kB writepending:4kB present:1028096kB managed:998436kB mlocked:0kB slab_reclaimable:11300kB slab_unreclaimable:49812kB kernel_stack:4240kB pagetables:44760kB bounce:0kB free_pcp:56kB local_pcp:56kB free_cma:0kB
Nov 8 05:51:14 wikitech-static kernel: [60936548.020658] lowmem_reserve[]: 0 0 0 0 0
Nov 8 05:51:14 wikitech-static kernel: [60936548.020662] Node 0 DMA: 87*4kB (M) 118*8kB (UM) 70*16kB (M) 8*32kB (UM) 11*64kB (UM) 7*128kB (UM) 1*256kB (U) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4524kB
Nov 8 05:51:14 wikitech-static kernel: [60936548.020674] Node 0 DMA32: 9214*4kB (UME) 898*8kB (UME) 19*16kB (UM) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44344kB
Nov 8 05:51:14 wikitech-static kernel: [60936548.020685] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Nov 8 05:51:14 wikitech-static kernel: [60936548.020687] 8723 total pagecache pages
Nov 8 05:51:14 wikitech-static kernel: [60936548.020689] 873 pages in swap cache
Nov 8 05:51:14 wikitech-static kernel: [60936548.020690] Swap cache stats: add 20773779, delete 20772906, find 85139396/90941849
Nov 8 05:51:14 wikitech-static kernel: [60936548.020692] Free swap = 0kB
Nov 8 05:51:14 wikitech-static kernel: [60936548.020693] Total swap = 1048572kB
Nov 8 05:51:14 wikitech-static kernel: [60936548.020694] 261021 pages RAM
Nov 8 05:51:14 wikitech-static kernel: [60936548.020696] 0 pages HighMem/MovableOnly
Nov 8 05:51:14 wikitech-static kernel: [60936548.020697] 7436 pages reserved
Nov 8 05:51:14 wikitech-static kernel: [60936548.020698] 0 pages hwpoisoned
Nov 8 05:51:14 wikitech-static kernel: [60936548.020699] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
Nov 8 05:51:14 wikitech-static kernel: [60936548.020704] [ 639] 106 639 11279 43 28 3 94 -900 dbus-daemon
Nov 8 05:51:14 wikitech-static kernel: [60936548.020707] [ 652] 0 652 1051 0 8 3 33 0 acpid
Nov 8 05:51:14 wikitech-static kernel: [60936548.020710] [ 669] 0 669 7416 28 19 3 43 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020713] [ 674] 0 674 11814 32 28 3 324 0 systemd-logind
Nov 8 05:51:14 wikitech-static kernel: [60936548.020715] [ 688] 0 688 3631 0 12 3 39 0 agetty
Nov 8 05:51:14 wikitech-static kernel: [60936548.020718] [ 703] 0 703 1069 0 8 3 28 0 sshguard-journa
Nov 8 05:51:14 wikitech-static kernel: [60936548.020722] [ 706] 0 706 12724 15 29 4 96 0 journalctl
Nov 8 05:51:14 wikitech-static kernel: [60936548.020724] [ 785] 0 785 17489 27 39 3 166 -1000 sshd
Nov 8 05:51:14 wikitech-static kernel: [60936548.020727] [ 907] 0 907 35210 83 35 3 1578 0 nova-agent
Nov 8 05:51:14 wikitech-static kernel: [60936548.020730] [26102] 0 26102 14101 0 30 3 206 0 systemd
Nov 8 05:51:14 wikitech-static kernel: [60936548.020732] [26103] 0 26103 57519 0 48 3 438 0 (sd-pam)
Nov 8 05:51:14 wikitech-static kernel: [60936548.020735] [ 2724] 0 2724 62561 40 30 4 366 0 rsyslogd
Nov 8 05:51:14 wikitech-static kernel: [60936548.020737] [ 3273] 107 3273 177141 9001 213 4 55042 0 mysqld
Nov 8 05:51:14 wikitech-static kernel: [60936548.020740] [14717] 0 14717 31701 0 32 3 960 0 dirmngr
Nov 8 05:51:14 wikitech-static kernel: [60936548.020743] [15062] 0 15062 31701 0 32 3 959 0 dirmngr
Nov 8 05:51:14 wikitech-static kernel: [60936548.020745] [15381] 0 15381 31701 0 33 3 960 0 dirmngr
Nov 8 05:51:14 wikitech-static kernel: [60936548.020748] [15452] 0 15452 31701 0 32 3 959 0 dirmngr
Nov 8 05:51:14 wikitech-static kernel: [60936548.020750] [15506] 0 15506 31699 0 31 3 1009 0 dirmngr
Nov 8 05:51:14 wikitech-static kernel: [60936548.020753] [16228] 0 16228 31701 0 30 3 959 0 dirmngr
Nov 8 05:51:14 wikitech-static kernel: [60936548.020755] [16325] 0 16325 31701 0 31 3 960 0 dirmngr
Nov 8 05:51:14 wikitech-static kernel: [60936548.020758] [16447] 0 16447 31701 0 31 3 960 0 dirmngr
Nov 8 05:51:14 wikitech-static kernel: [60936548.020760] [16575] 0 16575 31701 0 32 3 959 0 dirmngr
Nov 8 05:51:14 wikitech-static kernel: [60936548.020763] [16905] 0 16905 31699 0 33 4 958 0 dirmngr
Nov 8 05:51:14 wikitech-static kernel: [60936548.020765] [17027] 0 17027 31699 0 32 3 959 0 dirmngr
Nov 8 05:51:14 wikitech-static kernel: [60936548.020768] [17157] 0 17157 31701 0 32 3 959 0 dirmngr
Nov 8 05:51:14 wikitech-static kernel: [60936548.020770] [17475] 0 17475 31699 0 32 3 958 0 dirmngr
Nov 8 05:51:14 wikitech-static kernel: [60936548.020773] [ 1213] 100 1213 31821 1 32 3 132 0 systemd-timesyn
Nov 8 05:51:14 wikitech-static kernel: [60936548.020776] [17211] 0 17211 11310 12 23 3 90 -1000 systemd-udevd
Nov 8 05:51:14 wikitech-static kernel: [60936548.020778] [15128] 0 15128 116636 130 151 3 1795 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020781] [28241] 108 28241 92324 944 45 4 7894 0 memcached
Nov 8 05:51:14 wikitech-static kernel: [60936548.020784] [28248] 33 28248 152271 4664 206 4 14014 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020786] [28249] 33 28249 172155 10151 245 4 29173 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020789] [28250] 33 28250 140714 4333 184 4 3823 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020791] [28251] 33 28251 172221 10180 246 4 29277 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020794] [28252] 33 28252 158768 6558 220 4 18787 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020797] [28253] 33 28253 166207 9128 233 4 23874 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020799] [28411] 33 28411 119139 3125 173 3 2240 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020802] [28439] 33 28439 155002 5339 212 4 16703 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020804] [28768] 33 28768 118447 1687 172 3 2097 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020807] [28817] 33 28817 175595 13369 238 4 19314 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020809] [29050] 33 29050 137371 2755 177 4 1938 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020812] [29095] 33 29095 158268 1582 185 4 4844 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020814] [29097] 33 29097 118891 3111 170 3 1991 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020817] [29169] 33 29169 161532 4034 191 4 6464 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020819] [29301] 33 29301 166392 4508 201 4 10741 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020821] [29365] 33 29365 135092 1486 175 4 2007 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020824] [29391] 33 29391 134110 1337 169 4 1849 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020827] [29393] 33 29393 135061 2555 162 4 2052 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020829] [29418] 33 29418 135070 2628 170 4 1923 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020832] [29419] 33 29419 135020 3041 171 4 1892 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020834] [29508] 0 29508 12206 19 28 3 86 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020837] [29523] 0 29523 1069 0 7 3 21 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020839] [29527] 0 29527 39825 6411 57 4 306 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020842] [29589] 33 29589 118799 3159 170 3 1862 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020845] [29600] 0 29600 12206 24 28 3 80 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020847] [29601] 0 29601 12206 18 28 3 86 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020850] [29602] 0 29602 1069 0 8 3 21 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020852] [29603] 0 29603 1069 0 8 3 22 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020855] [29604] 0 29604 21598 4140 47 3 989 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020858] [29605] 0 29605 21590 4044 46 3 1080 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020860] [29606] 33 29606 135088 2823 170 4 1952 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020863] [29614] 0 29614 12206 39 28 3 65 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020865] [29615] 0 29615 12206 38 28 3 66 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020868] [29617] 0 29617 1069 0 7 3 16 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020871] [29618] 0 29618 1069 0 8 3 16 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020873] [29619] 0 29619 38077 3863 48 3 984 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020876] [29620] 0 29620 38110 3958 49 4 900 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020878] [29631] 0 29631 12206 33 28 3 71 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020881] [29632] 0 29632 12206 38 28 3 66 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020883] [29636] 0 29636 1069 17 8 3 0 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020886] [29637] 0 29637 1069 15 9 3 1 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020889] [29638] 0 29638 36555 3643 42 3 1005 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020891] [29639] 0 29639 36141 3608 46 3 1006 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020894] [29641] 33 29641 117775 1675 160 3 1709 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020896] [29642] 33 29642 118156 2788 161 3 1713 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020899] [29644] 0 29644 12206 44 28 3 60 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020901] [29645] 0 29645 12206 47 28 3 57 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020904] [29646] 0 29646 1069 8 8 3 9 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020906] [29647] 0 29647 1069 6 8 3 11 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020909] [29649] 0 29649 36392 3987 45 3 508 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020911] [29650] 0 29650 36171 4053 47 4 469 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020914] [29652] 0 29652 1069 6 8 3 10 0 sessionclean
Nov 8 05:51:14 wikitech-static kernel: [60936548.020917] [29653] 0 29653 1069 8 8 3 15 0 sessionclean
Nov 8 05:51:14 wikitech-static kernel: [60936548.020919] [29656] 0 29656 3588 9 10 3 10 0 sort
Nov 8 05:51:14 wikitech-static kernel: [60936548.020922] [29657] 0 29657 3588 13 10 3 7 0 sort
Nov 8 05:51:14 wikitech-static kernel: [60936548.020925] [29658] 0 29658 1069 13 8 3 10 0 sessionclean
Nov 8 05:51:14 wikitech-static kernel: [60936548.020927] [29671] 0 29671 12206 18 28 3 86 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020930] [29672] 0 29672 12206 25 28 3 79 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020932] [29674] 0 29674 62982 722 107 3 178 0 php7.3
Nov 8 05:51:14 wikitech-static kernel: [60936548.020935] [29675] 0 29675 1069 0 7 3 21 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020938] [29676] 0 29676 1069 0 7 3 22 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020940] [29677] 0 29677 35574 3850 44 3 421 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020943] [29678] 0 29678 35590 3815 44 3 458 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020945] [29706] 0 29706 12206 45 28 3 60 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020948] [29707] 0 29707 12206 49 28 3 56 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020950] [29717] 0 29717 1069 9 7 4 11 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020953] [29718] 0 29718 1069 7 7 3 13 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020956] [29720] 0 29720 12206 41 28 3 64 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020958] [29721] 0 29721 12206 38 28 3 67 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.020961] [29723] 0 29723 33669 3131 39 3 333 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020963] [29724] 0 29724 33606 3123 41 3 324 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020966] [29752] 0 29752 1069 14 8 3 7 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020968] [29754] 0 29754 1069 14 8 3 6 0 sh
Nov 8 05:51:14 wikitech-static kernel: [60936548.020971] [29755] 0 29755 33538 2650 39 3 386 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020974] [29768] 0 29768 33644 3229 40 3 236 0 check_icinga
Nov 8 05:51:14 wikitech-static kernel: [60936548.020976] [29869] 33 29869 77573 1488 131 3 954 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020979] [29871] 33 29871 117598 1032 151 3 1684 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020981] [29876] 33 29876 117117 1120 150 3 1617 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020984] [29877] 33 29877 117592 1034 151 3 1686 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020986] [29884] 33 29884 117136 1130 151 3 1643 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020989] [29887] 33 29887 117174 826 156 3 1672 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020991] [29892] 33 29892 77582 1482 133 3 956 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020994] [29893] 33 29893 77580 1499 132 3 950 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020996] [29894] 33 29894 117179 1083 156 3 1676 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.020999] [29918] 33 29918 117084 1070 150 3 1661 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021001] [29942] 33 29942 117086 622 148 3 1664 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021004] [29943] 33 29943 117064 673 149 3 1652 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021006] [29944] 33 29944 117080 563 149 3 1678 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021009] [29945] 33 29945 117080 1077 151 3 1653 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021011] [29965] 33 29965 2089 251 11 3 0 0 lua
Nov 8 05:51:14 wikitech-static kernel: [60936548.021014] [29966] 33 29966 117064 666 148 3 1657 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021016] [30001] 33 30001 116657 792 146 3 1559 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021019] [30003] 33 30003 80693 903 134 3 1015 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021022] [30006] 33 30006 117068 677 148 3 1651 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021024] [30057] 0 30057 11166 66 26 3 31 0 cron
Nov 8 05:51:14 wikitech-static kernel: [60936548.021027] [30074] 33 30074 116644 177 137 3 1752 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021029] [30076] 33 30076 77053 943 126 3 961 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021032] [30077] 33 30077 116644 171 137 3 1758 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021034] [30078] 33 30078 116649 231 139 3 1715 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021037] [30079] 33 30079 116649 229 139 3 1717 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021039] [30080] 33 30080 116644 171 137 3 1758 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021042] [30081] 33 30081 77053 947 126 3 958 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021044] [30082] 33 30082 116644 162 137 3 1760 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021047] [30083] 33 30083 116644 171 137 3 1758 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021049] [30084] 33 30084 116644 161 137 3 1761 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021052] [30085] 33 30085 116644 161 137 3 1761 0 apache2
Nov 8 05:51:14 wikitech-static kernel: [60936548.021054] Out of memory: Kill process 3273 (mysqld) score 124 or sacrifice child
Nov 8 05:51:14 wikitech-static kernel: [60936548.021179] Killed process 3273 (mysqld) total-vm:708564kB, anon-rss:36004kB, file-rss:0kB, shmem-rss:0kB
Nov 8 05:51:14 wikitech-static kernel: [60936548.046071] oom_reaper: reaped process 3273 (mysqld), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Linux version 4.9.0-11-amd64 (debian-kernel@lists.debian.org) (gcc version 6.3.0 20170516 (Debian 6.3.0-18+deb9u1) ) #1 SMP Debian 4.9.189-3+deb9u2 (2019-11-11)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.9.0-11-amd64 root=/dev/xvda1 ro quiet
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] x86/fpu: Legacy x87 FPU detected.
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] e820: BIOS-provided physical RAM map:
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003fbfffff] usable
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BIOS-e820: [mem 0x00000000fc000000-0x00000000ffffffff] reserved
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] NX (Execute Disable) protection: active
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] SMBIOS 2.4 present.
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMI: Xen HVM domU, BIOS 4.1.5 11/28/2013
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Hypervisor detected: Xen
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Xen version 4.1.
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Xen Platform PCI: I/O protocol version 1
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs.
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks.
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] You might have to change the root device
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] from /dev/hd[a-d] to /dev/xvd[a-d]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] in your root= kernel command line option
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] HVMOP_pagetable_dying not supported
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Kernel/User page tables isolation: disabled
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] AGP: No AGP bridge found
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] e820: last_pfn = 0x3fc00 max_arch_pfn = 0x400000000
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] MTRR default type: write-back
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] MTRR fixed ranges enabled:
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 00000-9FFFF write-back
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] A0000-BFFFF write-combining
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] C0000-FFFFF write-back
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] MTRR variable ranges enabled:
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 0 base 0000F0000000 mask FFFFF8000000 uncachable
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 1 base 0000F8000000 mask FFFFFC000000 uncachable
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 2 disabled
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 3 disabled
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 4 disabled
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 5 disabled
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 6 disabled
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] 7 disabled
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] TOM2: 000000083f000000 aka 33776M
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WC UC- WT
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] found SMP MP-table at [mem 0x000fb710-0x000fb71f] mapped at [ffff918e000fb710]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Base memory trampoline at [ffff918e00098000] 98000 size 24576
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BRK [0x13535000, 0x13535fff] PGTABLE
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BRK [0x13536000, 0x13536fff] PGTABLE
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BRK [0x13537000, 0x13537fff] PGTABLE
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] BRK [0x13538000, 0x13538fff] PGTABLE
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] RAMDISK: [mem 0x35aa2000-0x36d48fff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: Early table checksum verification disabled
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: RSDP 0x00000000000EA020 000024 (v02 Xen )
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: XSDT 0x00000000FC00EF80 000044 (v01 Xen HVM 00000000 HVML 00000000)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: FACP 0x00000000FC00ED40 0000F4 (v04 Xen HVM 00000000 HVML 00000000)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: DSDT 0x00000000FC003040 00BC75 (v02 Xen HVM 00000000 INTL 20090123)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: FACS 0x00000000FC003000 000040
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: FACS 0x00000000FC003000 000040
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: APIC 0x00000000FC00EE40 0000D8 (v02 Xen HVM 00000000 HVML 00000000)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: HPET 0x00000000FC00EF20 000038 (v01 Xen HVM 00000000 HVML 00000000)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: WAET 0x00000000FC00EF58 000028 (v01 Xen HVM 00000000 HVML 00000000)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: Local APIC address 0xfee00000
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] No NUMA configuration found
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000003fbfffff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] NODE_DATA(0) allocated [mem 0x3fbfb000-0x3fbfffff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Zone ranges:
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA32 [mem 0x0000000001000000-0x000000003fbfffff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Normal empty
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Device empty
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Movable zone start for each node
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Early memory node ranges
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009dfff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] node 0: [mem 0x0000000000100000-0x000000003fbfffff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000003fbfffff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] On node 0 totalpages: 261021
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA zone: 64 pages used for memmap
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA zone: 21 pages reserved
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA zone: 3997 pages, LIFO batch:0
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA32 zone: 4016 pages used for memmap
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] DMA32 zone: 257024 pages, LIFO batch:31
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: PM-Timer IO Port: 0x1f48
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: Local APIC address 0xfee00000
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: IRQ0 used by override.
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: IRQ5 used by override.
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: IRQ9 used by override.
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: IRQ10 used by override.
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: IRQ11 used by override.
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Using ACPI (MADT) for SMP configuration information
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] smpboot: Allowing 15 CPUs, 14 hotplug CPUs
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] e820: [mem 0x3fc00000-0xfbffffff] available for PCI devices
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Booting paravirtualized kernel on Xen HVM
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:15 nr_node_ids:1
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] percpu: Embedded 35 pages/cpu s105304 r8192 d29864 u262144
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] pcpu-alloc: s105304 r8192 d29864 u262144 alloc=1*2097152
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 --
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] xen: PV spinlocks enabled
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 256920
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Policy zone: DMA32
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.9.0-11-amd64 root=/dev/xvda1 ro quiet
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] AGP: Checking aperture...
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] AGP: No AGP bridge found
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Calgary: detecting Calgary via BIOS EBDA area
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Memory: 990712K/1044084K available (6288K kernel code, 1162K rwdata, 2880K rodata, 1424K init, 656K bss, 53372K reserved, 0K cma-reserved)
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Hierarchical RCU implementation.
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Build-time adjustment of leaf fanout to 64.
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=15.
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=15
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] NR_IRQS:33024 nr_irqs:952 16
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] xen:events: Using 2-level ABI
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] xen:events: Xen HVM callback vector for event delivery is enabled
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Console: colour VGA+ 80x25
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] console [tty0] enabled
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 30580167144 ns
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] hpet clockevent registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] tsc: Fast TSC calibration using PIT
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] tsc: Detected 2999.945 MHz processor
Nov 8 05:54:27 wikitech-static kernel: [ 0.000000] tsc: Marking TSC unstable due to TSCs unsynchronized
Nov 8 05:54:27 wikitech-static kernel: [ 0.024000] Calibrating delay loop (skipped), value calculated using timer frequency.. 6000.16 BogoMIPS (lpj=12000336)
Nov 8 05:54:27 wikitech-static kernel: [ 0.024000] pid_max: default: 32768 minimum: 301
Nov 8 05:54:27 wikitech-static kernel: [ 0.024000] ACPI: Core revision 20160831
Nov 8 05:54:27 wikitech-static kernel: [ 0.031234] ACPI: 1 ACPI AML tables successfully acquired and loaded
Nov 8 05:54:27 wikitech-static kernel: [ 0.031368] Security Framework initialized
Nov 8 05:54:27 wikitech-static kernel: [ 0.031370] Yama: disabled by default; enable with sysctl kernel.yama.*
Nov 8 05:54:27 wikitech-static kernel: [ 0.031382] AppArmor: AppArmor disabled by boot time parameter
Nov 8 05:54:27 wikitech-static kernel: [ 0.031505] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
Nov 8 05:54:27 wikitech-static kernel: [ 0.031976] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
Nov 8 05:54:27 wikitech-static kernel: [ 0.032125] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes)
Nov 8 05:54:27 wikitech-static kernel: [ 0.032128] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes)
Nov 8 05:54:27 wikitech-static kernel: [ 0.032458] mce: CPU supports 0 MCE banks
Nov 8 05:54:27 wikitech-static kernel: [ 0.032469] Last level iTLB entries: 4KB 512, 2MB 1024, 4MB 512
Nov 8 05:54:27 wikitech-static kernel: [ 0.032470] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 512, 1GB 0
Nov 8 05:54:27 wikitech-static kernel: [ 0.032471] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
Nov 8 05:54:27 wikitech-static kernel: [ 0.032473] Spectre V2 : Spectre mitigation: LFENCE not serializing, switching to generic retpoline
Nov 8 05:54:27 wikitech-static kernel: [ 0.033464] Spectre V2 : Mitigation: Full generic retpoline
Nov 8 05:54:27 wikitech-static kernel: [ 0.033465] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
Nov 8 05:54:27 wikitech-static kernel: [ 0.033467] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
Nov 8 05:54:27 wikitech-static kernel: [ 0.049324] ftrace: allocating 25339 entries in 99 pages
Nov 8 05:54:27 wikitech-static kernel: [ 0.084143] smpboot: Max logical packages: 15
Nov 8 05:54:27 wikitech-static kernel: [ 0.085241] x2apic: IRQ remapping doesn't support X2APIC mode
Nov 8 05:54:27 wikitech-static kernel: [ 0.088006] Switched APIC routing to physical flat.
Nov 8 05:54:27 wikitech-static kernel: [ 0.091238] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
Nov 8 05:54:27 wikitech-static kernel: [ 0.131664] clocksource: xen: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
Nov 8 05:54:27 wikitech-static kernel: [ 0.131703] Xen: using vcpuop timer interface
Nov 8 05:54:27 wikitech-static kernel: [ 0.131714] installing Xen timer for CPU 0
Nov 8 05:54:27 wikitech-static kernel: [ 0.131817] smpboot: CPU0: AMD Opteron(tm) Processor 4332 HE (family: 0x15, model: 0x2, stepping: 0x0)
Nov 8 05:54:27 wikitech-static kernel: [ 0.131860] cpu 0 spinlock event irq 53
Nov 8 05:54:27 wikitech-static kernel: [ 0.131862] Performance Events: AMD PMU driver.
Nov 8 05:54:27 wikitech-static kernel: [ 0.131876] ... version: 0
Nov 8 05:54:27 wikitech-static kernel: [ 0.131877] ... bit width: 48
Nov 8 05:54:27 wikitech-static kernel: [ 0.131878] ... generic registers: 4
Nov 8 05:54:27 wikitech-static kernel: [ 0.131879] ... value mask: 0000ffffffffffff
Nov 8 05:54:27 wikitech-static kernel: [ 0.131881] ... max period: 00007fffffffffff
Nov 8 05:54:27 wikitech-static kernel: [ 0.131881] ... fixed-purpose events: 0
Nov 8 05:54:27 wikitech-static kernel: [ 0.131882] ... event mask: 000000000000000f
Nov 8 05:54:27 wikitech-static kernel: [ 0.132000] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
Nov 8 05:54:27 wikitech-static kernel: [ 0.132000] x86: Booted up 1 node, 1 CPUs
Nov 8 05:54:27 wikitech-static kernel: [ 0.132000] smpboot: Total of 1 processors activated (6000.16 BogoMIPS)
Nov 8 05:54:27 wikitech-static kernel: [ 0.132000] devtmpfs: initialized
Nov 8 05:54:27 wikitech-static kernel: [ 0.132000] x86/mm: Memory block size: 128MB
Nov 8 05:54:27 wikitech-static kernel: [ 0.132617] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
Nov 8 05:54:27 wikitech-static kernel: [ 0.132636] futex hash table entries: 4096 (order: 6, 262144 bytes)
Nov 8 05:54:27 wikitech-static kernel: [ 0.132753] pinctrl core: initialized pinctrl subsystem
Nov 8 05:54:27 wikitech-static kernel: [ 0.133038] NET: Registered protocol family 16
Nov 8 05:54:27 wikitech-static kernel: [ 0.133344] cpuidle: using governor ladder
Nov 8 05:54:27 wikitech-static kernel: [ 0.133344] cpuidle: using governor menu
Nov 8 05:54:27 wikitech-static kernel: [ 0.133344] ACPI: bus type PCI registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.133344] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
Nov 8 05:54:27 wikitech-static kernel: [ 0.133344] PCI: Using configuration type 1 for base access
Nov 8 05:54:27 wikitech-static kernel: [ 0.133344] PCI: Using configuration type 1 for extended access
Nov 8 05:54:27 wikitech-static kernel: [ 0.133800] HugeTLB registered 2 MB page size, pre-allocated 0 pages
Nov 8 05:54:27 wikitech-static kernel: [ 0.134099] ACPI: Added _OSI(Module Device)
Nov 8 05:54:27 wikitech-static kernel: [ 0.134100] ACPI: Added _OSI(Processor Device)
Nov 8 05:54:27 wikitech-static kernel: [ 0.134101] ACPI: Added _OSI(3.0 _SCP Extensions)
Nov 8 05:54:27 wikitech-static kernel: [ 0.134102] ACPI: Added _OSI(Processor Aggregator Device)
Nov 8 05:54:27 wikitech-static kernel: [ 0.134522] xen: --> pirq=16 -> irq=9 (gsi=9)
Nov 8 05:54:27 wikitech-static kernel: [ 0.140347] ACPI: Interpreter enabled
Nov 8 05:54:27 wikitech-static kernel: [ 0.140358] ACPI: (supports S0 S5)
Nov 8 05:54:27 wikitech-static kernel: [ 0.140360] ACPI: Using IOAPIC for interrupt routing
Nov 8 05:54:27 wikitech-static kernel: [ 0.140390] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
Nov 8 05:54:27 wikitech-static kernel: [ 0.219834] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
Nov 8 05:54:27 wikitech-static kernel: [ 0.219843] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
Nov 8 05:54:27 wikitech-static kernel: [ 0.219850] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
Nov 8 05:54:27 wikitech-static kernel: [ 0.222872] acpiphp: Slot [0] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.223977] acpiphp: Slot [3] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224085] acpiphp: Slot [4] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224209] acpiphp: Slot [5] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224288] acpiphp: Slot [6] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224339] acpiphp: Slot [7] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224390] acpiphp: Slot [8] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224441] acpiphp: Slot [9] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224496] acpiphp: Slot [10] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224549] acpiphp: Slot [11] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224599] acpiphp: Slot [12] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224651] acpiphp: Slot [13] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224706] acpiphp: Slot [14] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224764] acpiphp: Slot [15] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224814] acpiphp: Slot [16] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224864] acpiphp: Slot [17] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224916] acpiphp: Slot [18] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.224968] acpiphp: Slot [19] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.225019] acpiphp: Slot [20] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.225069] acpiphp: Slot [21] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.225121] acpiphp: Slot [22] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.225172] acpiphp: Slot [23] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.225222] acpiphp: Slot [24] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.225274] acpiphp: Slot [25] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.225324] acpiphp: Slot [26] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.225375] acpiphp: Slot [27] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.225425] acpiphp: Slot [28] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.225499] acpiphp: Slot [29] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.225585] acpiphp: Slot [30] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.225672] acpiphp: Slot [31] registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.225741] PCI host bridge to bus 0000:00
Nov 8 05:54:27 wikitech-static kernel: [ 0.225746] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
Nov 8 05:54:27 wikitech-static kernel: [ 0.225749] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
Nov 8 05:54:27 wikitech-static kernel: [ 0.225751] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
Nov 8 05:54:27 wikitech-static kernel: [ 0.225754] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfbffffff window]
Nov 8 05:54:27 wikitech-static kernel: [ 0.225757] pci_bus 0000:00: root bus resource [bus 00-ff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.227382] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000
Nov 8 05:54:27 wikitech-static kernel: [ 0.230259] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100
Nov 8 05:54:27 wikitech-static kernel: [ 0.232860] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180
Nov 8 05:54:27 wikitech-static kernel: [ 0.233960] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f]
Nov 8 05:54:27 wikitech-static kernel: [ 0.234402] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7]
Nov 8 05:54:27 wikitech-static kernel: [ 0.234403] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6]
Nov 8 05:54:27 wikitech-static kernel: [ 0.234405] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177]
Nov 8 05:54:27 wikitech-static kernel: [ 0.234407] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376]
Nov 8 05:54:27 wikitech-static kernel: [ 0.235054] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300
Nov 8 05:54:27 wikitech-static kernel: [ 0.236007] pci 0000:00:01.2: reg 0x20: [io 0xc300-0xc31f]
Nov 8 05:54:27 wikitech-static kernel: [ 0.237088] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000
Nov 8 05:54:27 wikitech-static kernel: [ 0.237116] * Found PM-Timer Bug on the chipset. Due to workarounds for a bug,
Nov 8 05:54:27 wikitech-static kernel: [ 0.237116] * this clock source is slow. Consider trying other clock sources
Nov 8 05:54:27 wikitech-static kernel: [ 0.238145] pci 0000:00:01.3: quirk: [io 0x1f40-0x1f7f] claimed by PIIX4 ACPI
Nov 8 05:54:27 wikitech-static kernel: [ 0.239809] pci 0000:00:02.0: [1013:00b8] type 00 class 0x030000
Nov 8 05:54:27 wikitech-static kernel: [ 0.240943] pci 0000:00:02.0: reg 0x10: [mem 0xf0000000-0xf1ffffff pref]
Nov 8 05:54:27 wikitech-static kernel: [ 0.241987] pci 0000:00:02.0: reg 0x14: [mem 0xf3000000-0xf3000fff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.244894] pci 0000:00:03.0: [5853:0001] type 00 class 0x010000
Nov 8 05:54:27 wikitech-static kernel: [ 0.245424] pci 0000:00:03.0: reg 0x10: [io 0xc000-0xc0ff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.245776] pci 0000:00:03.0: reg 0x14: [mem 0xf2000000-0xf2ffffff pref]
Nov 8 05:54:27 wikitech-static kernel: [ 0.248427] ACPI: PCI Interrupt Link [LNKA] (IRQs *5 10 11)
Nov 8 05:54:27 wikitech-static kernel: [ 0.248651] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
Nov 8 05:54:27 wikitech-static kernel: [ 0.248852] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
Nov 8 05:54:27 wikitech-static kernel: [ 0.249116] ACPI: PCI Interrupt Link [LNKD] (IRQs *5 10 11)
Nov 8 05:54:27 wikitech-static kernel: [ 0.274336] ACPI: Enabled 2 GPEs in block 00 to 1F
Nov 8 05:54:27 wikitech-static kernel: [ 0.274449] xen:balloon: Initialising balloon driver
Nov 8 05:54:27 wikitech-static kernel: [ 0.276047] xen_balloon: Initialising balloon driver
Nov 8 05:54:27 wikitech-static kernel: [ 0.277652] vgaarb: setting as boot device: PCI:0000:00:02.0
Nov 8 05:54:27 wikitech-static kernel: [ 0.277655] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
Nov 8 05:54:27 wikitech-static kernel: [ 0.277656] vgaarb: loaded
Nov 8 05:54:27 wikitech-static kernel: [ 0.277657] vgaarb: bridge control possible 0000:00:02.0
Nov 8 05:54:27 wikitech-static kernel: [ 0.277791] PCI: Using ACPI for IRQ routing
Nov 8 05:54:27 wikitech-static kernel: [ 0.277794] PCI: pci_cache_line_size set to 64 bytes
Nov 8 05:54:27 wikitech-static kernel: [ 0.278149] e820: reserve RAM buffer [mem 0x0009e000-0x0009ffff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.278151] e820: reserve RAM buffer [mem 0x3fc00000-0x3fffffff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.278399] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
Nov 8 05:54:27 wikitech-static kernel: [ 0.278404] hpet0: 3 comparators, 64-bit 62.500000 MHz counter
Nov 8 05:54:27 wikitech-static kernel: [ 0.282079] clocksource: Switched to clocksource xen
Nov 8 05:54:27 wikitech-static kernel: [ 0.292321] VFS: Disk quotas dquot_6.6.0
Nov 8 05:54:27 wikitech-static kernel: [ 0.292358] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
Nov 8 05:54:27 wikitech-static kernel: [ 0.292556] pnp: PnP ACPI init
Nov 8 05:54:27 wikitech-static kernel: [ 0.292648] system 00:00: [mem 0x00000000-0x0009ffff] could not be reserved
Nov 8 05:54:27 wikitech-static kernel: [ 0.292652] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active)
Nov 8 05:54:27 wikitech-static kernel: [ 0.292714] system 00:01: [io 0x10c0-0x1141] has been reserved
Nov 8 05:54:27 wikitech-static kernel: [ 0.292716] system 00:01: [io 0xb044-0xb047] has been reserved
Nov 8 05:54:27 wikitech-static kernel: [ 0.292719] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
Nov 8 05:54:27 wikitech-static kernel: [ 0.292812] system 00:02: [io 0x08a0-0x08a3] has been reserved
Nov 8 05:54:27 wikitech-static kernel: [ 0.292814] system 00:02: [io 0x0cc0-0x0ccf] has been reserved
Nov 8 05:54:27 wikitech-static kernel: [ 0.292816] system 00:02: [io 0x04d0-0x04d1] has been reserved
Nov 8 05:54:27 wikitech-static kernel: [ 0.292819] system 00:02: Plug and Play ACPI device, IDs PNP0c02 (active)
Nov 8 05:54:27 wikitech-static kernel: [ 0.292846] xen: --> pirq=17 -> irq=8 (gsi=8)
Nov 8 05:54:27 wikitech-static kernel: [ 0.292873] pnp 00:03: Plug and Play ACPI device, IDs PNP0b00 (active)
Nov 8 05:54:27 wikitech-static kernel: [ 0.292895] xen: --> pirq=18 -> irq=12 (gsi=12)
Nov 8 05:54:27 wikitech-static kernel: [ 0.292917] pnp 00:04: Plug and Play ACPI device, IDs PNP0f13 (active)
Nov 8 05:54:27 wikitech-static kernel: [ 0.292937] xen: --> pirq=19 -> irq=1 (gsi=1)
Nov 8 05:54:27 wikitech-static kernel: [ 0.292958] pnp 00:05: Plug and Play ACPI device, IDs PNP0303 PNP030b (active)
Nov 8 05:54:27 wikitech-static kernel: [ 0.292984] xen: --> pirq=20 -> irq=6 (gsi=6)
Nov 8 05:54:27 wikitech-static kernel: [ 0.292988] pnp 00:06: [dma 2]
Nov 8 05:54:27 wikitech-static kernel: [ 0.293026] pnp 00:06: Plug and Play ACPI device, IDs PNP0700 (active)
Nov 8 05:54:27 wikitech-static kernel: [ 0.293062] xen: --> pirq=21 -> irq=4 (gsi=4)
Nov 8 05:54:27 wikitech-static kernel: [ 0.293093] pnp 00:07: Plug and Play ACPI device, IDs PNP0501 (active)
Nov 8 05:54:27 wikitech-static kernel: [ 0.293132] xen: --> pirq=22 -> irq=7 (gsi=7)
Nov 8 05:54:27 wikitech-static kernel: [ 0.293152] pnp 00:08: Plug and Play ACPI device, IDs PNP0400 (active)
Nov 8 05:54:27 wikitech-static kernel: [ 0.319195] pnp: PnP ACPI: found 9 devices
Nov 8 05:54:27 wikitech-static kernel: [ 0.325635] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
Nov 8 05:54:27 wikitech-static kernel: [ 0.325651] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
Nov 8 05:54:27 wikitech-static kernel: [ 0.325654] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]
Nov 8 05:54:27 wikitech-static kernel: [ 0.325656] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
Nov 8 05:54:27 wikitech-static kernel: [ 0.325658] pci_bus 0000:00: resource 7 [mem 0xf0000000-0xfbffffff window]
Nov 8 05:54:27 wikitech-static kernel: [ 0.325931] NET: Registered protocol family 2
Nov 8 05:54:27 wikitech-static kernel: [ 0.326187] TCP established hash table entries: 8192 (order: 4, 65536 bytes)
Nov 8 05:54:27 wikitech-static kernel: [ 0.326219] TCP bind hash table entries: 8192 (order: 5, 131072 bytes)
Nov 8 05:54:27 wikitech-static kernel: [ 0.326256] TCP: Hash tables configured (established 8192 bind 8192)
Nov 8 05:54:27 wikitech-static kernel: [ 0.326298] UDP hash table entries: 512 (order: 2, 16384 bytes)
Nov 8 05:54:27 wikitech-static kernel: [ 0.326307] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
Nov 8 05:54:27 wikitech-static kernel: [ 0.326387] NET: Registered protocol family 1
Nov 8 05:54:27 wikitech-static kernel: [ 0.326399] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
Nov 8 05:54:27 wikitech-static kernel: [ 0.326466] pci 0000:00:01.0: PIIX3: Enabling Passive Release
Nov 8 05:54:27 wikitech-static kernel: [ 0.326526] pci 0000:00:01.0: Activating ISA DMA hang workarounds
Nov 8 05:54:27 wikitech-static kernel: [ 0.327062] xen: --> pirq=23 -> irq=23 (gsi=23)
Nov 8 05:54:27 wikitech-static kernel: [ 0.328142] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
Nov 8 05:54:27 wikitech-static kernel: [ 0.328199] PCI: CLS 0 bytes, default 64
Nov 8 05:54:27 wikitech-static kernel: [ 0.328279] Unpacking initramfs...
Nov 8 05:54:27 wikitech-static kernel: [ 0.636062] random: fast init done
Nov 8 05:54:27 wikitech-static kernel: [ 0.698973] Freeing initrd memory: 19100K
Nov 8 05:54:27 wikitech-static kernel: [ 0.699233] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2b3e9497a9e, max_idle_ns: 440795264360 ns
Nov 8 05:54:27 wikitech-static kernel: [ 0.699606] audit: initializing netlink subsys (disabled)
Nov 8 05:54:27 wikitech-static kernel: [ 0.699629] audit: type=2000 audit(1636350847.445:1): initialized
Nov 8 05:54:27 wikitech-static kernel: [ 0.700026] workingset: timestamp_bits=40 max_order=18 bucket_order=0
Nov 8 05:54:27 wikitech-static kernel: [ 0.700042] zbud: loaded
Nov 8 05:54:27 wikitech-static kernel: [ 0.700873] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)
Nov 8 05:54:27 wikitech-static kernel: [ 0.700903] io scheduler noop registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.700904] io scheduler deadline registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.700916] io scheduler cfq registered (default)
Nov 8 05:54:27 wikitech-static kernel: [ 0.700973] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Nov 8 05:54:27 wikitech-static kernel: [ 0.700980] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
Nov 8 05:54:27 wikitech-static kernel: [ 0.701119] GHES: HEST is not enabled!
Nov 8 05:54:27 wikitech-static kernel: [ 0.701615] xen: --> pirq=24 -> irq=30 (gsi=30)
Nov 8 05:54:27 wikitech-static kernel: [ 0.701698] xen:grant_table: Grant tables using version 1 layout
Nov 8 05:54:27 wikitech-static kernel: [ 0.701715] Grant table initialized
Nov 8 05:54:27 wikitech-static kernel: [ 0.701761] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
Nov 8 05:54:27 wikitech-static kernel: [ 0.702488] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
Nov 8 05:54:27 wikitech-static kernel: [ 0.734672] 00:07: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
Nov 8 05:54:27 wikitech-static kernel: [ 0.735208] Linux agpgart interface v0.103
Nov 8 05:54:27 wikitech-static kernel: [ 0.735360] AMD IOMMUv2 driver by Joerg Roedel <jroedel@suse.de>
Nov 8 05:54:27 wikitech-static kernel: [ 0.735361] AMD IOMMUv2 functionality not available on this system
Nov 8 05:54:27 wikitech-static kernel: [ 0.735499] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
Nov 8 05:54:27 wikitech-static kernel: [ 0.738057] serio: i8042 KBD port at 0x60,0x64 irq 1
Nov 8 05:54:27 wikitech-static kernel: [ 0.738072] serio: i8042 AUX port at 0x60,0x64 irq 12
Nov 8 05:54:27 wikitech-static kernel: [ 0.738294] mousedev: PS/2 mouse device common for all mice
Nov 8 05:54:27 wikitech-static kernel: [ 0.739281] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
Nov 8 05:54:27 wikitech-static kernel: [ 0.739905] rtc_cmos 00:03: RTC can wake from S4
Nov 8 05:54:27 wikitech-static kernel: [ 0.740024] rtc_cmos 00:03: rtc core: registered rtc_cmos as rtc0
Nov 8 05:54:27 wikitech-static kernel: [ 0.740142] rtc_cmos 00:03: alarms up to one day, 114 bytes nvram, hpet irqs
Nov 8 05:54:27 wikitech-static kernel: [ 0.740169] ledtrig-cpu: registered to indicate activity on CPUs
Nov 8 05:54:27 wikitech-static kernel: [ 0.740427] NET: Registered protocol family 10
Nov 8 05:54:27 wikitech-static kernel: [ 0.740677] mip6: Mobile IPv6
Nov 8 05:54:27 wikitech-static kernel: [ 0.740679] NET: Registered protocol family 17
Nov 8 05:54:27 wikitech-static kernel: [ 0.740682] mpls_gso: MPLS GSO support
Nov 8 05:54:27 wikitech-static kernel: [ 0.740919] registered taskstats version 1
Nov 8 05:54:27 wikitech-static kernel: [ 0.740933] zswap: loaded using pool lzo/zbud
Nov 8 05:54:27 wikitech-static kernel: [ 0.741012] ima: No TPM chip found, activating TPM-bypass!
Nov 8 05:54:27 wikitech-static kernel: [ 0.741015] ima: Allocated hash algorithm: sha256
Nov 8 05:54:27 wikitech-static kernel: [ 0.741328] xenbus_probe_frontend: Device with no driver: device/vbd/768
Nov 8 05:54:27 wikitech-static kernel: [ 0.741329] xenbus_probe_frontend: Device with no driver: device/vbd/5632
Nov 8 05:54:27 wikitech-static kernel: [ 0.741330] xenbus_probe_frontend: Device with no driver: device/vif/0
Nov 8 05:54:27 wikitech-static kernel: [ 0.741331] xenbus_probe_frontend: Device with no driver: device/vif/1
Nov 8 05:54:27 wikitech-static kernel: [ 0.741364] rtc_cmos 00:03: setting system clock to 2021-11-08 05:54:07 UTC (1636350847)
Nov 8 05:54:27 wikitech-static kernel: [ 0.741389] PM: Hibernation image not present or could not be loaded.
Nov 8 05:54:27 wikitech-static kernel: [ 0.742787] Freeing unused kernel memory: 1424K
Nov 8 05:54:27 wikitech-static kernel: [ 0.742789] Write protecting the kernel read-only data: 12288k
Nov 8 05:54:27 wikitech-static kernel: [ 0.743631] Freeing unused kernel memory: 1888K
Nov 8 05:54:27 wikitech-static kernel: [ 0.746747] Freeing unused kernel memory: 1216K
Nov 8 05:54:27 wikitech-static kernel: [ 0.753348] x86/mm: Checked W+X mappings: passed, no W+X pages found.
Nov 8 05:54:27 wikitech-static kernel: [ 0.766308] random: systemd-udevd: uninitialized urandom read (16 bytes read)
Nov 8 05:54:27 wikitech-static kernel: [ 0.766389] random: systemd-udevd: uninitialized urandom read (16 bytes read)
Nov 8 05:54:27 wikitech-static kernel: [ 0.766396] random: systemd-udevd: uninitialized urandom read (16 bytes read)
Nov 8 05:54:27 wikitech-static kernel: [ 0.884457] SCSI subsystem initialized
Nov 8 05:54:27 wikitech-static kernel: [ 0.888628] ACPI: bus type USB registered
Nov 8 05:54:27 wikitech-static kernel: [ 0.888653] usbcore: registered new interface driver usbfs
Nov 8 05:54:27 wikitech-static kernel: [ 0.888665] usbcore: registered new interface driver hub
Nov 8 05:54:27 wikitech-static kernel: [ 0.888689] usbcore: registered new device driver usb
Nov 8 05:54:27 wikitech-static kernel: [ 0.889276] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
Nov 8 05:54:27 wikitech-static kernel: [ 0.889617] uhci_hcd: USB Universal Host Controller Interface driver
Nov 8 05:54:27 wikitech-static kernel: [ 0.890240] uhci_hcd 0000:00:01.2: UHCI Host Controller
Nov 8 05:54:27 wikitech-static kernel: [ 0.890246] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
Nov 8 05:54:27 wikitech-static kernel: [ 0.890324] uhci_hcd 0000:00:01.2: detected 2 ports
Nov 8 05:54:27 wikitech-static kernel: [ 0.890527] uhci_hcd 0000:00:01.2: irq 23, io base 0x0000c300
Nov 8 05:54:27 wikitech-static kernel: [ 0.903130] FDC 0 is a S82078B
Nov 8 05:54:27 wikitech-static kernel: [ 0.905277] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001
Nov 8 05:54:27 wikitech-static kernel: [ 0.905281] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Nov 8 05:54:27 wikitech-static kernel: [ 0.905283] usb usb1: Product: UHCI Host Controller
Nov 8 05:54:27 wikitech-static kernel: [ 0.905285] usb usb1: Manufacturer: Linux 4.9.0-11-amd64 uhci_hcd
Nov 8 05:54:27 wikitech-static kernel: [ 0.905287] usb usb1: SerialNumber: 0000:00:01.2
Nov 8 05:54:27 wikitech-static kernel: [ 0.905687] hub 1-0:1.0: USB hub found
Nov 8 05:54:27 wikitech-static kernel: [ 0.905849] hub 1-0:1.0: 2 ports detected
Nov 8 05:54:27 wikitech-static kernel: [ 0.906298] piix4_smbus 0000:00:01.3: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr
Nov 8 05:54:27 wikitech-static kernel: [ 0.910051] libata version 3.00 loaded.
Nov 8 05:54:27 wikitech-static kernel: [ 0.910445] ata_piix 0000:00:01.1: version 2.13
Nov 8 05:54:27 wikitech-static kernel: [ 0.915373] Invalid max_queues (4), will use default max: 1.
Nov 8 05:54:27 wikitech-static kernel: [ 0.917221] xen_netfront: Initialising Xen virtual ethernet driver
Nov 8 05:54:27 wikitech-static kernel: [ 0.920395] scsi host0: ata_piix
Nov 8 05:54:27 wikitech-static kernel: [ 0.921047] SSE version of gcm_enc/dec engaged.
Nov 8 05:54:27 wikitech-static kernel: [ 0.928281] scsi host1: ata_piix
Nov 8 05:54:27 wikitech-static kernel: [ 0.928359] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14
Nov 8 05:54:27 wikitech-static kernel: [ 0.928360] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15
Nov 8 05:54:27 wikitech-static kernel: [ 0.958029] blkfront: xvda: barrier: enabled; persistent grants: disabled; indirect descriptors: disabled;
Nov 8 05:54:27 wikitech-static kernel: [ 0.962200] xvda: xvda1
Nov 8 05:54:27 wikitech-static kernel: [ 0.965528] blkfront: xvdc: barrier: enabled; persistent grants: disabled; indirect descriptors: disabled;
Nov 8 05:54:27 wikitech-static kernel: [ 0.975803] xvdc: xvdc1
Nov 8 05:54:27 wikitech-static kernel: [ 1.232088] usb 1-2: new full-speed USB device number 2 using uhci_hcd
Nov 8 05:54:27 wikitech-static kernel: [ 1.784231] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2
Nov 8 05:54:27 wikitech-static kernel: [ 1.827364] usb 1-2: New USB device found, idVendor=0627, idProduct=0001
Nov 8 05:54:27 wikitech-static kernel: [ 1.827367] usb 1-2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Nov 8 05:54:27 wikitech-static kernel: [ 1.827369] usb 1-2: Product: QEMU USB Tablet
Nov 8 05:54:27 wikitech-static kernel: [ 1.827370] usb 1-2: Manufacturer: QEMU 0.10.2
Nov 8 05:54:27 wikitech-static kernel: [ 1.827372] usb 1-2: SerialNumber: 1
Nov 8 05:54:27 wikitech-static kernel: [ 2.029324] hidraw: raw HID events driver (C) Jiri Kosina
Nov 8 05:54:27 wikitech-static kernel: [ 2.224574] usbcore: registered new interface driver usbhid
Nov 8 05:54:27 wikitech-static kernel: [ 2.224576] usbhid: USB HID core driver
Nov 8 05:54:27 wikitech-static kernel: [ 2.225450] input: QEMU 0.10.2 QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-2/1-2:1.0/0003:0627:0001.0001/input/input3
Nov 8 05:54:27 wikitech-static kernel: [ 2.225638] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Pointer [QEMU 0.10.2 QEMU USB Tablet] on usb-0000:00:01.2-2/input0
Nov 8 05:54:27 wikitech-static kernel: [ 4.103630] EXT4-fs (xvda1): mounted filesystem with ordered data mode. Opts: (null)
Nov 8 05:54:27 wikitech-static kernel: [ 6.069087] ip_tables: (C) 2000-2006 Netfilter Core Team
Nov 8 05:54:27 wikitech-static kernel: [ 7.523995] EXT4-fs (xvda1): re-mounted. Opts: errors=remount-ro,barrier=0
Nov 8 05:54:27 wikitech-static kernel: [ 7.784495] Adding 1048572k swap on /swapfile. Priority:-1 extents:46 across:8470524k SSFS
Nov 8 05:54:27 wikitech-static kernel: [ 8.481975] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4
Nov 8 05:54:27 wikitech-static kernel: [ 8.481981] ACPI: Power Button [PWRF]
Nov 8 05:54:27 wikitech-static kernel: [ 8.482036] input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input5
Nov 8 05:54:27 wikitech-static kernel: [ 8.482038] ACPI: Sleep Button [SLPF]
Nov 8 05:54:27 wikitech-static kernel: [ 8.642490] [drm] Initialized
Nov 8 05:54:27 wikitech-static kernel: [ 8.706776] parport_pc 00:08: reported by Plug and Play ACPI
Nov 8 05:54:27 wikitech-static kernel: [ 8.707493] parport0: PC-style at 0x378, irq 7 [PCSPP,TRISTATE]
Nov 8 05:54:27 wikitech-static kernel: [ 8.721839] xen: --> pirq=25 -> irq=24 (gsi=24)
Nov 8 05:54:27 wikitech-static kernel: [ 8.731060] [TTM] Zone kernel: Available graphics memory: 507170 kiB
Nov 8 05:54:27 wikitech-static kernel: [ 8.731062] [TTM] Initializing pool allocator
Nov 8 05:54:27 wikitech-static kernel: [ 8.731067] [TTM] Initializing DMA pool allocator
Nov 8 05:54:27 wikitech-static kernel: [ 8.731643] [drm] fb mappable at 0xF0000000
Nov 8 05:54:27 wikitech-static kernel: [ 8.731644] [drm] vram aper at 0xF0000000
Nov 8 05:54:27 wikitech-static kernel: [ 8.731644] [drm] size 33554432
Nov 8 05:54:27 wikitech-static kernel: [ 8.731645] [drm] fb depth is 24
Nov 8 05:54:27 wikitech-static kernel: [ 8.731646] [drm] pitch is 3072
Nov 8 05:54:27 wikitech-static kernel: [ 8.731701] fbcon: cirrusdrmfb (fb0) is primary device
Nov 8 05:54:27 wikitech-static kernel: [ 8.806233] input: PC Speaker as /devices/platform/pcspkr/input/input6
Nov 8 05:54:27 wikitech-static kernel: [ 8.981652] ppdev: user-space parallel port driver
Nov 8 05:54:27 wikitech-static kernel: [ 8.984939] Console: switching to colour frame buffer device 128x48
Nov 8 05:54:27 wikitech-static kernel: [ 9.059343] cirrus 0000:00:02.0: fb0: cirrusdrmfb frame buffer device
Nov 8 05:54:27 wikitech-static kernel: [ 9.187627] EDAC MC: Ver: 3.0.0
Nov 8 05:54:27 wikitech-static kernel: [ 9.189004] [drm] Initialized cirrus 1.0.0 20110418 for 0000:00:02.0 on minor 0
Nov 8 05:54:27 wikitech-static kernel: [ 9.190037] MCE: In-kernel MCE decoding enabled.
Nov 8 05:54:27 wikitech-static systemd[1]: Starting Flush Journal to Persistent Storage...
Nov 8 05:54:27 wikitech-static systemd[1]: Started Load/Save Random Seed.
Nov 8 05:54:27 wikitech-static systemd[1]: Activated swap /swapfile.
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Swap.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Flush Journal to Persistent Storage.
Nov 8 05:54:27 wikitech-static systemd[1]: Started udev Coldplug all Devices.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Create Static Device Nodes in /dev.
Nov 8 05:54:27 wikitech-static systemd[1]: Starting udev Kernel Device Manager...
Nov 8 05:54:27 wikitech-static systemd[1]: Started Set the console keyboard layout.
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Local File Systems (Pre).
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Local File Systems.
Nov 8 05:54:27 wikitech-static systemd[1]: Starting Set console font and keymap...
Nov 8 05:54:27 wikitech-static systemd[1]: Starting Create Volatile Files and Directories...
Nov 8 05:54:27 wikitech-static systemd[1]: Started Set console font and keymap.
Nov 8 05:54:27 wikitech-static systemd[1]: Started udev Kernel Device Manager.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Create Volatile Files and Directories.
Nov 8 05:54:27 wikitech-static systemd[1]: Starting Update UTMP about System Boot/Shutdown...
Nov 8 05:54:27 wikitech-static systemd[1]: Starting Network Time Synchronization...
Nov 8 05:54:27 wikitech-static systemd[1]: Started Update UTMP about System Boot/Shutdown.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Network Time Synchronization.
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target System Time Synchronized.
Nov 8 05:54:27 wikitech-static cloud-init[226]: Cloud-init v. 0.7.9 running 'init-local' at Mon, 08 Nov 2021 05:54:21 +0000. Up 15.20 seconds.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Initial cloud-init job (pre-networking).
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Network (Pre).
Nov 8 05:54:27 wikitech-static systemd[1]: Starting Raise network interfaces...
Nov 8 05:54:27 wikitech-static ifup[377]: Waiting for DAD... Done
Nov 8 05:54:27 wikitech-static systemd[1]: Started Raise network interfaces.
Nov 8 05:54:27 wikitech-static systemd[1]: Starting Initial cloud-init job (metadata service crawler)...
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Network.
Nov 8 05:54:27 wikitech-static cloud-init[615]: Cloud-init v. 0.7.9 running 'init' at Mon, 08 Nov 2021 05:54:25 +0000. Up 18.88 seconds.
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: ++++++++++++++++++++++++++++++++Net device info++++++++++++++++++++++++++++++++
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +--------+------+-----------------+---------------+-------+-------------------+
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | Device | Up | Address | Mask | Scope | Hw-Address |
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +--------+------+-----------------+---------------+-------+-------------------+
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | eth0: | True | 192.237.162.200 | 255.255.255.0 | . | bc:76:4e:10:2e:d5 |
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | eth0: | True | . | . | d | bc:76:4e:10:2e:d5 |
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | lo: | True | 127.0.0.1 | 255.0.0.0 | . | . |
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | lo: | True | . | . | d | . |
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | eth1: | True | 10.208.138.205 | 255.255.128.0 | . | bc:76:4e:10:3e:64 |
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | eth1: | True | . | . | d | bc:76:4e:10:3e:64 |
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +--------+------+-----------------+---------------+-------+-------------------+
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +++++++++++++++++++++++++++++++Route IPv4 info+++++++++++++++++++++++++++++++
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +-------+---------------+---------------+---------------+-----------+-------+
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | Route | Destination | Gateway | Genmask | Interface | Flags |
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +-------+---------------+---------------+---------------+-----------+-------+
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | 0 | 0.0.0.0 | 192.237.162.1 | 0.0.0.0 | eth0 | UG |
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | 1 | 10.176.0.0 | 10.208.128.1 | 255.240.0.0 | eth1 | UG |
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | 2 | 10.208.0.0 | 10.208.128.1 | 255.240.0.0 | eth1 | UG |
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | 3 | 10.208.128.0 | 0.0.0.0 | 255.255.128.0 | eth1 | U |
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: | 4 | 192.237.162.0 | 0.0.0.0 | 255.255.255.0 | eth0 | U |
Nov 8 05:54:27 wikitech-static cloud-init[615]: ci-info: +-------+---------------+---------------+---------------+-----------+-------+
Nov 8 05:54:27 wikitech-static systemd[1]: Started Initial cloud-init job (metadata service crawler).
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Network is Online.
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target System Initialization.
Nov 8 05:54:27 wikitech-static systemd[1]: certbot.timer: Adding 3h 55min 15.302870s random time.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Run certbot twice daily.
Nov 8 05:54:27 wikitech-static systemd[1]: apt-daily.timer: Adding 6h 28min 36.762679s random time.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Daily apt download activities.
Nov 8 05:54:27 wikitech-static systemd[1]: Listening on D-Bus System Message Bus Socket.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Clean PHP session files every 30 mins.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Daily Cleanup of Temporary Directories.
Nov 8 05:54:27 wikitech-static systemd[1]: apt-daily-upgrade.timer: Adding 24min 24.407279s random time.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Daily apt upgrade and clean activities.
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Timers.
Nov 8 05:54:27 wikitech-static systemd[1]: Listening on ACPID Listen Socket.
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Sockets.
Nov 8 05:54:27 wikitech-static systemd[1]: Started ACPI Events Check.
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Paths.
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Basic System.
Nov 8 05:54:27 wikitech-static systemd[1]: Starting LSB: XenServer Virtual Machine daemon providing host integration services...
Nov 8 05:54:27 wikitech-static systemd[1]: Starting The Apache HTTP Server...
Nov 8 05:54:27 wikitech-static systemd[1]: Starting MariaDB 10.1.48 database server...
Nov 8 05:54:27 wikitech-static systemd[1]: Starting /etc/rc.local Compatibility...
Nov 8 05:54:27 wikitech-static systemd[1]: Started D-Bus System Message Bus.
Nov 8 05:54:27 wikitech-static xe-linux-distribution[656]: Mounting xenfs on /proc/xen: OK
Nov 8 05:54:27 wikitech-static systemd[1]: Starting System Logging Service...
Nov 8 05:54:27 wikitech-static systemd[1]: Started irqbalance daemon.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Regular background program processing daemon.
Nov 8 05:54:27 wikitech-static systemd[1]: Starting SSHGuard...
Nov 8 05:54:27 wikitech-static systemd[1]: Started memcached daemon.
Nov 8 05:54:27 wikitech-static systemd[1]: Started ACPI event daemon.
Nov 8 05:54:27 wikitech-static cron[688]: (CRON) INFO (pidfile fd = 3)
Nov 8 05:54:27 wikitech-static systemd[1]: Starting Login Service...
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Cloud-config availability.
Nov 8 05:54:27 wikitech-static systemd[1]: Starting Apply the settings specified in cloud-config...
Nov 8 05:54:27 wikitech-static systemd[1]: Starting Permit User Sessions...
Nov 8 05:54:27 wikitech-static systemd[1]: Started /etc/rc.local Compatibility.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Login Service.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Permit User Sessions.
Nov 8 05:54:27 wikitech-static systemd[1]: Started Getty on tty1.
Nov 8 05:54:27 wikitech-static systemd[1]: Reached target Login Prompts.
Nov 8 05:54:27 wikitech-static /usr/sbin/irqbalance: Balancing is ineffective on systems with a single cpu. Shutting down
Nov 8 05:54:27 wikitech-static xe-linux-distribution[656]: Detecting Linux distribution version: OK
Nov 8 05:54:27 wikitech-static cron[688]: (CRON) INFO (Running @reboot jobs)
Nov 8 05:54:27 wikitech-static liblogging-stdlog: [origin software="rsyslogd" swVersion="8.24.0" x-pid="686" x-info="http://www.rsyslog.com"] start
Nov 8 05:54:27 wikitech-static systemd[1]: Started System Logging Service.
Nov 8 05:54:27 wikitech-static xe-linux-distribution[656]: Starting xe daemon: OK
Nov 8 05:54:27 wikitech-static systemd[1]: Started LSB: XenServer Virtual Machine daemon providing host integration services.
Nov 8 05:54:27 wikitech-static systemd[1]: Starting nova-agent...
Nov 8 05:54:27 wikitech-static kernel: [ 20.674120] ip6_tables: (C) 2000-2006 Netfilter Core Team
Nov 8 05:54:27 wikitech-static acpid: starting up with netlink and the input layer
Nov 8 05:54:27 wikitech-static systemd[1]: Started SSHGuard.
Nov 8 05:54:27 wikitech-static acpid: 1 rule loaded
Nov 8 05:54:27 wikitech-static acpid: waiting for events: event logging is off
Nov 8 05:54:27 wikitech-static systemd[1]: Starting OpenBSD Secure Shell server...
Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: Chain INPUT (policy ACCEPT)
Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: target prot opt source destination
Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: sshguard all -- 0.0.0.0/0 0.0.0.0/0
Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: Chain FORWARD (policy ACCEPT)
Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: target prot opt source destination
Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: Chain OUTPUT (policy ACCEPT)
Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: target prot opt source destination
Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: Chain sshguard (1 references)
Nov 8 05:54:27 wikitech-static sshguard-journalctl[745]: target prot opt source destination
Nov 8 05:54:28 wikitech-static systemd[1]: Started OpenBSD Secure Shell server.
Nov 8 05:54:28 wikitech-static cloud-init[694]: Cloud-init v. 0.7.9 running 'modules:config' at Mon, 08 Nov 2021 05:54:28 +0000. Up 21.55 seconds.
Nov 8 05:54:28 wikitech-static mysqld[896]: 2021-11-08 5:54:28 140647699062144 [Note] /usr/sbin/mysqld (mysqld 10.1.48-MariaDB-0+deb9u2) starting as process 896 ...
Nov 8 05:54:28 wikitech-static systemd[1]: Started Apply the settings specified in cloud-config.
Nov 8 05:54:29 wikitech-static systemd[1]: Started The Apache HTTP Server.
Nov 8 05:54:29 wikitech-static systemd[1]: Started nova-agent.
Nov 8 05:54:31 wikitech-static kernel: [ 25.007477] random: crng init done
Nov 8 05:54:31 wikitech-static kernel: [ 25.007480] random: 7 urandom warning(s) missed due to ratelimiting
Nov 8 05:54:34 wikitech-static systemd[1]: Started MariaDB 10.1.48 database server.
Nov 8 05:54:34 wikitech-static systemd[1]: Reached target Multi-User System.
Nov 8 05:54:34 wikitech-static systemd[1]: Starting Execute cloud user/final scripts...
Nov 8 05:54:34 wikitech-static systemd[1]: Reached target Graphical Interface.
Nov 8 05:54:34 wikitech-static systemd[1]: Starting Update UTMP about System Runlevel Changes...
Nov 8 05:54:34 wikitech-static systemd[1]: Started Update UTMP about System Runlevel Changes.
Nov 8 05:54:35 wikitech-static cloud-init[954]: Cloud-init v. 0.7.9 running 'modules:final' at Mon, 08 Nov 2021 05:54:34 +0000. Up 28.12 seconds.
Nov 8 05:54:35 wikitech-static cloud-init[954]: Cloud-init v. 0.7.9 finished at Mon, 08 Nov 2021 05:54:35 +0000. Datasource DataSourceNone. Up 28.43 seconds
Nov 8 05:54:35 wikitech-static cloud-init[954]: 2021-11-08 05:54:35,196 - cc_final_message.py[WARNING]: Used fallback datasource
Nov 8 05:54:35 wikitech-static systemd[1]: Started Execute cloud user/final scripts.
Nov 8 05:54:35 wikitech-static systemd[1]: Reached target Cloud-init target.
Nov 8 05:54:35 wikitech-static systemd[1]: Startup finished in 5.560s (kernel) + 22.966s (userspace) = 28.527s.
Nov 8 05:54:46 wikitech-static systemd-timesyncd[287]: Synchronized to time server [2001:4998:58:183a::1001]:123 (2.debian.pool.ntp.org).
Nov 8 05:56:02 wikitech-static CRON[1040]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 05:56:02 wikitech-static CRON[1041]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 05:56:03 wikitech-static check_icinga[1043]: 2021-11-08 05:56:03,677 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 05:56:03 wikitech-static check_icinga[1042]: 2021-11-08 05:56:03,678 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 05:56:06 wikitech-static check_icinga[1042]: 2021-11-08 05:56:06,769 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 05:56:06 wikitech-static check_icinga[1042]: 2021-11-08 05:56:06,775 [INFO] Emailing jcrespo for alert2001.wikimedia.org
Nov 8 05:56:06 wikitech-static check_icinga[1043]: 2021-11-08 05:56:06,776 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 05:56:06 wikitech-static check_icinga[1043]: 2021-11-08 05:56:06,777 [INFO] Emailing andrew-email for alert1001.wikimedia.org
Nov 8 05:56:07 wikitech-static check_icinga[1042]: 2021-11-08 05:56:07,174 [INFO] Emailing vgutierrez for alert2001.wikimedia.org
Nov 8 05:56:07 wikitech-static check_icinga[1043]: 2021-11-08 05:56:07,244 [INFO] Emailing dcaro-email for alert1001.wikimedia.org
Nov 8 05:56:07 wikitech-static check_icinga[1042]: 2021-11-08 05:56:07,485 [INFO] Emailing elukey for alert2001.wikimedia.org
Nov 8 05:56:07 wikitech-static check_icinga[1043]: 2021-11-08 05:56:07,864 [INFO] Emailing cdanis for alert1001.wikimedia.org
Nov 8 05:56:08 wikitech-static check_icinga[1042]: 2021-11-08 05:56:08,165 [INFO] Emailing cdanis for alert2001.wikimedia.org
Nov 8 05:56:08 wikitech-static check_icinga[1043]: 2021-11-08 05:56:08,200 [INFO] Emailing glavagetto for alert1001.wikimedia.org
Nov 8 05:56:08 wikitech-static check_icinga[1042]: 2021-11-08 05:56:08,434 [INFO] Emailing lsobanski for alert2001.wikimedia.org
Nov 8 05:56:08 wikitech-static check_icinga[1043]: 2021-11-08 05:56:08,727 [INFO] Emailing mmandere for alert1001.wikimedia.org
Nov 8 05:56:08 wikitech-static check_icinga[1042]: 2021-11-08 05:56:08,984 [INFO] Emailing cmjohnson for alert2001.wikimedia.org
Nov 8 05:56:08 wikitech-static check_icinga[1043]: 2021-11-08 05:56:08,990 [INFO] Emailing wpao for alert1001.wikimedia.org
Nov 8 05:56:09 wikitech-static check_icinga[1042]: 2021-11-08 05:56:09,513 [INFO] Emailing marostegui for alert2001.wikimedia.org
Nov 8 05:56:09 wikitech-static check_icinga[1043]: 2021-11-08 05:56:09,573 [INFO] Emailing jmm for alert1001.wikimedia.org
Nov 8 05:56:09 wikitech-static check_icinga[1042]: 2021-11-08 05:56:09,847 [INFO] Emailing volans for alert2001.wikimedia.org
Nov 8 05:56:10 wikitech-static check_icinga[1042]: 2021-11-08 05:56:10,120 [INFO] Emailing bblack for alert2001.wikimedia.org
Nov 8 05:56:10 wikitech-static check_icinga[1042]: 2021-11-08 05:56:10,832 [INFO] Emailing ema for alert2001.wikimedia.org
Nov 8 05:56:11 wikitech-static check_icinga[1043]: 2021-11-08 05:56:11,182 [INFO] Emailing jijiki for alert1001.wikimedia.org
Nov 8 05:56:11 wikitech-static check_icinga[1042]: 2021-11-08 05:56:11,360 [INFO] Emailing mdipietro for alert2001.wikimedia.org
Nov 8 05:56:11 wikitech-static check_icinga[1043]: 2021-11-08 05:56:11,701 [INFO] Emailing ariel for alert1001.wikimedia.org
Nov 8 05:56:11 wikitech-static check_icinga[1042]: 2021-11-08 05:56:11,907 [INFO] Emailing akosiaris for alert2001.wikimedia.org
Nov 8 05:56:12 wikitech-static check_icinga[1043]: 2021-11-08 05:56:12,228 [INFO] Emailing vgutierrez for alert1001.wikimedia.org
Nov 8 05:56:12 wikitech-static check_icinga[1043]: 2021-11-08 05:56:12,745 [INFO] Emailing lsobanski for alert1001.wikimedia.org
Nov 8 05:56:12 wikitech-static check_icinga[1042]: 2021-11-08 05:56:12,748 [INFO] Emailing rkemper for alert2001.wikimedia.org
Nov 8 05:56:13 wikitech-static check_icinga[1043]: 2021-11-08 05:56:13,052 [INFO] Emailing ema for alert1001.wikimedia.org
Nov 8 05:56:13 wikitech-static check_icinga[1042]: 2021-11-08 05:56:13,237 [INFO] Emailing herron for alert2001.wikimedia.org
Nov 8 05:56:13 wikitech-static check_icinga[1043]: 2021-11-08 05:56:13,328 [INFO] Emailing fgiunchedi for alert1001.wikimedia.org
Nov 8 05:56:13 wikitech-static check_icinga[1042]: 2021-11-08 05:56:13,530 [INFO] Emailing wpao for alert2001.wikimedia.org
Nov 8 05:56:13 wikitech-static check_icinga[1043]: 2021-11-08 05:56:13,586 [INFO] Emailing herron for alert1001.wikimedia.org
Nov 8 05:56:13 wikitech-static check_icinga[1043]: 2021-11-08 05:56:13,852 [INFO] Emailing bblack for alert1001.wikimedia.org
Nov 8 05:56:14 wikitech-static check_icinga[1042]: 2021-11-08 05:56:14,013 [INFO] Emailing aborrero-email for alert2001.wikimedia.org
Nov 8 05:56:14 wikitech-static check_icinga[1043]: 2021-11-08 05:56:14,391 [INFO] Emailing bstorm-email for alert1001.wikimedia.org
Nov 8 05:56:14 wikitech-static check_icinga[1042]: 2021-11-08 05:56:14,526 [INFO] Emailing jmm for alert2001.wikimedia.org
Nov 8 05:56:14 wikitech-static check_icinga[1043]: 2021-11-08 05:56:14,669 [INFO] Emailing otto for alert1001.wikimedia.org
Nov 8 05:56:14 wikitech-static check_icinga[1043]: 2021-11-08 05:56:14,970 [INFO] Emailing mdipietro for alert1001.wikimedia.org
Nov 8 05:56:14 wikitech-static check_icinga[1042]: 2021-11-08 05:56:14,986 [INFO] Emailing jbond for alert2001.wikimedia.org
Nov 8 05:56:15 wikitech-static check_icinga[1043]: 2021-11-08 05:56:15,257 [INFO] Emailing mark for alert1001.wikimedia.org
Nov 8 05:56:15 wikitech-static check_icinga[1042]: 2021-11-08 05:56:15,508 [INFO] Emailing fgiunchedi for alert2001.wikimedia.org
Nov 8 05:56:15 wikitech-static check_icinga[1043]: 2021-11-08 05:56:15,524 [INFO] Emailing jbond for alert1001.wikimedia.org
Nov 8 05:56:15 wikitech-static check_icinga[1042]: 2021-11-08 05:56:15,795 [INFO] Emailing dcaro-email for alert2001.wikimedia.org
Nov 8 05:56:16 wikitech-static check_icinga[1043]: 2021-11-08 05:56:16,038 [INFO] Emailing robh for alert1001.wikimedia.org
Nov 8 05:56:16 wikitech-static check_icinga[1042]: 2021-11-08 05:56:16,269 [INFO] Emailing faidon for alert2001.wikimedia.org
Nov 8 05:56:16 wikitech-static check_icinga[1042]: 2021-11-08 05:56:16,556 [INFO] Emailing nskaggs for alert2001.wikimedia.org
Nov 8 05:56:16 wikitech-static check_icinga[1043]: 2021-11-08 05:56:16,571 [INFO] Emailing marostegui for alert1001.wikimedia.org
Nov 8 05:56:16 wikitech-static check_icinga[1043]: 2021-11-08 05:56:16,859 [INFO] Emailing volans for alert1001.wikimedia.org
Nov 8 05:56:17 wikitech-static check_icinga[1042]: 2021-11-08 05:56:17,048 [INFO] Emailing cwhite for alert2001.wikimedia.org
Nov 8 05:56:17 wikitech-static check_icinga[1043]: 2021-11-08 05:56:17,126 [INFO] Emailing fsero for alert1001.wikimedia.org
Nov 8 05:56:17 wikitech-static check_icinga[1043]: 2021-11-08 05:56:17,398 [INFO] Emailing dzahn for alert1001.wikimedia.org
Nov 8 05:56:17 wikitech-static check_icinga[1042]: 2021-11-08 05:56:17,564 [INFO] Emailing robh for alert2001.wikimedia.org
Nov 8 05:56:17 wikitech-static check_icinga[1042]: 2021-11-08 05:56:17,830 [INFO] Emailing otto for alert2001.wikimedia.org
Nov 8 05:56:17 wikitech-static check_icinga[1043]: 2021-11-08 05:56:17,852 [INFO] Emailing gehel for alert1001.wikimedia.org
Nov 8 05:56:18 wikitech-static check_icinga[1043]: 2021-11-08 05:56:18,100 [INFO] Emailing jcrespo for alert1001.wikimedia.org
Nov 8 05:56:18 wikitech-static check_icinga[1042]: 2021-11-08 05:56:18,109 [INFO] Emailing dzahn for alert2001.wikimedia.org
Nov 8 05:56:18 wikitech-static check_icinga[1042]: 2021-11-08 05:56:18,387 [INFO] Emailing glavagetto for alert2001.wikimedia.org
Nov 8 05:56:18 wikitech-static check_icinga[1043]: 2021-11-08 05:56:18,580 [INFO] Emailing akosiaris for alert1001.wikimedia.org
Nov 8 05:56:18 wikitech-static check_icinga[1042]: 2021-11-08 05:56:18,928 [INFO] Emailing mark for alert2001.wikimedia.org
Nov 8 05:56:19 wikitech-static check_icinga[1043]: 2021-11-08 05:56:19,098 [INFO] Emailing rlazarus for alert1001.wikimedia.org
Nov 8 05:56:19 wikitech-static check_icinga[1043]: 2021-11-08 05:56:19,319 [INFO] Emailing nskaggs for alert1001.wikimedia.org
Nov 8 05:56:19 wikitech-static check_icinga[1042]: 2021-11-08 05:56:19,413 [INFO] Emailing jijiki for alert2001.wikimedia.org
Nov 8 05:56:19 wikitech-static check_icinga[1043]: 2021-11-08 05:56:19,592 [INFO] Emailing tstarling for alert1001.wikimedia.org
Nov 8 05:56:19 wikitech-static check_icinga[1042]: 2021-11-08 05:56:19,704 [INFO] Emailing rlazarus for alert2001.wikimedia.org
Nov 8 05:56:19 wikitech-static check_icinga[1043]: 2021-11-08 05:56:19,882 [INFO] Emailing elukey for alert1001.wikimedia.org
Nov 8 05:56:20 wikitech-static check_icinga[1042]: 2021-11-08 05:56:20,187 [INFO] Emailing andrew-email for alert2001.wikimedia.org
Nov 8 05:56:20 wikitech-static check_icinga[1043]: 2021-11-08 05:56:20,401 [INFO] Emailing aborrero-email for alert1001.wikimedia.org
Nov 8 05:56:20 wikitech-static check_icinga[1042]: 2021-11-08 05:56:20,467 [INFO] Emailing gehel for alert2001.wikimedia.org
Nov 8 05:56:20 wikitech-static check_icinga[1043]: 2021-11-08 05:56:20,671 [INFO] Emailing cmjohnson for alert1001.wikimedia.org
Nov 8 05:56:20 wikitech-static check_icinga[1042]: 2021-11-08 05:56:20,725 [INFO] Emailing mmandere for alert2001.wikimedia.org
Nov 8 05:56:21 wikitech-static check_icinga[1042]: 2021-11-08 05:56:21,000 [INFO] Emailing tstarling for alert2001.wikimedia.org
Nov 8 05:56:21 wikitech-static check_icinga[1043]: 2021-11-08 05:56:21,156 [INFO] Emailing rkemper for alert1001.wikimedia.org
Nov 8 05:56:21 wikitech-static check_icinga[1042]: 2021-11-08 05:56:21,251 [INFO] Emailing ariel for alert2001.wikimedia.org
Nov 8 05:56:21 wikitech-static check_icinga[1043]: 2021-11-08 05:56:21,429 [INFO] Emailing cwhite for alert1001.wikimedia.org
Nov 8 05:56:21 wikitech-static check_icinga[1043]: 2021-11-08 05:56:21,714 [INFO] Emailing faidon for alert1001.wikimedia.org
Nov 8 05:56:21 wikitech-static check_icinga[1042]: 2021-11-08 05:56:21,792 [INFO] Emailing fsero for alert2001.wikimedia.org
Nov 8 05:56:22 wikitech-static check_icinga[1042]: 2021-11-08 05:56:22,044 [INFO] Emailing bstorm-email for alert2001.wikimedia.org
Nov 8 05:56:22 wikitech-static check_icinga[1043]: 2021-11-08 05:56:22,242 [INFO] Paging victorops for alert1001.wikimedia.org
Nov 8 05:58:01 wikitech-static CRON[1120]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 05:58:01 wikitech-static CRON[1121]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 05:58:02 wikitech-static check_icinga[1122]: 2021-11-08 05:58:02,675 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 05:58:02 wikitech-static check_icinga[1123]: 2021-11-08 05:58:02,702 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 05:58:05 wikitech-static check_icinga[1123]: 2021-11-08 05:58:05,775 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 05:58:05 wikitech-static check_icinga[1122]: 2021-11-08 05:58:05,936 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 06:00:01 wikitech-static CRON[1203]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 06:00:01 wikitech-static CRON[1204]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 06:00:02 wikitech-static check_icinga[1206]: 2021-11-08 06:00:02,071 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 06:00:02 wikitech-static check_icinga[1205]: 2021-11-08 06:00:02,099 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 06:00:05 wikitech-static check_icinga[1206]: 2021-11-08 06:00:05,118 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 06:00:05 wikitech-static check_icinga[1205]: 2021-11-08 06:00:05,209 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 06:02:01 wikitech-static CRON[1288]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 06:02:01 wikitech-static CRON[1289]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 06:02:02 wikitech-static check_icinga[1291]: 2021-11-08 06:02:02,332 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 06:02:02 wikitech-static check_icinga[1290]: 2021-11-08 06:02:02,334 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 06:02:05 wikitech-static check_icinga[1290]: 2021-11-08 06:02:05,552 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 06:02:05 wikitech-static check_icinga[1291]: 2021-11-08 06:02:05,607 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 06:02:32 wikitech-static systemd[1]: Created slice User Slice of root.
Nov 8 06:02:32 wikitech-static systemd[1]: Started Session 9 of user root.
Nov 8 06:02:32 wikitech-static systemd[1]: Starting User Manager for UID 0...
Nov 8 06:02:32 wikitech-static systemd[1342]: Listening on GnuPG cryptographic agent (ssh-agent emulation).
Nov 8 06:02:32 wikitech-static systemd[1342]: Listening on GnuPG cryptographic agent and passphrase cache (restricted).
Nov 8 06:02:32 wikitech-static systemd[1342]: Listening on GnuPG cryptographic agent (access for web browsers).
Nov 8 06:02:32 wikitech-static systemd[1342]: Reached target Timers.
Nov 8 06:02:32 wikitech-static systemd[1342]: Listening on GnuPG network certificate management daemon.
Nov 8 06:02:32 wikitech-static systemd[1342]: Reached target Paths.
Nov 8 06:02:32 wikitech-static systemd[1342]: Listening on GnuPG cryptographic agent and passphrase cache.
Nov 8 06:02:32 wikitech-static systemd[1342]: Reached target Sockets.
Nov 8 06:02:32 wikitech-static systemd[1342]: Reached target Basic System.
Nov 8 06:02:32 wikitech-static systemd[1342]: Reached target Default.
Nov 8 06:02:32 wikitech-static systemd[1342]: Startup finished in 254ms.
Nov 8 06:02:32 wikitech-static systemd[1]: Started User Manager for UID 0.
Nov 8 06:04:01 wikitech-static CRON[1384]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 06:04:01 wikitech-static CRON[1385]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 06:04:02 wikitech-static check_icinga[1388]: 2021-11-08 06:04:02,832 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 06:04:02 wikitech-static check_icinga[1387]: 2021-11-08 06:04:02,839 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 06:04:05 wikitech-static check_icinga[1387]: 2021-11-08 06:04:05,943 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 06:04:06 wikitech-static check_icinga[1388]: 2021-11-08 06:04:06,101 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 06:06:01 wikitech-static CRON[1462]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 06:06:01 wikitech-static CRON[1463]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 06:06:02 wikitech-static check_icinga[1465]: 2021-11-08 06:06:02,292 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 06:06:02 wikitech-static check_icinga[1464]: 2021-11-08 06:06:02,293 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 06:06:05 wikitech-static check_icinga[1465]: 2021-11-08 06:06:05,602 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 06:06:05 wikitech-static check_icinga[1464]: 2021-11-08 06:06:05,659 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 06:08:01 wikitech-static CRON[1608]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 06:08:01 wikitech-static CRON[1609]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 06:08:02 wikitech-static check_icinga[1610]: 2021-11-08 06:08:02,820 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 06:08:02 wikitech-static check_icinga[1611]: 2021-11-08 06:08:02,823 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 06:08:06 wikitech-static check_icinga[1610]: 2021-11-08 06:08:06,021 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 06:08:06 wikitech-static check_icinga[1611]: 2021-11-08 06:08:06,026 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 06:09:01 wikitech-static CRON[1660]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Nov 8 06:09:19 wikitech-static systemd[1]: Starting Cleanup of Temporary Directories...
Nov 8 06:09:19 wikitech-static systemd[1]: Starting Clean php session files...
Nov 8 06:09:19 wikitech-static systemd[1]: Started Cleanup of Temporary Directories.
Nov 8 06:09:20 wikitech-static systemd[1]: Started Clean php session files.
Nov 8 06:10:01 wikitech-static CRON[1801]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 06:10:01 wikitech-static CRON[1802]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 06:10:02 wikitech-static check_icinga[1803]: 2021-11-08 06:10:02,272 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 06:10:02 wikitech-static check_icinga[1804]: 2021-11-08 06:10:02,340 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 06:10:05 wikitech-static check_icinga[1804]: 2021-11-08 06:10:05,435 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 06:10:05 wikitech-static check_icinga[1803]: 2021-11-08 06:10:05,572 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 06:11:01 wikitech-static CRON[1851]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga_validate_config" /root/check_icinga_validate_config_crontab.sh)
Nov 8 06:11:02 wikitech-static check_icinga_validate_config[1852]: Valid config, nothing to do.
Nov 8 06:12:01 wikitech-static CRON[1888]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 06:12:01 wikitech-static CRON[1889]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 06:12:02 wikitech-static check_icinga[1890]: 2021-11-08 06:12:02,507 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 06:12:02 wikitech-static check_icinga[1891]: 2021-11-08 06:12:02,517 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 06:12:05 wikitech-static check_icinga[1890]: 2021-11-08 06:12:05,638 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 06:12:05 wikitech-static check_icinga[1891]: 2021-11-08 06:12:05,680 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 06:14:01 wikitech-static CRON[1978]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 06:14:01 wikitech-static CRON[1979]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 06:14:02 wikitech-static check_icinga[1980]: 2021-11-08 06:14:02,862 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 06:14:02 wikitech-static check_icinga[1981]: 2021-11-08 06:14:02,868 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 06:14:06 wikitech-static check_icinga[1980]: 2021-11-08 06:14:06,057 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 06:14:06 wikitech-static check_icinga[1981]: 2021-11-08 06:14:06,096 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 06:15:56 wikitech-static systemd[1]: Started Session 25 of user root.
Nov 8 06:16:01 wikitech-static CRON[2105]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 06:16:01 wikitech-static CRON[2106]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 06:16:02 wikitech-static check_icinga[2107]: 2021-11-08 06:16:02,276 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 06:16:02 wikitech-static check_icinga[2108]: 2021-11-08 06:16:02,310 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 06:16:05 wikitech-static check_icinga[2108]: 2021-11-08 06:16:05,400 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 06:16:05 wikitech-static check_icinga[2107]: 2021-11-08 06:16:05,488 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 06:17:01 wikitech-static CRON[2154]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Nov 8 06:18:01 wikitech-static CRON[2192]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 06:18:01 wikitech-static CRON[2193]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 06:18:02 wikitech-static check_icinga[2194]: 2021-11-08 06:18:02,662 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 06:18:02 wikitech-static check_icinga[2195]: 2021-11-08 06:18:02,668 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 06:18:05 wikitech-static check_icinga[2194]: 2021-11-08 06:18:05,752 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 06:18:05 wikitech-static check_icinga[2195]: 2021-11-08 06:18:05,914 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 06:18:40 wikitech-static systemd[1]: getty@tty1.service: Service has no hold-off time, scheduling restart.
Nov 8 06:18:40 wikitech-static systemd[1]: Stopped Getty on tty1.
Nov 8 06:18:40 wikitech-static systemd[1]: Started Getty on tty1.
Nov 8 06:20:01 wikitech-static CRON[2402]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert2001.wikimedia.org)
Nov 8 06:20:01 wikitech-static CRON[2403]: (root) CMD (/usr/bin/systemd-cat -t "check_icinga" /usr/local/bin/check_icinga alert1001.wikimedia.org)
Nov 8 06:20:03 wikitech-static check_icinga[2405]: 2021-11-08 06:20:03,038 [INFO] Checking icinga host alert1001.wikimedia.org (is_active=True, active_host=alert1001.wikimedia.org)
Nov 8 06:20:03 wikitech-static check_icinga[2404]: 2021-11-08 06:20:03,102 [INFO] Checking icinga host alert2001.wikimedia.org (is_active=False, active_host=alert1001.wikimedia.org)
Nov 8 06:20:06 wikitech-static check_icinga[2404]: 2021-11-08 06:20:06,224 [INFO] Check for host alert2001.wikimedia.org: OK
Nov 8 06:20:06 wikitech-static check_icinga[2405]: 2021-11-08 06:20:06,231 [INFO] Check for host alert1001.wikimedia.org: OK
Nov 8 06:21:19 wikitech-static systemd[1]: Started Session 33 of user root.

File Metadata

Mime Type
text/plain
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
9233161
Default Alt Text
syslog (822 KB)

Event Timeline

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits