Something else that didn't work well: the current version of ircecho doesn't seem to attempt reopening the files it is supposed to look for in /var/log/icinga. I have "fixed" this by creating said .log files and then restarting ircecho, which then did properly open/tail the files
Description
Description
Details
Details
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| icinga: create ircecho log files | operations/puppet | production | +14 -0 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | dcaro | T313444 Streamline WMCS Alerting and Paging | |||
| Resolved | dcaro | T320973 [wmcs][alerting] Allow silencing alerts metricsinfra alerts on alerts.wikimedia.org | |||
| Resolved | andrea.denisse | T333615 Upgrade alert* hosts to Bookworm | |||
| Resolved | andrea.denisse | T359292 ircecho doesn't attempt to open log files created after startup |
Event Timeline
Comment Actions
Logs from ircecho.service
Mar 05 15:14:33 alert2001 ircecho[1136326]: Failed to open file: /var/log/icinga/irc-analytics.log Mar 05 15:14:33 alert2001 ircecho[1136326]: [2024-03-05 15:14:33,941 pyinotify ERROR] add_watch: cannot watch /var/log/icinga/irc-analytics.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: ERROR:pyinotify:add_watch: cannot watch /var/log/icinga/irc-analytics.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: Opening: /var/log/icinga/irc-cloud-feed.log Mar 05 15:14:33 alert2001 ircecho[1136326]: Failed to open file: /var/log/icinga/irc-cloud-feed.log Mar 05 15:14:33 alert2001 ircecho[1136326]: [2024-03-05 15:14:33,943 pyinotify ERROR] add_watch: cannot watch /var/log/icinga/irc-cloud-feed.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: ERROR:pyinotify:add_watch: cannot watch /var/log/icinga/irc-cloud-feed.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: Opening: /var/log/icinga/irc-databases.log Mar 05 15:14:33 alert2001 ircecho[1136326]: Failed to open file: /var/log/icinga/irc-databases.log Mar 05 15:14:33 alert2001 ircecho[1136326]: [2024-03-05 15:14:33,945 pyinotify ERROR] add_watch: cannot watch /var/log/icinga/irc-databases.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: ERROR:pyinotify:add_watch: cannot watch /var/log/icinga/irc-databases.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: Opening: /var/log/icinga/irc-dcops.log Mar 05 15:14:33 alert2001 ircecho[1136326]: Failed to open file: /var/log/icinga/irc-dcops.log Mar 05 15:14:33 alert2001 ircecho[1136326]: [2024-03-05 15:14:33,948 pyinotify ERROR] add_watch: cannot watch /var/log/icinga/irc-dcops.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: ERROR:pyinotify:add_watch: cannot watch /var/log/icinga/irc-dcops.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: Opening: /var/log/icinga/irc-fundraising.log Mar 05 15:14:33 alert2001 ircecho[1136326]: Failed to open file: /var/log/icinga/irc-fundraising.log Mar 05 15:14:33 alert2001 ircecho[1136326]: [2024-03-05 15:14:33,949 pyinotify ERROR] add_watch: cannot watch /var/log/icinga/irc-fundraising.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: ERROR:pyinotify:add_watch: cannot watch /var/log/icinga/irc-fundraising.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: Opening: /var/log/icinga/irc-interactive.log Mar 05 15:14:33 alert2001 ircecho[1136326]: Failed to open file: /var/log/icinga/irc-interactive.log Mar 05 15:14:33 alert2001 ircecho[1136326]: [2024-03-05 15:14:33,951 pyinotify ERROR] add_watch: cannot watch /var/log/icinga/irc-interactive.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: ERROR:pyinotify:add_watch: cannot watch /var/log/icinga/irc-interactive.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: Opening: /var/log/icinga/irc-performance.log Mar 05 15:14:33 alert2001 ircecho[1136326]: Failed to open file: /var/log/icinga/irc-performance.log Mar 05 15:14:33 alert2001 ircecho[1136326]: [2024-03-05 15:14:33,953 pyinotify ERROR] add_watch: cannot watch /var/log/icinga/irc-performance.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: ERROR:pyinotify:add_watch: cannot watch /var/log/icinga/irc-performance.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: Opening: /var/log/icinga/irc-reading-web.log Mar 05 15:14:33 alert2001 ircecho[1136326]: Failed to open file: /var/log/icinga/irc-reading-web.log Mar 05 15:14:33 alert2001 ircecho[1136326]: [2024-03-05 15:14:33,954 pyinotify ERROR] add_watch: cannot watch /var/log/icinga/irc-reading-web.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: ERROR:pyinotify:add_watch: cannot watch /var/log/icinga/irc-reading-web.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: Opening: /var/log/icinga/irc-releng.log Mar 05 15:14:33 alert2001 ircecho[1136326]: Failed to open file: /var/log/icinga/irc-releng.log Mar 05 15:14:33 alert2001 ircecho[1136326]: [2024-03-05 15:14:33,956 pyinotify ERROR] add_watch: cannot watch /var/log/icinga/irc-releng.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: ERROR:pyinotify:add_watch: cannot watch /var/log/icinga/irc-releng.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: Opening: /var/log/icinga/irc-team-data-platform.log Mar 05 15:14:33 alert2001 ircecho[1136326]: Failed to open file: /var/log/icinga/irc-team-data-platform.log Mar 05 15:14:33 alert2001 ircecho[1136326]: [2024-03-05 15:14:33,958 pyinotify ERROR] add_watch: cannot watch /var/log/icinga/irc-team-data-platform.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: ERROR:pyinotify:add_watch: cannot watch /var/log/icinga/irc-team-data-platform.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: Opening: /var/log/icinga/irc.log Mar 05 15:14:33 alert2001 ircecho[1136326]: Failed to open file: /var/log/icinga/irc.log Mar 05 15:14:33 alert2001 ircecho[1136326]: [2024-03-05 15:14:33,959 pyinotify ERROR] add_watch: cannot watch /var/log/icinga/irc.log WD=-1, Errno=No such file or directory (ENOENT) Mar 05 15:14:33 alert2001 ircecho[1136326]: ERROR:pyinotify:add_watch: cannot watch /var/log/icinga/irc.log WD=-1, Errno=No such file or directory (ENOENT)
Comment Actions
Change 1009256 had a related patch set uploaded (by Filippo Giunchedi; author: Filippo Giunchedi):
[operations/puppet@production] icinga: create ircecho log files
Comment Actions
Change 1009256 merged by Filippo Giunchedi:
[operations/puppet@production] icinga: create ircecho log files