When I first logged in
tools.wikibugs@tools-bastion-12:~$ toolforge jobs list +-----------+------------+--------------------------------+ | Job name: | Job type: | Status: | +-----------+------------+--------------------------------+ | gerrit | continuous | Running | | gitlab | continuous | Running | | irc | continuous | Not running | | phorge | continuous | Specified command fails to run | | znc | continuous | Running | +-----------+------------+--------------------------------+
A few restarts later...
tools.wikibugs@tools-bastion-12:~$ toolforge jobs list +-----------+------------+-------------+ | Job name: | Job type: | Status: | +-----------+------------+-------------+ | gerrit | continuous | Running | | gitlab | continuous | Running | | irc | continuous | Not running | | phorge | continuous | Running | | znc | continuous | Running | +-----------+------------+-------------+
Trying to get logs from the irc job...
[pod/irc-74d5c494f5-rmslj/job] 2025-05-25T20:56:18Z wikibugs2.events INFO: Connecting to http://wikibugs:8000/api/event/stream [pod/irc-74d5c494f5-rmslj/job] 2025-05-25T20:56:21Z wikibugs2.events ERROR: Failed to connect to http://wikibugs:8000/api/event/stream [pod/irc-74d5c494f5-rmslj/job] Traceback (most recent call last): [pod/irc-74d5c494f5-rmslj/job] File "/layers/heroku_python/dependencies/lib/python3.12/site-packages/aiohttp/client.py", line 578, in _request [pod/irc-74d5c494f5-rmslj/job] conn = await self._connector.connect( [pod/irc-74d5c494f5-rmslj/job] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [pod/irc-74d5c494f5-rmslj/job] File "/layers/heroku_python/dependencies/lib/python3.12/site-packages/aiohttp/connector.py", line 544, in connect [pod/irc-74d5c494f5-rmslj/job] proto = await self._create_connection(req, traces, timeout) [pod/irc-74d5c494f5-rmslj/job] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [pod/irc-74d5c494f5-rmslj/job] File "/layers/heroku_python/dependencies/lib/python3.12/site-packages/aiohttp/connector.py", line 911, in _create_connection [pod/irc-74d5c494f5-rmslj/job] _, proto = await self._create_direct_connection(req, traces, timeout) [pod/irc-74d5c494f5-rmslj/job] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [pod/irc-74d5c494f5-rmslj/job] File "/layers/heroku_python/dependencies/lib/python3.12/site-packages/aiohttp/connector.py", line 1204, in _create_direct_connection [pod/irc-74d5c494f5-rmslj/job] transp, proto = await self._wrap_create_connection( [pod/irc-74d5c494f5-rmslj/job] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [pod/irc-74d5c494f5-rmslj/job] File "/layers/heroku_python/dependencies/lib/python3.12/site-packages/aiohttp/connector.py", line 992, in _wrap_create_connection [pod/irc-74d5c494f5-rmslj/job] return await self._loop.create_connection(*args, **kwargs) [pod/irc-74d5c494f5-rmslj/job] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [pod/irc-74d5c494f5-rmslj/job] File "/layers/heroku_python/python/lib/python3.12/asyncio/base_events.py", line 1102, in create_connection [pod/irc-74d5c494f5-rmslj/job] sock = await self._connect_sock( [pod/irc-74d5c494f5-rmslj/job] ^^^^^^^^^^^^^^^^^^^^^^^^^ [pod/irc-74d5c494f5-rmslj/job] File "/layers/heroku_python/python/lib/python3.12/asyncio/base_events.py", line 1005, in _connect_sock [pod/irc-74d5c494f5-rmslj/job] await self.sock_connect(sock, address) [pod/irc-74d5c494f5-rmslj/job] File "/layers/heroku_python/python/lib/python3.12/asyncio/selector_events.py", line 651, in sock_connect [pod/irc-74d5c494f5-rmslj/job] return await fut [pod/irc-74d5c494f5-rmslj/job] ^^^^^^^^^ [pod/irc-74d5c494f5-rmslj/job] asyncio.exceptions.CancelledError [pod/irc-74d5c494f5-rmslj/job] [pod/irc-74d5c494f5-rmslj/job] The above exception was the direct cause of the following exception: [pod/irc-74d5c494f5-rmslj/job] [pod/irc-74d5c494f5-rmslj/job] Traceback (most recent call last): [pod/irc-74d5c494f5-rmslj/job] File "/layers/heroku_python/dependencies/lib/python3.12/site-packages/aiohttp/client.py", line 573, in _request [pod/irc-74d5c494f5-rmslj/job] async with ceil_timeout( [pod/irc-74d5c494f5-rmslj/job] File "/layers/heroku_python/python/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ [pod/irc-74d5c494f5-rmslj/job] raise TimeoutError from exc_val [pod/irc-74d5c494f5-rmslj/job] TimeoutError [pod/irc-74d5c494f5-rmslj/job] [pod/irc-74d5c494f5-rmslj/job] The above exception was the direct cause of the following exception: [pod/irc-74d5c494f5-rmslj/job] [pod/irc-74d5c494f5-rmslj/job] Traceback (most recent call last): [pod/irc-74d5c494f5-rmslj/job] File "/workspace/src/wikibugs2/events.py", line 158, in _connect [pod/irc-74d5c494f5-rmslj/job] resp = await self.session.get(self.feed_url, headers=headers) [pod/irc-74d5c494f5-rmslj/job] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [pod/irc-74d5c494f5-rmslj/job] File "/layers/heroku_python/dependencies/lib/python3.12/site-packages/aiohttp/client.py", line 582, in _request [pod/irc-74d5c494f5-rmslj/job] raise ServerTimeoutError( [pod/irc-74d5c494f5-rmslj/job] aiohttp.client_exceptions.ServerTimeoutError: Connection timeout to host http://wikibugs:8000/api/event/stream [pod/irc-74d5c494f5-rmslj/job] 2025-05-25T20:56:21Z wikibugs2.events DEBUG: 9 disconnects. Sleeping 4.096s