Page MenuHomePhabricator

Wikibugs: Quit due to excess flood
Closed, ResolvedPublic

Description

At 15:29 (UTC)

wikibugs quit (~wikibugs2@wikimedia/bot/pywikibugs) Excess Flood

from libera.chat—it has not rejoined the network. Just needs someone (like @Majavah) to restart it please :-)

Event Timeline

I'm afraid it's intended (wikibugs not getting kicked from the IRC channel but instead quitting itself for a moment) until someone comes up with sophisticated buffering and rate limiting?
See also T112032, T237109.

someone (like @Majavah)

I already tried, I think it needs someone who actually knows what they are doing, I tried adding a bit more logs but this is what I see:

DEBUG:irc3.wikibugs:Starting wikibugs...
2022-03-18 18:10:51,314 - irc3.wikibugs - DEBUG - Starting wikibugs...
Exception ignored in: <object repr() failed>
Traceback (most recent call last):
  File "/usr/lib/python3.5/asyncio/tasks.py", line 92, in __del__
    self._loop.call_exception_handler(context)
AttributeError: 'NoneType' object has no attribute 'call_exception_handler'
Exception ignored in: <object repr() failed>
Traceback (most recent call last):
  File "/usr/lib/python3.5/asyncio/tasks.py", line 92, in __del__
    self._loop.call_exception_handler(context)
AttributeError: 'NoneType' object has no attribute 'call_exception_handler'
Exception ignored in: <object repr() failed>
Traceback (most recent call last):
  File "/usr/lib/python3.5/asyncio/tasks.py", line 92, in __del__
    self._loop.call_exception_handler(context)
AttributeError: 'NoneType' object has no attribute 'call_exception_handler'
Exception ignored in: <object repr() failed>
Traceback (most recent call last):
  File "/usr/lib/python3.5/asyncio/tasks.py", line 92, in __del__
    self._loop.call_exception_handler(context)
AttributeError: 'NoneType' object has no attribute 'call_exception_handler'
Exception ignored in: <object repr() failed>
Traceback (most recent call last):
  File "/usr/lib/python3.5/asyncio/tasks.py", line 92, in __del__
    self._loop.call_exception_handler(context)
AttributeError: 'NoneType' object has no attribute 'call_exception_handler'
Exception ignored in: <object repr() failed>
Traceback (most recent call last):
  File "/usr/lib/python3.5/asyncio/tasks.py", line 92, in __del__
    self._loop.call_exception_handler(context)
AttributeError: 'NoneType' object has no attribute 'call_exception_handler'
DEBUG:irc3.wikibugs:Connected
2022-03-18 18:10:51,725 - irc3.wikibugs - DEBUG - Connected
DEBUG:irc3.wikibugs:CONNECT ping-pong ()
2022-03-18 18:10:51,725 - irc3.wikibugs - DEBUG - CONNECT ping-pong ()
CRITICAL:irc3.wikibugs:connection lost (140435413981224): None
2022-03-18 18:11:46,759 - irc3.wikibugs - CRITICAL - connection lost (140435413981224): None
CRITICAL:irc3.wikibugs:closing old transport (140435413981224)
2022-03-18 18:11:46,760 - irc3.wikibugs - CRITICAL - closing old transport (140435413981224)
DEBUG:irc3.wikibugs:Starting wikibugs...
2022-03-18 18:11:48,771 - irc3.wikibugs - DEBUG - Starting wikibugs...
DEBUG:irc3.wikibugs:Connected

Same issue as T291129: wikibugs failing to connect when run on exec hosts, which kinda just magically fixed itself. For now I'm running wikibugs in a screen on the bastion (yes, I know I'm doing evil things, sorry). Idk why Libera doesn't like us connecting from the grid host, I've poked a friendly Libera staffer to see what debugging info they can provide.

We can try moving to the buster grid? We'd need to create a separate py37 venv for it.

Legoktm claimed this task.

Tried connecting while our friendly Libera staffer was watching and...it worked. Tried one more time and it worked again. Sigh. But at least it works properly, via the grid now.

The IP we're connecting from isn't k-lined and we're not even at halfway of our iline limit (which is on the whole /24).

I suspect it's proooobably some subtle bug in the irc3 library we're using maybe coupled with the old OS version/Python??

...something something RIIR time??