Page MenuHomePhabricator

irc.wikimedia.org is not sending out changes
Closed, ResolvedPublic

Description

Can connect to the server but cannot join any channel. /list command gives LIST :Server load is temporarily too heavy. Please wait a while and try again.

Event Timeline

Glaisher triaged this task as Unbreak Now! priority.May 22 2016, 3:27 PM

This is preventing all of the cross-wiki anti-vandalism efforts.

https://en.wikipedia.org/wiki/Special:Contributions/ClueBot_NG last edit was about just less than an hour ago so this is probably when it broke. (I'm not sure but I think ClueBot NG watches the changes from here)

Adding SRE as I'm not sure who else has access to this.

jcrespo claimed this task.
jcrespo added a subscriber: jcrespo.

It seems the server overloaded/bugged out, then it was hit by T134875.

I checked and the IRC bot is running as of now. Either somebody restarted the service (it's T134875 that it needed that) or it came back a little delayed. It's normal that channels can't be joined until the bot starts.

No, I had to do it manually, we need to resolve that.

Change 290077 had a related patch set uploaded (by Dzahn):
ircd/ircecho: add icinga process monitoring

https://gerrit.wikimedia.org/r/290077

Change 290078 had a related patch set uploaded (by Dzahn):
ircd: make check_ircd a critical (paging) icinga check

https://gerrit.wikimedia.org/r/290078

Change 290078 merged by Dzahn:
ircd: make check_ircd a critical (paging) icinga check

https://gerrit.wikimedia.org/r/290078

Change 290077 merged by Dzahn:
ircecho: add icinga process monitoring

https://gerrit.wikimedia.org/r/290077