Page MenuHomePhabricator

irc.wikimedia.org is not sending out changes
Closed, ResolvedPublic

Description

Can connect to the server but cannot join any channel. /list command gives LIST :Server load is temporarily too heavy. Please wait a while and try again.

Event Timeline

Glaisher triaged this task as Unbreak Now! priority.May 22 2016, 3:27 PM

This is preventing all of the cross-wiki anti-vandalism efforts.

https://en.wikipedia.org/wiki/Special:Contributions/ClueBot_NG last edit was about just less than an hour ago so this is probably when it broke. (I'm not sure but I think ClueBot NG watches the changes from here)

Adding SRE as I'm not sure who else has access to this.

jcrespo claimed this task.
jcrespo subscribed.

It seems the server overloaded/bugged out, then it was hit by T134875.

I checked and the IRC bot is running as of now. Either somebody restarted the service (it's T134875 that it needed that) or it came back a little delayed. It's normal that channels can't be joined until the bot starts.

No, I had to do it manually, we need to resolve that.

Change 290077 had a related patch set uploaded (by Dzahn):
ircd/ircecho: add icinga process monitoring

https://gerrit.wikimedia.org/r/290077

Change 290078 had a related patch set uploaded (by Dzahn):
ircd: make check_ircd a critical (paging) icinga check

https://gerrit.wikimedia.org/r/290078

Change 290078 merged by Dzahn:
ircd: make check_ircd a critical (paging) icinga check

https://gerrit.wikimedia.org/r/290078

Change 290077 merged by Dzahn:
ircecho: add icinga process monitoring

https://gerrit.wikimedia.org/r/290077