Page MenuHomePhabricator

502 Bad Gateway using multiple WMF Labs Tools
Closed, ResolvedPublic

Description

Event Timeline

Actually all tools on wmflabs.org are down.

Jeff_G renamed this task from 502 Bad Gateway using Tool-Global-user-contributions to 502 Bad Gateway using multiple WMF Labs Tools.Jun 6 2018, 8:32 PM

Mix-n-match and guc are now running. Petscan still down.

See T196589: Some kubernetes webservices stuck in CrashLoopBackOff after cluster restart for info about lots of tools that did not start as expected following system maintenance. Most are resolved now.

bd808 claimed this task.
bd808 edited projects, added Tools, Toolforge; removed Tool-Global-user-contributions.

Most things should be back up and running now. Our planned maintenance took a bit longer than expected and there were some additional complications with Toolforge webservices running on our Kubernetes cluster.

If you find additional tools that need to be restarted, please let us know in the #wikimedia-cloud freenode channel, make new tickets here in phabricator, or notify the tool maintainers directly.

Vvjjkkii renamed this task from 502 Bad Gateway using multiple WMF Labs Tools to 3ibaaaaaaa.Jul 1 2018, 1:05 AM
Vvjjkkii reopened this task as Open.
Vvjjkkii removed bd808 as the assignee of this task.
Vvjjkkii triaged this task as High priority.
Vvjjkkii updated the task description. (Show Details)
Vvjjkkii removed a subscriber: Aklapper.
Jeff_G renamed this task from 3ibaaaaaaa to 502 Bad Gateway using multiple WMF Labs Tools.Jul 2 2018, 1:07 AM
Jeff_G closed this task as Resolved.
Jeff_G assigned this task to bd808.
Jeff_G lowered the priority of this task from High to Low.
Jeff_G updated the task description. (Show Details)
Jeff_G added a subscriber: Aklapper.