Page MenuHomePhabricator

Outreachdashboard application Internal Sever error
Closed, ResolvedPublicPRODUCTION ERROR

Description

Error
500 Internal Server Error
If you are the administrator of this website, then please read this web application's log file and/or the web server's log file to find out what went wrong.
Impact

Application is unavailable since 2022-05-06T00:09:00 or earlier

Notes

Please fix asap, registering edit-a-thon presence is not possible.

Details

Request URL
https://outreachdashboard.wmflabs.org

Event Timeline

Pcoombe triaged this task as Unbreak Now! priority.May 6 2022, 10:52 AM
Pcoombe subscribed.

Setting as unbreak now since the dashboard is needed for the competition linked in an active CentralNotice campaign (IMD 2022)

It looks like the database went down. I've restarted it, but I fear that I waited too long to expand the storage volume, which is currently at 96% full. Unfortunately, I'm on vacation and won't be able to work on that until I return home next week. Here's hoping it stays up until then.

That's for dropping in during your vacation to restart the database!

Pcoombe lowered the priority of this task from Unbreak Now! to Needs Triage.May 6 2022, 12:21 PM

Thanks Sage, looking good for me now. Fingers crossed it stays up.

Application is unavailable again since this morning or earlier.

The Cinder volume that holds the database was full. I'm trying to resize it.

I think I did it! That worked far more quickly than I expected. Distributed systems are a miracle and a horror.

Pcoombe assigned this task to Ragesoss.