Page MenuHomePhabricator

IABot Management Interface is 504 Gateway Timeout
Closed, ResolvedPublicBUG REPORT

Description

A part of the pipeline that the bot's process relies on is getting stuck intermittently. This causes reliant bot processes to get stuck, and is resulting in 504 timeouts. Once the pipeline gets itself unstuck, all reliant processes resume normally, finishing what they started working on.

Event Timeline

Would this potentially be related to why the current five IABot batch jobs (11994, 11995, 11996, 11997, and 11998) are all currently stalled at zero progress, with the most recent batch-job edit being this one from nearly two weeks ago?

Update: The new results page error being thrown is:

"DB ERROR : QUERY: CREATE DATABASE IF NOT EXISTS s51059__cyberbot; ERROR - : Error encountered while creating the database. Exiting..."

Cyberpower678 claimed this task.

Fix-page requests are now throwing the "503 Service Unavailable" results error again.

Nintendofan885 renamed this task from IAB is 503 Service Unavailable to IABot Management Interface is 503 Service Unavailable.Jan 26 2023, 2:56 PM
Nintendofan885 updated the task description. (Show Details)

IABot fix-pages Management Interface is now throwing a new error:

"DB ERROR : QUERY: CREATE DATABASE IF NOT EXISTS s51059__cyberbot; ERROR - : Error encountered while creating the database. Exiting..."

This should be fixed hopefully today.

I'm getting the 503 Service Unavailable error again

I restarted the management interface webservice and it should be online again. Please confirm.

Well, the interface loaded but hasn't sucessfully processed a page (and getting 502 Bad Gateway)

Yep they timed out (504 Gateway Time-out) and now it's back to the 503 on reload

'Fix dead links' now throwing this page error: "DB ERROR : QUERY: CREATE DATABASE IF NOT EXISTS s51059__cyberbot; ERROR - : Error encountered while creating the database. Exiting..."

There was another outage related to Cloud VPS' Ceph outage; we restarted the database server and the management interface should work again.

'Fix dead links" showing up for me as:

DB ERROR : QUERY: CREATE DATABASE IF NOT EXISTS s51059__cyberbot; ERROR - : Error encountered while creating the database. Exiting...

How do I resolve this? I even checked multiple "Is It Down or Just Me?" sites and they all say the site it up and running. But the above keeps showing up for me! Need help!!!

https://iabot.toolforge.org/ is not working again Need help in resolving this issue!

504 Gateway Time-out is now the error.

Looks to be working now

"504 Gateway Time-out" keeps appearing, especially with larger articles (still below 300 citations) or for articles that have more unarchived sources needing archiving. Need the "504 Gateway Time-out" error to be fixed. Thank you!

I want to report the issue as well. "504 Gateway Time Out" on every article I attempted. Thank you very much.

I have also discovered that the archiving works, the bot ran perfectly, but we will be given a timeout error.

504 once again.

504 Gateway Time-out is back

Please provide more details. I'm not getting 504s.

Cyberpower678 renamed this task from IABot Management Interface is 503 Service Unavailable to IABot Management Interface is 504 Gateway Timeout.Oct 12 2023, 4:48 PM
Cyberpower678 updated the task description. (Show Details)

Today "504 Gateway Time-out" appeared on zhwiki (Chinese Wikipedia), and it's been stuck ever since, even the queues are stuck too. An analysis that resulted in nothing changing would run successfully, though. Thus, it seems that the reason why queues got stuck was because of editing/archiving rather than analysis per se.

Today "504 Gateway Time-out" appeared on zhwiki (Chinese Wikipedia), and it's been stuck ever since, even the queues are stuck too. An analysis that resulted in nothing changing would run successfully, though. Thus, it seems that the reason why queues got stuck was because of editing/archiving rather than analysis per se.

Alright, the queues are now complete.