Page MenuHomePhabricator

X's Tools cannot be reached
Closed, DuplicatePublic

Description

While browsing to https://xtools.wmcloud.org/ I got the following:
"Error
This web service cannot be reached. Please contact a maintainer of this project.
Maintainers can find troubleshooting instructions from our documentation on Wikitech.
proxy-03.project-proxy.eqiad1.wikimedia.cloud"

I got there by seeing how deep the water was from https://xtools.wmcloud.org/globalcontribs/2600%3A1700%3A617A%3A4410%3A1589%3A3633%3A7834%3A9DF4 (which gives the same error) via the "XTools GC" link on https://meta.wikimedia.org/wiki/Special:GlobalContributions/2600:1700:617A:4410:1589:3633:7834:9DF4 . I am using the web on the latest Chrome on the latest Windows 10.

Event Timeline

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

In T387103#10573896, @Herald wrote:

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Sorry, I don't have the expertise to find "a more specific project tag" at this time. I tried to tag it "XTools", but that tag appears to have gone away.

MusikAnimal claimed this task.
MusikAnimal subscribed.

Repeat of T384711: XTools is down or very slow due to bot scraping except this time I'm around to investigate!

Looks like we've had some abusive bots pounding the service lately. 3.7 million requests from the same bot alone in the last 24 hours! Fortunately the automated throttling was doing its job, and few if any XTools requests from these bots were actually fulfilled. However, we were still logging the requests, and due to the sheer volume that led to the disk becoming full.

I have blocked the bots and reduced the log ratation to go back only 7 days instead of 14 days. Things should be OK now.