Page MenuHomePhabricator
Create Task
Maniphest T420011

Intermittent rate limiting at hackathon-northwestern-europe-2026
Closed, ResolvedPublicBUG REPORT
Actions

Description

We're working with bots and we hit rate limits

WARNING: Http response status 429
WARNING: Non-JSON response received from server wikipedia:nl for url
https://nl.wikipedia.org/w/api.php?action=query&meta=userinfo&uiprop=blockinfo%7Cgroups%7Chasmsg%7Cratelimits%7Crights&formatversion=2&maxlag=600&format=json
The server may be down.
Status code: 429
User agent: BotMultichill/login (wikipedia:nl; User:BotMultichill) Pywikibot/11.1.0.dev1 (g20284) Python/3.9.5.final.0 requests/2.32.5

In private opening of https://www.wikidata.org/w/api.php?action=query&meta=userinfo&uiprop=blockinfo%7Cgroups%7Chasmsg%7Cratelimits%7Crights&formatversion=2&maxlag=600&format=json

You are making too many requests.
Please reduce your request rate or contact <bot-traffic@wikimedia.org>.

Managed to reproduce on multiple laptops with multiple users.

Range is 94.142.215.192 - 94.142.215.223 for Rozet ( https://apps.db.ripe.net/db-web-ui/query?searchtext=94.142.215.207 )

Related Objects

Event Timeline

Multichill created this task.Mar 13 2026, 3:11 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 13 2026, 3:11 PM
A_smart_kitten added a project: Traffic.Mar 13 2026, 3:18 PM
taavi removed a project: Traffic.Mar 13 2026, 3:19 PM

(Not from the CDN layer.)

taavi added a project: MediaWiki-Platform-Team.Mar 13 2026, 3:26 PM

AIUI the username in the user-agent should give the bot its own rate limiting bucket, and I don't see any sampled hits for that in Logstash suggesting that it alone is low enough volume. So is something up with the rate limiting rules in rest-gateway?

ArielGlenn subscribed.Mar 13 2026, 4:05 PM
JTweed-WMF subscribed.Mar 13 2026, 4:55 PM

Just to confirm that we are looking into this. Apologies for the inconvenience.

Fabfur subscribed.Mar 13 2026, 4:57 PM
Addshore subscribed.Mar 13 2026, 11:30 PM
daniel subscribed.Sat, Mar 14, 4:18 PM

This is probably a manifestation of T420106: rest gateway: assign unauthed-bot class for trust level C without valid token.

Novem_Linguae subscribed.Sat, Mar 14, 8:43 PM
gerritbot added a comment.Sun, Mar 15, 4:41 PM

Change #1252658 had a related patch set uploaded (by Daniel Kinzler; author: Daniel Kinzler):

[operations/deployment-charts@master] rest-gateway: handle trust level C with invalid token.

https://gerrit.wikimedia.org/r/1252658

gerritbot added a project: Patch-For-Review.Sun, Mar 15, 4:41 PM
matmarex closed this task as Resolved.Mon, Mar 16, 11:26 PM
matmarex subscribed.

We've survived the hackathon, so I think this can be closed. T420106 exists for the (probable) underlying issue.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits