Page MenuHomePhabricator
Create Task
Maniphest T366456

How to read big set of pages without getting 429?
Closed, InvalidPublicBUG REPORT
Actions

Description

I have a two bots reading large sets of pages (its wikicode), several thousand pages each bot. I read page wikicode by requesting URL "/wiki/Pagename?action=raw", because I don't know API method for this. One of these bots got HTTP 429 error (Too many requests) only if I don't login, but yesterday I write a second bot and it got 429 even under login. How to get contents of big sets of pages without getting this?

Event Timeline

MBH created this task.Mon, Jun 3, 9:32 AM
Restricted Application added subscribers: Base, Aklapper. · View Herald TranscriptMon, Jun 3, 9:32 AM
Aklapper closed this task as Invalid.Mon, Jun 3, 9:33 AM

Hi @MBH. This does not sound like something is wrong in the code base but instead like a support request (how to change settings, questions how to do something, etc.). As Wikimedia Phabricator is for bug reports, enhancement requests, and planning work, please check https://www.mediawiki.org/wiki/Communication where to bring up such questions - thanks.

MBH added a comment.Mon, Jun 3, 9:36 AM

@Aklapper Could you tell me the name of any developer who you think could help me with this?

Aklapper added a comment.Mon, Jun 3, 1:07 PM

@MBH: I don't believe that contacting individuals scales. I'd ask in a more public venue, see the link I shared.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits