Page MenuHomePhabricator

Remove obsolete and excessive throttling
Open, LowestPublic

Description

2015/06/03 13:38 UTC [#pywikibot] <Betacommand> xzise: why is the bot sleeping for 10 seconds between deletes?
2015/06/03 13:40 UTC [#pywikibot] <xzise> Betacommand, because of put_throttle
2015/06/03 13:40 UTC [#pywikibot] <xzise> you can set that to 0
2015/06/03 13:40 UTC [#pywikibot] <xzise> in your user-config.py
2015/06/03 13:41 UTC [#pywikibot] <xqt> or use -pt:0 or -putthrottle:0 or -put_throttle:0 but it is recommended to keep throttleling
2015/06/03 13:47 UTC [#pywikibot] <Betacommand> xqt: changing a task that should take 15 seconds to something that takes 6 minutes to run is kind of ridiculous
2015/06/03 13:49 UTC [#pywikibot] <xzise> Afaik is there no technical reason for the throttle
2015/06/03 13:50 UTC [#pywikibot] <xqt> Betacommand: That is the first time when you run core because all settings are fetched by api whereas core has stored it in family files which might be/is deprecated or wrong in some cases
2015/06/03 13:50 UTC [#pywikibot] <Betacommand> xqt: Not the same thing
2015/06/03 13:50 UTC [#pywikibot] <xzise> I think the second “core” is “compat”
2015/06/03 13:51 UTC [#pywikibot] <Betacommand> xqt: Ive started redirect several times
2015/06/03 13:51 UTC [#pywikibot] <xqt> compat, yes
2015/06/03 13:51 UTC [#pywikibot] <Betacommand> after each delete in core there is a 8-10 second throttled delay
2015/06/03 13:51 UTC [#pywikibot] <xzise> Hmm async might be problematic
2015/06/03 13:52 UTC [#pywikibot] <xqt> xzise: Might be this is an old rule for screen scrapping but for a lot of projects writing requests are limited by community consensus
2015/06/03 13:53 UTC [#pywikibot] <Betacommand> So if I need to delete 30-40 pages it would take 6+ minutes
2015/06/03 13:53 UTC [#pywikibot] <xzise> doesn't MW throttle you with this maxlag parameter?
2015/06/03 13:54 UTC [#pywikibot] <Betacommand> xqt: that rule died 5+ years ago with the introduction of maxlag
2015/06/03 13:54 UTC [#pywikibot] <Betacommand> xzise: yeah if we have that param set
2015/06/03 13:55 UTC [#pywikibot] <xqt> Betacommand: I guess it is the same in compat or it doesn't work as expected there. btw throttleing is more restricted in compat as in core. In core each project has its own throttle lag whereas compat throttles all sites.
2015/06/03 13:56 UTC [#pywikibot] <Betacommand> xqt: I killed throttling in compat years ago due to how broken it was
2015/06/03 13:56 UTC [#pywikibot] <xzise> btw only writes are throttled afaik
2015/06/03 13:56 UTC [#pywikibot] <xqt> Betacommand: maxlag is one point. A lot of communities doesn't want bot edits more often than 12 times a minute
2015/06/03 13:57 UTC [#pywikibot] <xqt> xzise: in core yes. compat also throttles read requests
2015/06/03 13:57 UTC [#pywikibot] <Betacommand> xqt: then their should be a throttle for those communities, not hobbling the whole code base
2015/06/03 13:58 UTC [#pywikibot] <xqt> Betacommand: I aggree
2015/06/03 13:58 UTC [#pywikibot] <Betacommand> xqt: should I file a ticket?
2015/06/03 13:59 UTC [#pywikibot] <xqt> Betacommand: Would be great. I guess there are other site dependend issues