Page MenuHomePhabricator
Create Task
Maniphest T240369

Chase up bot operators whose bot keeps running when the dispatch lag is higher than 5
Closed, ResolvedPublic
Actions

Description

To ensure that Wikidata bot edits slow down when lag is high, we should ensure that bot operators follow the guidelines which recommend to use the maxlag parameter with a value no higher than 5.

This task tracks efforts towards getting in touch with tool and bot operators to request compliance with this policy.

A first batch of requests will be based on this 30 min time window where maxlag was consistently above 5:
https://grafana.wikimedia.org/d/000000156/wikidata-dispatch?orgId=1&fullscreen&panelId=22&from=1575926925839&to=1575928082473
I will check which bots were still editing during that time and send requests to the bot owners accordingly.

Related Objects
Search...

Event Timeline

Pintoch created this task.Dec 10 2019, 7:51 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 10 2019, 7:51 PM
Pintoch updated the task description. (Show Details)Dec 10 2019, 8:09 PM
Bugreporter subscribed.Dec 10 2019, 8:12 PM

Many bots already respect maxlag=5, though as maxlag (from WDQS) is updated per minute, they may run intermittently.

Bugreporter added a comment.EditedDec 10 2019, 8:21 PM

@Pintoch Please recheck the number of edits. The time in the Grafana graph is in your local timezone, not in UTC. Some bots does not edit at all in this period.

https://www.wikidata.org/w/index.php?title=Special:Contributions/LargeDatasetBot&offset=20191209214801
https://www.wikidata.org/w/index.php?title=Special:Contributions/LogainmBot&offset=20191209214801
https://www.wikidata.org/w/index.php?title=Special:Contributions/Reinheitsgebot&offset=20191209214801

Bugreporter closed subtask T240375: Maxlag=5 for LargeDatasetBot as Invalid.Dec 10 2019, 8:22 PM
Bugreporter closed subtask T240376: Maxlag=5 for LogainmBot as Invalid.
Bugreporter closed subtask T240377: Maxlag=5 for Reinheitsgebot as Invalid.
Pintoch added a comment.Dec 10 2019, 8:24 PM

@Bugreporter yes indeed! I was off by one hour there. Thanks for your help! Feel free to add more bots which match that period.

Bugreporter mentioned this in T240379: Explicitly state the timezone in grafana.Dec 10 2019, 8:34 PM
Addshore mentioned this in T214064: hamstar/Wikimate code is hitting wikidata API without passing maxlag.Dec 11 2019, 11:39 AM
Addshore merged a task: T199662: Contact wikidata bot owners & script runners not passing maxlag.
Addshore added subscribers: Addshore, Sjoerddebruin, Framawiki, Lydia_Pintscher.
Addshore moved this task from incoming to monitoring on the Wikidata board.Dec 11 2019, 11:41 AM
ArthurPSmith closed subtask T240371: Maxlag=5 for Author Disambiguator as Resolved.Dec 11 2019, 3:36 PM
Multichill closed subtask T240374: Maxlag=5 for BotMultichill as Declined.Dec 11 2019, 8:27 PM
Pintoch mentioned this in T221774: Add Wikidata query service lag to Wikidata maxlag.Jan 18 2020, 7:41 AM
Multichill changed the status of subtask T240374: Maxlag=5 for BotMultichill from Declined to Invalid.Jan 18 2020, 12:41 PM
Multichill mentioned this in T242157: Provide some Pywikibot usage statistics for Python2.7 and Python3.x.Jan 18 2020, 12:48 PM
Xqt subscribed.Mar 5 2020, 7:36 AM
Xqt closed subtask T240373: Maxlag=5 for Edoderoobot as Resolved.Jul 19 2021, 5:53 AM
Addshore closed this task as Resolved.Aug 30 2021, 3:34 PM
Addshore claimed this task.
Restricted Application added a project: User-Addshore. · View Herald TranscriptAug 30 2021, 3:34 PM
Addshore closed subtask T240370: Maxlag=5 for Petscan as Resolved.Aug 30 2021, 3:35 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits