Page MenuHomePhabricator

Massive image upload with pywikibot
Closed, InvalidPublic

Description

Hi all. In the last years, I've been created some tools to upload free images from (mainly) government webs in Spain (for instance, most of the images in https://commons.wikimedia.org/wiki/Category:Images_from_Ayuntamiento_de_Madrid have been uploaded by me using said tools). I've developed them as Python notebooks that run either on PAWS or locally by using pywikibot. I'm thinking of turning them into a flickr2commons-like tool, but, at the moment, upload of images by means of pywikibot is a task that takes several seconds per image (I assume this is a constraint set by any kind of policy). Is there a way to speed image upload (flickr2commons does it) but still using pywikibot? Any contact person or link I can use to understand how I can proceed? Thanks

Event Timeline

Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. · View Herald TranscriptFeb 13 2019, 11:29 AM
Discasto renamed this task from Massive upload with pywikibot to Massive image upload with pywikibot.Feb 13 2019, 11:36 AM
Discasto updated the task description. (Show Details)

You can upload at a faster rate with a bot account. See https://commons.wikimedia.org/wiki/Commons:Bots

Xqt added a subscriber: Xqt.May 24 2020, 2:23 PM

upload of images by means of pywikibot is a task that takes several seconds per image (I assume this is a constraint set by any kind of policy)

This is the usual put_throttle delay for each write operation (here upload action). It can be modified either via user-config.py setting or the corresponding global parameter (if the scripts calls handle_args() function) but normally it shouldn't except you have a very good reason to do.

Xqt closed this task as Invalid.May 24 2020, 2:24 PM

You should likely not change put_throttle, because doing so will impact performance for users and other bots.
See also https://mediawiki.org/wiki/Special:MyLanguage/API:Etiquette.