Page MenuHomePhabricator

Request creation of commons-corruption-checker VPS project
Closed, ResolvedPublic


Project Name: commons-corruption-checker

Wikitech Usernames of requestors: TheSandDoctor

Purpose: Check existing images on Wikimedia Commons for corruption and monitor uploads indefinitely

Brief description: This task will require the installation of python and python packages: mwclient, mwparserfromhell, Pywikibot, sseclient, and my own version of Pillow (PIL). I need this version to be installed due to the potential for large images. This bot task has been approved on Commons. This task works by downloading all of the images (though only one at a time will be processed/downloaded and deleted afterwords), scanning them, and then logging in a database the result. In the event that corruption is detected, the uploader is then notified. After either 7 (for new uploads) or 30 days (existing catalogue) has passed, the images are then re-downloaded and re-checked. If their hashes match the previously checked version (aka unchanged/still corrupt), then it is tagged for speedy deletion and the uploader notified of this action.

I am definitely open to adding collaborators on this task/project and would not have "closed" membership.

How soon you are hoping this can be fulfilled: as soon as possible (e.g. January some time if possible?)

Event Timeline

TheSandDoctor renamed this task from Request creation of <PROJECT-NAME> VPS project to Request creation of commons-corruption-checker VPS project.Dec 31 2019, 5:39 AM
TheSandDoctor updated the task description. (Show Details)
TheSandDoctor updated the task description. (Show Details)
TheSandDoctor updated the task description. (Show Details)

Mentioned in SAL (#wikimedia-cloud) [2020-01-07T21:20:25Z] <jeh> create commons-corruption-checker project T241635

JHedden claimed this task.
JHedden added a subscriber: JHedden.

Hi @TheSandDoctor, your CloudVPS project has been created.

Please make sure to join the cloud-announce mailing list! More information about this can be found at: