cheap image dump script that might be ok for wikitech

Authored by ArielGlenn on Mar 7 2018, 7:24 PM.

Description

cheap image dump script that might be ok for wikitech

[WIP] This runs ok on enwiki on beta, on snapshot01 instance, using
the included config file; in the real world it may yet need help. Lots
of error handling probably missing.

It also runs ok on wikitech-static, pulling images from wikitech.
That doesn't mean it's suitable for cron yet.
It is supposed to raise an exception if too many image retrievals
or too any cp of image from past dump fail in a row, but this
needs to be tested in a broken setup.

Features missing:

  • relies on direct access to db, want to fix that
  • does not retrieve media on commons used on the wiki, only local media
  • no scaling, retrieves originals only

Bug: T188915
Change-Id: I0cc24cafdfa18340ac7d25994eb5b85d5c4c8015