Page MenuHomePhabricator

Make BatchUploadTools work with file-over-url
Closed, ResolvedPublic8 Estimated Story Points

Description

The current incarnation of BatchUploadTools relies on physical files to at least:

  • Determine which file description files to generate
  • Actually upload the files

Since the KMB upload will likely be over url this requires modifications to:

  • prepUpload: should be able to generate description files given a list of filename/url pairs
    • could possibly include a step to check that the url is valid/responsive
  • uploader: should be able to pass a file url together with the decription page
    • this also requires modification to how files are archived after an un-/successful upload.

Related to this we will also need to ensure that the domain i whitelisted for upload-via-url on Wikimedia Commons.

Event Timeline

This is a first overview which should be broken down into subtasks

Lokal_Profil set the point value for this task to 8.May 15 2017, 7:45 AM
Lokal_Profil moved this task from 📥 Backlog to 📆 This week on the User-LokalProfil board.
Lokal_Profil moved this task from 📆 This week to 🔬 to Review on the User-LokalProfil board.
Lokal_Profil added a subscriber: Alicia_Fagerving_WMSE.

PR: https://github.com/lokal-profil/BatchUploadTools/pull/27

Instead of modifying prepUpload this instead skips that step. The largest change is that instead of shuffling files (images and .info) into subdirectories, depending on outcome this instead keeps three separate log files (in addition to the general one) where the outcomes are tracked per url.

As a follow up patch there should be a mechanism for either skipping all urls in a list or only upload urls in a list.