Page MenuHomePhabricator

Two cases of failing upload, followed by a successful upload with a different file name
Open, Needs TriagePublic

Description

BEIC upload policy implies Commons upload of two files per book - an original pdf and a derived djvu with the same file name, the extension only being obviously different; the djvu file comes from an upload of pdf file into IA too, then runnin IA Upload tool.

When we tried to upload File:Buonarroti, Michelangelo – Rime, 1960 – BEIC 1775670.djvu and File:Boiardo, Matteo Maria – Opere volgari, 1962 – BEIC 1773914.djvu, IA Upload tool silently failed; on the contrary, IA Upload successfully uploaded the same files named as File:Buonarroti - Rime.djvu and File:Boiardo - Opere volgari.djvu (then renamed into Commons from a rename request; see file chronology).

I found that Commons throws a warning after a try to upload files when a file with a very similar file exists; I presume that IA Upload tool could be confused by that warning.

Event Timeline

Restricted Application added a project: Community-Tech. · View Herald TranscriptNov 30 2017, 1:26 PM
Alex_brollo renamed this task from Two cased of failing upload, followed by a successful upload with a different file name to Two cases of failing upload, followed by a successful upload with a different file name.Nov 30 2017, 1:37 PM

I think this was a result of the recent fixes in finding (i.e. waiting for) the DjVu XML file: these files were uploaded yesterday after I updated the code and let it run on all stalled jobs. :-(

Sorry!

Perhaps the best solution here is to implement the "remove this job" button as mentioned in T166303: Add indicator to see if a queued task is dead on not on IA-upload?

I don't think there's a warning for a very similar file; there is for an exact match (which these aren't, I'm guessing, because they're derived by different means?) or for a similar filename (and these are presumably different enough to not get caught).

What about we also add a thing that purges jobs from the queue after say 14 days?

Alex_brollo added a comment.EditedDec 1 2017, 6:29 AM

Thanks Sam, I'll try again.

What about a IA Uploader option "Email log file to uploader when finished" (obviously disabled by default)?

That's a good idea.

I don't think we can email them though (can bots do that?). Perhaps we can add a note to their Commons talk page?