Please upload the following files to enwikisource:
API uploads have repeatedly failed due to T278104
Since I am now getting a stash failure for nearly every upload, I'm going to batch them up. Please also upload the following.
You can use a placeholder description for each, and I'll add it at enWS afterwards:
(Volumes 43, 46, 49, and 57 did upload, 65 exists already)
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Inductiveload | T290816 Batch Upload for The Strand | |||
| Resolved | Reedy | T290900 Server side upload to enwikisource (multiple DJVU files ~200MB each) |
Pointing out that in the URL for the batch upload "download" is misspelled. https://archive.org/dowload should be https://archive.org/download .
Could this be actioned please, as we were hoping to use some of these for a Community Project in October?
Mentioned in SAL (#wikimedia-operations) [2021-09-30T12:31:43Z] <Reedy> downloading files for T290900 in screen on mwmaint1002
Just to point out, at least the first file is much bigger than 200MB
Length: 719231392 (686M) [image/x.djvu]
Still downloading. Looks like a couple failed...
reedy@mwmaint1002:/tmp/uploads$ ls -al total 6936632 drwxrwxr-x 2 reedy wikidev 4096 Sep 30 16:35 . drwxrwxrwt 29 root root 4096 Sep 30 16:40 .. -rwxrwxr-x 1 reedy wikidev 5865 Sep 30 12:53 download.sh -rw-rw-r-- 1 reedy wikidev 719231392 Sep 13 13:42 'The Strand Magazine (Volume 21).djvu' -rw-rw-r-- 1 reedy wikidev 247302608 Sep 13 15:04 'The Strand Magazine (Volume 22).djvu' -rw-rw-r-- 1 reedy wikidev 754984992 Sep 13 17:36 'The Strand Magazine (Volume 23).djvu' -rw-rw-r-- 1 reedy wikidev 323503413 Sep 13 21:17 'The Strand Magazine (Volume 24).djvu' -rw-rw-r-- 1 reedy wikidev 170864135 Sep 13 22:52 'The Strand Magazine (Volume 25).djvu' -rw-rw-r-- 1 reedy wikidev 176102499 Sep 14 06:16 'The Strand Magazine (Volume 26).djvu' -rw-rw-r-- 1 reedy wikidev 175148609 Sep 14 06:56 'The Strand Magazine (Volume 27).djvu' -rw-rw-r-- 1 reedy wikidev 181092999 Sep 14 07:05 'The Strand Magazine (Volume 28).djvu' -rw-rw-r-- 1 reedy wikidev 177105990 Sep 14 07:15 'The Strand Magazine (Volume 29).djvu' -rw-rw-r-- 1 reedy wikidev 179488771 Sep 14 07:25 'The Strand Magazine (Volume 30).djvu' -rw-rw-r-- 1 reedy wikidev 271798879 Sep 14 07:39 'The Strand Magazine (Volume 31).djvu' -rw-rw-r-- 1 reedy wikidev 299097913 Sep 14 07:55 'The Strand Magazine (Volume 32).djvu' -rw-rw-r-- 1 reedy wikidev 260461161 Sep 14 08:08 'The Strand Magazine (Volume 33).djvu' -rw-rw-r-- 1 reedy wikidev 282881802 Sep 14 08:22 'The Strand Magazine (Volume 34).djvu' -rw-rw-r-- 1 reedy wikidev 0 Sep 30 14:49 'The Strand Magazine (Volume 35).djvu' -rw-rw-r-- 1 reedy wikidev 166820863 Sep 14 10:57 'The Strand Magazine (Volume 36).djvu' -rw-rw-r-- 1 reedy wikidev 163766773 Sep 14 15:40 'The Strand Magazine (Volume 37).djvu' -rw-rw-r-- 1 reedy wikidev 166097755 Sep 14 15:47 'The Strand Magazine (Volume 38).djvu' -rw-rw-r-- 1 reedy wikidev 170210692 Sep 14 15:56 'The Strand Magazine (Volume 39).djvu' -rw-rw-r-- 1 reedy wikidev 170575302 Sep 14 16:36 'The Strand Magazine (Volume 40).djvu' -rw-rw-r-- 1 reedy wikidev 170612036 Sep 14 16:51 'The Strand Magazine (Volume 41).djvu' -rw-rw-r-- 1 reedy wikidev 0 Sep 30 15:28 'The Strand Magazine (Volume 42).djvu' -rw-rw-r-- 1 reedy wikidev 160129232 Sep 14 20:25 'The Strand Magazine (Volume 44).djvu' -rw-rw-r-- 1 reedy wikidev 158126335 Sep 16 10:57 'The Strand Magazine (Volume 45).djvu' -rw-rw-r-- 1 reedy wikidev 157304871 Sep 14 21:23 'The Strand Magazine (Volume 47).djvu' -rw-rw-r-- 1 reedy wikidev 155488039 Sep 14 21:54 'The Strand Magazine (Volume 48).djvu' -rw-rw-r-- 1 reedy wikidev 160735333 Sep 14 22:12 'The Strand Magazine (Volume 50).djvu' -rw-rw-r-- 1 reedy wikidev 158237496 Sep 14 22:21 'The Strand Magazine (Volume 51).djvu' -rw-rw-r-- 1 reedy wikidev 152748665 Sep 15 09:35 'The Strand Magazine (Volume 52).djvu' -rw-rw-r-- 1 reedy wikidev 149745219 Sep 15 10:56 'The Strand Magazine (Volume 53).djvu' -rw-rw-r-- 1 reedy wikidev 149787053 Sep 15 11:04 'The Strand Magazine (Volume 54).djvu' -rw-rw-r-- 1 reedy wikidev 178765076 Sep 16 10:49 'The Strand Magazine (Volume 55).djvu' -rw-rw-r-- 1 reedy wikidev 145312275 Sep 15 11:12 'The Strand Magazine (Volume 56).djvu' -rw-rw-r-- 1 reedy wikidev 149470812 Sep 30 16:40 'The Strand Magazine (Volume 58).djvu' reedy@mwmaint1002:/tmp/uploads$
reedy@mwmaint1002:/tmp/uploads$ wget https://archive.org/download/TheStrandMagazineVolume35/TheStrandMagazineVolume35.djvu -O "The Strand Magazine (Volume 35).djvu" --2021-09-30 18:02:08-- https://archive.org/download/TheStrandMagazineVolume35/TheStrandMagazineVolume35.djvu Resolving webproxy.eqiad.wmnet (webproxy.eqiad.wmnet)... 2620:0:861:1:208:80:154:32, 208.80.154.32 Connecting to webproxy.eqiad.wmnet (webproxy.eqiad.wmnet)|2620:0:861:1:208:80:154:32|:8080... connected. Proxy request sent, awaiting response... 404 Not Found 2021-09-30 18:02:11 ERROR 404: Not Found. reedy@mwmaint1002:/tmp/uploads$ wget https://archive.org/download/TheStrandMagazineVolume42/TheStrandMagazineVolume42.djvu -O "The Strand Magazine (Volume 42).djvu" --2021-09-30 18:03:03-- https://archive.org/download/TheStrandMagazineVolume42/TheStrandMagazineVolume42.djvu Resolving webproxy.eqiad.wmnet (webproxy.eqiad.wmnet)... 2620:0:861:1:208:80:154:32, 208.80.154.32 Connecting to webproxy.eqiad.wmnet (webproxy.eqiad.wmnet)|2620:0:861:1:208:80:154:32|:8080... connected. Proxy request sent, awaiting response... 404 Not Found 2021-09-30 18:03:06 ERROR 404: Not Found.
Are these two supposed to work?
Hmm, looks like those also failed to upload to the IA some time during the multi-day process. I guess it still doesn't have enough armour-plating for when it goes sideways >_<
The files are now being uploaded to wikisource-bot.toolforge, since that's ~10x faster:
This will be my default upload target for when uploads fail since it's definitely much faster on the upload and I'm told also on the download.
Yeah, downloading from there is many many times faster:
reedy@mwmaint1002:/tmp/uploads$ wget "https://wikisource-bot.toolforge.org/ssu_request/The%20Strand%20Magazine%20(Volume%2035).djvu" --2021-09-30 19:45:46-- https://wikisource-bot.toolforge.org/ssu_request/The%20Strand%20Magazine%20(Volume%2035).djvu Resolving webproxy.eqiad.wmnet (webproxy.eqiad.wmnet)... 2620:0:861:1:208:80:154:32, 208.80.154.32 Connecting to webproxy.eqiad.wmnet (webproxy.eqiad.wmnet)|2620:0:861:1:208:80:154:32|:8080... connected. Proxy request sent, awaiting response... 200 OK Length: 162234162 (155M) [image/vnd.djvu] Saving to: ‘The Strand Magazine (Volume 35).djvu’ The Strand Magazine (Volume 35).djvu 100%[==============================================================================================>] 154.72M 35.8MB/s in 4.3s 2021-09-30 19:45:50 (35.7 MB/s) - ‘The Strand Magazine (Volume 35).djvu’ saved [162234162/162234162] reedy@mwmaint1002:/tmp/uploads$ wget "https://wikisource-bot.toolforge.org/ssu_request/The%20Strand%20Magazine%20(Volume%2042).djvu" --2021-09-30 19:45:55-- https://wikisource-bot.toolforge.org/ssu_request/The%20Strand%20Magazine%20(Volume%2042).djvu Resolving webproxy.eqiad.wmnet (webproxy.eqiad.wmnet)... 2620:0:861:1:208:80:154:32, 208.80.154.32 Connecting to webproxy.eqiad.wmnet (webproxy.eqiad.wmnet)|2620:0:861:1:208:80:154:32|:8080... connected. Proxy request sent, awaiting response... 200 OK Length: 164170144 (157M) [image/vnd.djvu] Saving to: ‘The Strand Magazine (Volume 42).djvu’ The Strand Magazine (Volume 42).djvu 100%[==============================================================================================>] 156.56M 35.7MB/s in 4.4s 2021-09-30 19:46:00 (35.7 MB/s) - ‘The Strand Magazine (Volume 42).djvu’ saved [164170144/164170144]
All uploaded