Page Menu
Home
Phabricator
Search
Configure Global Search
Log In
Paste
P17649
16 minutes for 497MB
Active
Public
Actions
Authored by
Legoktm
on Nov 1 2021, 10:09 PM.
Edit Paste
Archive Paste
View Raw File
Subscribe
Mute Notifications
Award Token
Flag For Later
Tags
None
Referenced Files
F34722936: 16 minutes for 497MB
Nov 1 2021, 10:09 PM
2021-11-01 22:09:44 (UTC+0)
Subscribers
None
legoktm@mw1305:~$ curl -v https://archive.org/download/clevelandart-1916.1044-gardener-s-house-at/1916.1044_full.tif --http1.1 -L --output test.tif
* Expire in 0 ms for 6 (transfer 0x5581b61f5fb0)
* Uses proxy env variable https_proxy == 'http://url-downloader.eqiad.wikimedia.org:8080'
* Expire in 1 ms for 1 (transfer 0x5581b61f5fb0)
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 2 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 1 (transfer 0x5581b61f5fb0)
* Trying 2620:0:861:3:208:80:154:81...
* TCP_NODELAY set
* Expire in 149999 ms for 3 (transfer 0x5581b61f5fb0)
* Expire in 200 ms for 4 (transfer 0x5581b61f5fb0)
* Connected to url-downloader.eqiad.wikimedia.org (2620:0:861:3:208:80:154:81) port 8080 (#0)
* allocate connect buffer!
* Establish HTTP proxy tunnel to archive.org:443
> CONNECT archive.org:443 HTTP/1.1
> Host: archive.org:443
> User-Agent: curl/7.64.0
> Proxy-Connection: Keep-Alive
>
< HTTP/1.1 200 Connection established
<
* Proxy replied 200 to CONNECT request
* CONNECT phase completed!
* ALPN, offering http/1.1
* successfully set certificate verify locations:
* CAfile: none
CApath: /etc/ssl/certs
} [5 bytes data]
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
} [512 bytes data]
* CONNECT phase completed!
* CONNECT phase completed!
{ [5 bytes data]
* TLSv1.3 (IN), TLS handshake, Server hello (2):
{ [80 bytes data]
* TLSv1.2 (IN), TLS handshake, Certificate (11):
{ [5152 bytes data]
* TLSv1.2 (IN), TLS handshake, Server key exchange (12):
{ [300 bytes data]
* TLSv1.2 (IN), TLS handshake, Server finished (14):
{ [4 bytes data]
* TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
} [37 bytes data]
* TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1):
} [1 bytes data]
* TLSv1.2 (OUT), TLS handshake, Finished (20):
} [16 bytes data]
* TLSv1.2 (IN), TLS handshake, Finished (20):
{ [16 bytes data]
* SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256
* ALPN, server accepted to use http/1.1
* Server certificate:
* subject: OU=Domain Control Validated; CN=*.archive.org
* start date: Dec 23 13:16:33 2019 GMT
* expire date: Feb 21 22:56:08 2022 GMT
* subjectAltName: host "archive.org" matched cert's "archive.org"
* issuer: C=US; ST=Arizona; L=Scottsdale; O=GoDaddy.com, Inc.; OU=http://certs.godaddy.com/repository/; CN=Go Daddy Secure Certificate Authority - G2
* SSL certificate verify ok.
} [5 bytes data]
> GET /download/clevelandart-1916.1044-gardener-s-house-at/1916.1044_full.tif HTTP/1.1
> Host: archive.org
> User-Agent: curl/7.64.0
> Accept: */*
>
{ [5 bytes data]
< HTTP/1.1 302 Found
< Server: nginx/1.18.0 (Ubuntu)
< Date: Mon, 01 Nov 2021 21:34:33 GMT
< Content-Type: text/html; charset=UTF-8
< Transfer-Encoding: chunked
< Connection: keep-alive
< Accept-Ranges: bytes
< Location: https://ia800907.us.archive.org/30/items/clevelandart-1916.1044-gardener-s-house-at/1916.1044_full.tif
< Strict-Transport-Security: max-age=15724800
< Referrer-Policy: no-referrer-when-downgrade
<
* Ignoring the response-body
{ [5 bytes data]
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
* Connection #0 to host url-downloader.eqiad.wikimedia.org left intact
* Issue another request to this URL: 'https://ia800907.us.archive.org/30/items/clevelandart-1916.1044-gardener-s-house-at/1916.1044_full.tif'
* Uses proxy env variable https_proxy == 'http://url-downloader.eqiad.wikimedia.org:8080'
* Found bundle for host ia800907.us.archive.org: 0x5581b61f4fe0 [can pipeline]
* Hostname url-downloader.eqiad.wikimedia.org was found in DNS cache
* Trying 2620:0:861:3:208:80:154:81...
* TCP_NODELAY set
* Expire in 150000 ms for 3 (transfer 0x5581b61f5fb0)
* Expire in 200 ms for 4 (transfer 0x5581b61f5fb0)
* Expire in 0 ms for 6 (transfer 0x5581b61f5fb0)
* Connected to url-downloader.eqiad.wikimedia.org (2620:0:861:3:208:80:154:81) port 8080 (#1)
* allocate connect buffer!
* Establish HTTP proxy tunnel to ia800907.us.archive.org:443
> CONNECT ia800907.us.archive.org:443 HTTP/1.1
> Host: ia800907.us.archive.org:443
> User-Agent: curl/7.64.0
> Proxy-Connection: Keep-Alive
>
< HTTP/1.1 200 Connection established
<
* Proxy replied 200 to CONNECT request
* CONNECT phase completed!
* ALPN, offering http/1.1
* successfully set certificate verify locations:
* CAfile: none
CApath: /etc/ssl/certs
} [5 bytes data]
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
} [512 bytes data]
* CONNECT phase completed!
* CONNECT phase completed!
{ [5 bytes data]
* TLSv1.3 (IN), TLS handshake, Server hello (2):
{ [80 bytes data]
* TLSv1.2 (IN), TLS handshake, Certificate (11):
{ [5161 bytes data]
* TLSv1.2 (IN), TLS handshake, Server key exchange (12):
{ [300 bytes data]
* TLSv1.2 (IN), TLS handshake, Server finished (14):
{ [4 bytes data]
* TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
} [37 bytes data]
* TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1):
} [1 bytes data]
* TLSv1.2 (OUT), TLS handshake, Finished (20):
} [16 bytes data]
* TLSv1.2 (IN), TLS handshake, Finished (20):
{ [16 bytes data]
* SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256
* ALPN, server accepted to use http/1.1
* Server certificate:
* subject: OU=Domain Control Validated; CN=*.us.archive.org
* start date: Dec 23 13:16:32 2019 GMT
* expire date: Feb 21 22:56:17 2022 GMT
* subjectAltName: host "ia800907.us.archive.org" matched cert's "*.us.archive.org"
* issuer: C=US; ST=Arizona; L=Scottsdale; O=GoDaddy.com, Inc.; OU=http://certs.godaddy.com/repository/; CN=Go Daddy Secure Certificate Authority - G2
* SSL certificate verify ok.
} [5 bytes data]
> GET /30/items/clevelandart-1916.1044-gardener-s-house-at/1916.1044_full.tif HTTP/1.1
> Host: ia800907.us.archive.org
> User-Agent: curl/7.64.0
> Accept: */*
>
{ [5 bytes data]
< HTTP/1.1 200 OK
< Server: nginx/1.18.0 (Ubuntu)
< Date: Mon, 01 Nov 2021 21:34:34 GMT
< Content-Type: image/tiff
< Content-Length: 521184928
< Last-Modified: Sun, 13 Jan 2019 20:33:40 GMT
< Connection: keep-alive
< ETag: "5c3ba0a4-1f10a6a0"
< Strict-Transport-Security: max-age=15724800
< Expires: Tue, 02 Nov 2021 03:34:34 GMT
< Cache-Control: max-age=21600
< Referrer-Policy: no-referrer-when-downgrade
< Accept-Ranges: bytes
<
{ [15965 bytes data]
100 497M 100 497M 0 0 524k 0 0:16:11 0:16:11 --:--:-- 541k
* Connection #1 to host url-downloader.eqiad.wikimedia.org left intact
Event Timeline
Legoktm
created this paste.
Nov 1 2021, 10:09 PM
2021-11-01 22:09:44 (UTC+0)
Legoktm
mentioned this in
T292954: [epic] large file uploads to commons
.
Legoktm
mentioned this in
T295009: Improve download speed from archive.org on appservers
.
Nov 4 2021, 8:09 AM
2021-11-04 08:09:03 (UTC+0)
Log In to Comment