HomePhabricator

Refactor a bit, add archive.org as a web seed

Description

Refactor a bit, add archive.org as a web seed

And improve support for resuming runs

Details

Provenance
LegoktmAuthored on Jan 19 2017, 11:11 PM
Parents
R2037:5c487cde03de: Skip 'latest' directories - broken for chwikimedia
Branches
Unknown
Tags
Unknown
ChangeId
None

Event Timeline

Interestingly, deluge (1.3.12) finds both archive.org servers as webseeds:

$ deluge-console "info -v 64321954d652702a2c5463f95af53a39c944b90c"

Name: bclwiki-20161201-pages-articles-multistream.xml.bz2
ID: 64321954d652702a2c5463f95af53a39c944b90c
State: Error
Size: 14.8 KiB/3.6 MiB Ratio: 0.000
Seed time: 0 days 00:00:00 Active: 1 days 16:03:47
Tracker status: opentrackr.org: Announce OK
Progress: 0.40% [~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~]
  ::Files
    bclwiki-20161201-pages-articles-multistream.xml.bz2 (3.6 MiB) Progress: 0.24% Priority: Normal
  ::Peers
Seed    US      207.241.227.46:443      URL seed @ ia601906.us.archive.org (nginx/1.4.6 (Ubuntu))       0.0 KiB/s       0.0 KiB/s
Seed    US      207.241.228.106:443     URL seed @ ia801906.us.archive.org (nginx/1.4.6 (Ubuntu))       0.0 KiB/s       0.0 KiB/s
Seed    BR      200.236.31.1:80 URL seed @ wikipedia.c3sl.ufpr.br (Apache)      0.0 KiB/s       0.0 KiB/s
Seed    US      204.9.55.82:80  URL seed @ dumps.wikimedia.your.org (lighttpd)  0.0 KiB/s       0.0 KiB/s
Seed    SE      130.239.18.165:80       URL seed @ ftp.acc.umu.se (Apache/2.4.25 (Unix))        0.0 KiB/s       0.0 KiB/s