Details
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Resolved | faidon | T84041 Replace all instances of lighttpd with nginx | |||
Resolved | faidon | T84053 mailman - replace lighttpd | |||
Resolved | LSobanski | T111653 Encrypt all the things | |||
Resolved | faidon | T82576 Enable STARTTLS (both inbound and outbound) on lists | |||
Resolved | JanZerebecki | T55259 Add Forward Secrecy to all HTTPS sites | |||
Resolved | Dzahn | T90351 Improve SSL of lists.wikimedia.org | |||
Resolved | Dzahn | T83541 Upgrade Exim to >=4.73 | |||
Duplicate | None | T97492 Upgrade to Mailman 3.0 | |||
Resolved | Dzahn | T110141 TTL back up to normal 1H | |||
Resolved | • MZMcBride | T27231 Mailman mailing list archiver truncates if a line begins with "From" | |||
Resolved | None | T66818 Mitigate strict DMARC policy on the mailing lists | |||
Resolved | Dzahn | T80945 Get rid of all Ubuntu Lucid (10.04) installs | |||
Resolved | Dzahn | T82698 shutdown sodium after mailman has migrated to jessie VM | |||
Resolved | Dzahn | T105756 Mailman Upgrade (Jessie & Mailman 2.x) and migration to a VM | |||
Resolved | Dzahn | T110138 rsync the diff since mail was held on sodium |
Event Timeline
Change 237001 had a related patch set uploaded (by Dzahn):
mailman: rsync command for exim copy
Change 237008 had a related patch set uploaded (by Dzahn):
mailman: rsync for local import
in preparation for this i already deleted a whole bunch of spam from sodium, obvious spam from gTLDs such as .racing, .space and .xyz was especially popular among the older held messages.
it is down to things that are just a few days old and not very obvious spam
Change 237299 had a related patch set uploaded (by Dzahn):
mailman: also rsync qfiles
since rsync scripts have been changed and use other options, i ran new tests:
initial run as dry-run:
sent 2038665 bytes received 6328 bytes 29424.36 bytes/sec total size is 2873269305 speedup is 1405.03 (DRY RUN) real 114m25.086s user 0m12.470s sys 1m0.080s
intial run, real:
sent 54669718 bytes received 40125 bytes 304790.21 bytes/sec total size is 2848527589 speedup is 52.07 real 136m2.074s user 12m20.380s sys 1m20.020s
second run, about 7 hours after the last one:
sent 27587140 bytes received 8667 bytes 73687.07 bytes/sec total size is 2879319104 speedup is 104.34 real 105m21.346s user 3m29.980s sys 1m3.040s
one more time, about 20 hours later
sent 5435891 bytes received 10238 bytes 37952.12 bytes/sec
total size is 2837146704 speedup is 520.95
real 101m38.155s
user 3m38.360s
sys 1m5.030s
so we're seeing static values below 2 hours but not less than an hour and forty minutes? Still seems high but if we are directly rsyncing, it would fall under a well timed window.