At 2019-01-04 22:09 UTC the archive-things tool is/was running 75 active grid engine jobs:
Job | Total seen | Active | Last seen (exit) |
---|---|---|---|
save | 4 | 4 | Currently running |
yt-channels-3 | 1400 | 34 | Currently running |
yt-channels-5 | 8300 | 30 | Currently running |
yt-daily | 175 | 2 | Currently running |
yt-lists | 167 | 5 | Currently running |
This seems like a lot of resources to be devoting to the purpose of "Automatically and periodically archive things to the Internet Archive Wayback Machine through Save Page Now." Can the concurrency (number of simultaneously active jobs) be scaled back?