Currently /data/project/zoomviewer/public_html/cache is 166G. The Toolforge NFS system is getting full, and we need folks to clean up large directories however possible. Is there any way to reduce disk usage?
iipsrv.log is 5G, which might be quicker to clean up.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Duplicate | • Bstorm | T284964 2021-06-15: Tools NFS share cleanup | |||
| Resolved | tstarling | T285018 zoomviewer taking up a lot of NFS space -- please clean up |
I've already set up a daily cronjob that prunes out all cache file older than 90 days. That's based on mtime. I suppose atime would be the better measure, but /mnt/nfs/labstore-secondary-tools-project is mounted with noatime. Do you want me to reduce the expiration age to 30 days? Alternatively I could come up with a dabade approach to implement atime myself and purge images that are not being accessed for a while.
Those are both good ideas. If 30 days works and doesn't ruin the tool's usefulness, that would definitely help and seems easy. There's a lot of larger tools this round with no single huge user, so I'm trying to see what all of the largest users can do to help.
@dschwen: Per emails from Sep18 and Oct20 and https://www.mediawiki.org/wiki/Bug_management/Assignee_cleanup , I am resetting the assignee of this task because there has not been progress lately (please correct me if I am wrong!). Resetting the assignee avoids the impression that somebody is already working on this task. It also allows others to potentially work towards fixing this task. Please claim this task again when you plan to work on it (via Add Action... → Assign / Claim in the dropdown menu) - it would be welcome. Thanks for your understanding!
I reduced the expiry time to 30 days.
Also, I fixed a bug causing originals to be deleted less than 1 day after download.
Previously, pyramids were 221GB and originals were 17GB. Now pyramids are 107GB but we can expect originals to grow to a multiple of that figure, due to the bug fix. If that's a problem, the expiry time can be reduced further.
"Clean up" is not really a fair description of the task. These are cache files, not junk.