Once again, in the tradition of T156982: Cleanup tools nfs share on labstore1004/5, T183920: 2018-01-02: labstore Tools and Misc share very full and T247315: 2020-03-10: tools and misc nfs share cleanup, we must clean up the NFS to prevent collapse.
/dev/drbd4 8.0T 6.4T 1.3T 85% /srv/tools
running
ionice -c 3 nice -19 find /srv/tools -type f -size +100M -printf "%k KB %p\n" | sort -h > tools_large_files_$(date +%Y%m%d).txt
root@labstore1004:~# tail tools_large_files_20220210.txt 31437236 KB /srv/tools/shared/tools/project/freebase/freebase-rdf-latest.gz 31634548 KB /srv/tools/shared/tools/project/zoomviewer/iipsrv.log 32003020 KB /srv/tools/shared/tools/project/ifttt/uwsgi.log 34923884 KB /srv/tools/shared/tools/project/sdzerobot/SDZeroBot/dyk-counts/task.out 36285016 KB /srv/tools/shared/tools/project/wiki2prop/prediction_ranked_Wiki2PropDEPLOY_year2018_embedding300LG_DEPLOY.h5 37082440 KB /srv/tools/shared/tools/project/khanamalumat/qaus.err 43767724 KB /srv/tools/shared/tools/project/render-tests/error.log 47352328 KB /srv/tools/shared/tools/project/rezabot/error.log 49303704 KB /srv/tools/shared/tools/project/splinetools/dumps/enwiki-20141106-pages-articles.xml 116235180 KB /srv/tools/shared/tools/project/jarbot/NANEIT.err
Is it the case that everything following the pattern of "project/<project name>/error.log" is a grid engine log and can be removed or significantly truncated?
@Jar is it alright if we truncate or remove NANEIT.err ?
@Reticulated_Spline is it alright if we remove enwiki-20141106-pages-articles.xml ?
/dev/drbd4 8.0T 5.2T 2.4T 69% /srv/tools
Large log files truncated. Remaining large files amount to about 2.7T of data.