Page MenuHomePhabricator

Reducing wikiedudashboard/access.log size (68GB)
Closed, ResolvedPublic

Description

Hi @awight and @Ragesoss

Could you please see if it's possible to truncate/compress/archive the following large file? It's currently occupying 68GB of disk space. Please also see if you can also cleanup any other unnecessary files if possible.

# ls -lh/srv/tools/shared/tools/project/wikiedudashboard/access.log
-rw-r--r-- 1 52389 52389 68G Sep 19 16:34 access.log

Thank you for your help with this matter.

Event Timeline

That log file is not needed at all. It looks like that logging is part of the automatic configuration for a web tool with lighttpd, but I can't find any documentation on how to disable it or automatically truncate it when it gets big. All I found is: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Web/Lighttpd#Web_logs

I tried to truncate it, but it does not seem to be taking. I ran truncate -s 0 access.log and it went to 0, but then shortly after it shows as 68G again.

I wonder if the "real" fix for access.log would be to remove it from the default lighttpd config and let folks add it back in via $HOME/.lighttpd.conf if they really want/need it? I should start a task and some discussion about that. I have a hunch that for the majority of webservices running on Toolforge nobody every looks at the access.log data.

Hi @Ragesoss, from https://phabricator.wikimedia.org/T152235#3521216, you need to stop the webserver before you can truncate the access.log file

It looks like the access.log file has been truncated. Thanks.