Page MenuHomePhabricator

Prevent iabot from filling the tools project NFS filesystems
Closed, ResolvedPublic


The iabot tool has a file that has grown over a TB twice recently (2/25 and 3/10). Please fix the tool so that the file is not as likely to do that with some kind of cleanup task or rotation at least.

/data/project/iabot/Workers/Worker2.err is the problem file. Recent problems with LDAP could be contributing to the difficulty, but the rate of file growth is only happening there.


Previous related tasks: T183953: tools.iabot is using 1.3T of 8T available tools nfs storage T216988: labstore1004 - DISK CRITICAL - free space: /srv/tools 115904 MB (1% inode=79%):

Event Timeline

Bstorm triaged this task as High priority.Mar 10 2019, 11:02 PM
Bstorm created this task.

I thought I had fixed this issue last Friday.

This does not seem entirely related to the migration to Toolforge Stretch.

From Jan 2018, same .err files:

No. There is an issue with the newest beta of IABot that wasn’t caught during testing. I’m actively working to resolve it.

Cyberpower678 moved this task from Other bugs to v2.0 on the InternetArchiveBot board.

This should be fixed in beta13 of IABot