Page MenuHomePhabricator

Prevent iabot from filling the tools project NFS filesystems
Closed, ResolvedPublic

Description

The iabot tool has a file that has grown over a TB twice recently (2/25 and 3/10). Please fix the tool so that the file is not as likely to do that with some kind of cleanup task or rotation at least.

/data/project/iabot/Workers/Worker2.err is the problem file. Recent problems with LDAP could be contributing to the difficulty, but the rate of file growth is only happening there.

Thanks!

Previous related tasks: T183953: tools.iabot is using 1.3T of 8T available tools nfs storage T216988: labstore1004 - DISK CRITICAL - free space: /srv/tools 115904 MB (1% inode=79%):

Event Timeline

Bstorm created this task.Mar 10 2019, 11:02 PM
Bstorm triaged this task as High priority.
Krenair updated the task description. (Show Details)Mar 10 2019, 11:06 PM
Bstorm updated the task description. (Show Details)Mar 10 2019, 11:21 PM

I thought I had fixed this issue last Friday.

This does not seem entirely related to the migration to Toolforge Stretch.

From Jan 2018, same .err files: https://phabricator.wikimedia.org/T183920#3867540

No. There is an issue with the newest beta of IABot that wasn’t caught during testing. I’m actively working to resolve it.

Cyberpower678 moved this task from Bugs to v2.0 on the InternetArchiveBot board.

This should be fixed in beta13 of IABot

Cyberpower678 closed this task as Resolved.Mar 12 2019, 6:33 PM