Page MenuHomePhabricator

tools-webgrid-generic-1402 filling up from pacct on man tasks
Closed, ResolvedPublic

Description

This node is just about full from pacct activity. lastcomm says:

10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45
10.64.37.18-man   F    root     __         0.00 secs Tue Sep 11 16:45

This is pretty much just like T107052

Event Timeline

Per the historical task, remounted NFS.

Seems to have done it after truncating the offending files.

tools-exec-1418 was in the same condition. This may have been around for a while due to NFS changes. I'm not sure if it wasn't triggered very recently, though.

This appears resolved as long as this relates ultimately to the failover for NFS server reboots, not to T203254