Maniphest T217999

Prevent iabot from filling the tools project NFS filesystems
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• Bstorm
	Mar 10 2019, 11:02 PM

Tags

Referenced Files

None

Subscribers

Description

The iabot tool has a file that has grown over a TB twice recently (2/25 and 3/10). Please fix the tool so that the file is not as likely to do that with some kind of cleanup task or rotation at least.

/data/project/iabot/Workers/Worker2.err is the problem file. Recent problems with LDAP could be contributing to the difficulty, but the rate of file growth is only happening there.

Thanks!

Previous related tasks: T183953: tools.iabot is using 1.3T of 8T available tools nfs storage T216988: labstore1004 - DISK CRITICAL - free space: /srv/tools 115904 MB (1% inode=79%):

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		• Bstorm	T217993 2019-03-10: tools and NFS share cleanup (high usage)
		Resolved		Cyberpower678	T217999 Prevent iabot from filling the tools project NFS filesystems

Event Timeline

• Bstorm triaged this task as High priority.Mar 10 2019, 11:02 PM

• Bstorm created this task.

JJMC89 added a project: InternetArchiveBot.Mar 10 2019, 11:04 PM

Krenair updated the task description. (Show Details)Mar 10 2019, 11:06 PM

• Bstorm updated the task description. (Show Details)Mar 10 2019, 11:21 PM

I thought I had fixed this issue last Friday.

This does not seem entirely related to the migration to Toolforge Stretch.

From Jan 2018, same .err files: https://phabricator.wikimedia.org/T183920#3867540

No. There is an issue with the newest beta of IABot that wasn’t caught during testing. I’m actively working to resolve it.

This should be fixed in beta13 of IABot

Cyberpower678 closed this task as Resolved.Mar 12 2019, 6:33 PM