Page MenuHomePhabricator

Logrotate of refinery rotating on size rather than time
Closed, ResolvedPublic1 Estimated Story Points

Description

For example:

/var/log/refinery/sqoop-mediawiki-private.log

Event Timeline

Ottomata triaged this task as Medium priority.Oct 4 2018, 4:56 PM
Ottomata raised the priority of this task from Medium to High.
Ottomata added a project: Analytics-Kanban.
Ottomata moved this task from Incoming to Operational Excellence on the Analytics board.

We do have a logrotate config on an1003:

elukey@analytics1003:/etc/logrotate.d$ cat refinery
# Note:  This file is managed by Puppet.
#
/var/log/refinery/*.log {
  size 100M
  rotate 4
  missingok
  notifempty
  nocreate
  su hdfs analytics-admins
}

It logrotates on data size and not on date (like daily, hourly, etc..). So if we want to change it, the file is in: profile/files/analytics/refinery-logrotate.conf

Nuria renamed this task from /var/log/refinery/sqoop-mediawiki-private.log does not rotate to Logrotate of refinery rotating on size rather than time .Oct 4 2018, 10:50 PM
Nuria updated the task description. (Show Details)

Change 464732 had a related patch set uploaded (by Nuria; owner: Nuria):
[operations/puppet@production] Rotate logs in refinery based on time rather than size

https://gerrit.wikimedia.org/r/464732

@elukey : I think (please let me know if you disagree) that a logrotate on time is more intuitive than size so we have a clear point in time when rotation will happen for all logs. Set it to rotate logs weekly and keep 10 logs so there would be 2 months of logs at any one time.

Nuria set the point value for this task to 1.Oct 4 2018, 10:58 PM
Nuria moved this task from Next Up to In Code Review on the Analytics-Kanban board.

Change 464732 merged by Elukey:
[operations/puppet@production] Rotate logs in refinery based on time rather than size

https://gerrit.wikimedia.org/r/464732