Page MenuHomePhabricator

eventlog1001 / full
Closed, ResolvedPublic

Description

Filesystem      Size  Used Avail Use% Mounted on
/dev/md0        9.1G  9.1G     0 100% /
/dev/md2        456G   69G  387G  16% /srv
root@eventlog1001:/var/log/upstart# du -hs
7.6G	.
root@eventlog1001:/var/log/upstart# du -hs * | sort -h | tail -5
3.1M	eventlogging_consumer-mysql-m4-master.log
8.3M	eventlogging_processor-client-side-events.log
845M	eventlogging_consumer-server-side-events-log.log
3.0G	eventlogging_consumer-client-side-events-log.log
3.8G	eventlogging_consumer-all-events-log.log

Event Timeline

faidon assigned this task to Ottomata.
faidon raised the priority of this task from to Unbreak Now!.
faidon updated the task description. (Show Details)
faidon added a project: acl*sre-team.
faidon subscribed.

Change 202048 had a related patch set uploaded (by Ottomata):
Set up disk full alerts for eventlogging that will notify the analytics contact group

https://gerrit.wikimedia.org/r/202048

Change 202048 merged by Ottomata:
Set up disk full alerts for eventlogging that will notify the analytics contact group

https://gerrit.wikimedia.org/r/202048

  • deployed change to log less to stderr/stdout
  • moved /var/log/upstart into /srv/log/upstart and symlinked