Page MenuHomePhabricator

Cleanup stale cassandra graphite metrics
Closed, ResolvedPublic

Description

This morning graphite1003 (the machine hosting cassandra metrics) ran out of disk space. I've added some from the VG but there isn't a whole lot left in the VG itself (66G).
I'm proposing to regularly clean up metric files that haven't been modified say in six months.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 26 2017, 8:34 AM
fgiunchedi renamed this task from cleanup stale cassandra graphite metrics to Cleanup stale cassandra graphite metrics.Oct 26 2017, 8:37 AM

Change 386587 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] graphite: cleanup cassandra metrics

https://gerrit.wikimedia.org/r/386587

mobrovac added a subscriber: mobrovac.

Also, there are metrics that are no longer being emitted and can be cleaned up, cf T173436: Delete graphite metrics for old CFs.

Change 386587 merged by Filippo Giunchedi:
[operations/puppet@production] graphite: cleanup cassandra metrics

https://gerrit.wikimedia.org/r/386587

Mentioned in SAL (#wikimedia-operations) [2017-10-26T13:32:44Z] <godog> force delete old graphite cassandra metrics - T179057

fgiunchedi closed this task as Resolved.Oct 26 2017, 1:53 PM
fgiunchedi claimed this task.

All done!