Page MenuHomePhabricator

Port DirectorySize diamond collector to a Prometheus exporter
Closed, ResolvedPublic

Description

Used in role::labs::nfs::seconday (which despite the name runs in the production realm), this is a custom Diamond collector originally written by Madhu and used in this dashboard: https://grafana.wikimedia.org/dashboard/db/labstore-nfs-directory-sizes

This should be ported to a Prometheus exporter.

Event Timeline

MoritzMuehlenhoff triaged this task as Medium priority.

Change 477937 had a related patch set uploaded (by Cwhite; owner: Cwhite):
[operations/puppet@production] prometheus: add directory size collector

https://gerrit.wikimedia.org/r/477937

Change 477937 merged by GTirloni:
[operations/puppet@production] prometheus: add directory size collector

https://gerrit.wikimedia.org/r/477937

Change 478168 had a related patch set uploaded (by GTirloni; owner: GTirloni):
[operations/puppet@production] prometheus: fix/adjust directory size collector

https://gerrit.wikimedia.org/r/478168

Change 478168 merged by GTirloni:
[operations/puppet@production] prometheus: fix/adjust directory size collector

https://gerrit.wikimedia.org/r/478168

This collector takes 5-10min to run. Since it's only used for capacity planning, I've adjusted the cron to run once a day only.

@colewhite thanks for working on this!

@colewhite Could you followup with a patch to absent the collector from puppet? Other that, this seems fully resolved, I couldn't find any dashboard where the former metrics were in use.