Page MenuHomePhabricator

archiva1002 - disk 98% full
Closed, ResolvedPublic

Description

20:56 <+icinga-wm> PROBLEM - Disk space on archiva1002 is CRITICAL: DISK CRITICAL - free space: / 3636 MB (3% inode=98%): /tmp 3636 MB (3% inode=98%): /var/tmp 3636 MB (3% inode=98%): 
                   https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space 
                   https://grafana.wikimedia.org/d/000000377/host-overview?var-server=archiva1002&var-datasource=eqiad+prometheus/ops
22:16 <+icinga-wm> PROBLEM - Disk space on archiva1002 is CRITICAL: DISK CRITICAL - free space: / 3510 MB (3% inode=98%): /tmp 3510 MB (3% inode=98%): /var/tmp 3510 MB (3% inode=98%): 
                   https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space 
                   https://grafana.wikimedia.org/d/000000377/host-overview?var-server=archiva1002&var-datasource=eqiad+prometheus/ops
22:56 <+icinga-wm> PROBLEM - Disk space on archiva1002 is CRITICAL: DISK CRITICAL - free space: / 3448 MB (3% inode=98%): /tmp 3448 MB (3% inode=98%): /var/tmp 3448 MB (3% inode=98%): 
                   https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space 
                   https://grafana.wikimedia.org/d/000000377/host-overview?var-server=archiva1002&var-datasource=eqiad+prometheus/ops

Apparently this alert isn't noticed. Can we change these to notify by opening a ticket or sending an email to service owners instead?

Related Objects

Event Timeline

LSobanski subscribed.

Archiva is on a path to deprecation so this is likely an ask to disable the alerting altogether.

Gehel assigned this task to brouberol.
Gehel triaged this task as High priority.
Gehel added subscribers: brouberol, Gehel.

Archiva is still being used, so we should still keep an eye on it. Cleanup done by @brouberol, we should be good for a while.

How about notifications for next time?