In the service history for the disk on labstore1004, this alert is mentioned:
[2019-02-25 01:31:06] SERVICE ALERT: labstore1004;Disk space;CRITICAL;HARD;3;DISK CRITICAL - free space: /srv/tools 473469 MB (5% inode=79%):
It recovered after @GTirloni got the info from other teams and IRC and fixed things.
[2019-02-25 10:28:40] SERVICE ALERT: labstore1004;Disk space;OK;HARD;3;DISK OK
These things should page us. This task is to track down why this did not happen.