/srv/ jumped to ~2% disk space left ~22h ago
https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=notebook1003&service=Disk+space
/srv/ jumped to ~2% disk space left ~22h ago
https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=notebook1003&service=Disk+space
I removed a rev of the analytics refinery in /srv/deployment, should be better now.
If the following homes could be reduced it would be great:
11G piccardi 18G fsalutari 28G dsaez
@diego @S.piccardi @Fsalutari could you please take a look? (the rationale is that notebook nodes are not meant to store data, but only to be used as a way to connect to Spark/HDFS/etc..).
I only signed up Mediawiki to file a bug report. I don't know anything about this, nor about homes at my name. I have no idea why there are 11G of data somewere, which dat they are and how they concern me. So please let me know about this issue, because now I'm worried about someone impersonating me.
@S.piccardi sorry my bad! There is another person with your surname that works with Analytics, and I added the wrong phab username. Apologies :)
It's at 0% now and alerting. This time for / and not /srv/
https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=notebook1004&service=Disk+space
Mentioned in SAL (#wikimedia-operations) [2020-02-26T14:00:43Z] <elukey> run apt-get clean on notebook1004 to free some space - T224682
Mentioned in SAL (#wikimedia-operations) [2020-03-02T17:41:05Z] <mutante> notebook1003 df: /mnt/hdfs: Input/output error | systemctl restart nagios-nrpe-server (T224682)
We added jupyterhub to stat1004 and stat1006 and we'll move people with big homes, it should help long term.