As of writing:
/dev/mapper/mwlog1001--vg-data 7.9T 7.4T 117G 99% /srv
Compared to in {T264639}, October 2020:
/dev/mapper/mwlog1001--vg-data 7.2T 5.1T 1.8T 74% /srv
And also as of 00:19, April 25, 2021.
[00:19:50] <icinga-wm> PROBLEM - Disk space on mwlog1001 is CRITICAL: DISK CRITICAL - free space: /srv 274062 MB (3% inode=99%): https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space https://grafana.wikimedia.org/dashboard/db/host-overview?var-server=mwlog1001&var-datasource=eqiad+prometheus/ops
The last week or so has seen quite an increase in disk space on the host
As per T264639, mwlog1002 is procured and in service.. What's the plan for decomming mwlog1001? I don't see a ticket, so not sure if it's just going to mostly sit around until there's reason to take it out of service.
It does seem mwlog1002 has seen a similar increase in disk space usage, but has quite a bit more total (and therefore free) space (for now).
I'm guessing something has changed with amount (frequency, data size) of stuff being logged to disk....