Page MenuHomePhabricator

dbstore1003 filling up
Closed, ResolvedPublic

Description

root@dbstore1003:/srv# df -hT /srv
Filesystem            Type  Size  Used Avail Use% Mounted on
/dev/mapper/tank-data xfs   4.4T  4.0T  397G  92% /srv
root@dbstore1003:/srv# du -sh *
1.9T	sqldata.s1
681G	sqldata.s5
1.5T	sqldata.s7
0	tmp.s1
0	tmp.s5
0	tmp.s7
root@dbstore1003:/srv#

This host is scheduled for refresh in Q1 next FY, which comes very handy. I am going to optimize some of the tables so we can get some space until the refresh arrives.

Event Timeline

Marostegui moved this task from Triage to In progress on the DBA board.

Thanks @Marostegui - Let me know if there's anything I can do to help.

Mentioned in SAL (#wikimedia-operations) [2023-05-16T09:21:10Z] <marostegui> Optimize s5 on dbstore1003 T336733

s5 was done:

root@dbstore1003:/srv# du -sh *
1.9T    sqldata.s1
562G    sqldata.s5
1.5T    sqldata.s7

Going for s7 now

Mentioned in SAL (#wikimedia-operations) [2023-05-17T05:16:04Z] <marostegui> Optimize s7 on dbstore1003 T336733

s7 was done:

root@dbstore1003:/srv# df -hT /srv
Filesystem            Type  Size  Used Avail Use% Mounted on
/dev/mapper/tank-data xfs   4.4T  3.3T  1.1T  75% /srv
root@dbstore1003:/srv# du -sh *
1.8T	sqldata.s1
477G	sqldata.s5
1.1T	sqldata.s7

I also deleted a bunch of old relay logs from all the 3 sections.
Going for s1 now.

This should be enough to keep us fine until we receive the host to replace this one in Q1

root@dbstore1003:/srv# du -sh *
1.5T	sqldata.s1
484G	sqldata.s5
1.1T	sqldata.s7
0	tmp.s1
0	tmp.s5
0	tmp.s7
root@dbstore1003:/srv# df -hT /srv/
Filesystem            Type  Size  Used Avail Use% Mounted on
/dev/mapper/tank-data xfs   4.4T  3.1T  1.3T  71% /srv
root@dbstore1003:/srv#