Page MenuHomePhabricator

Clean test-s4 cluster data
Closed, ResolvedPublic

Description

This is a testing cluster and should have pretty much no data apart from pt-heartbeat database and a few other testing tables (if required).
The current status is:

root@db1176:~# df -hT /srv/sqldata
Filesystem            Type  Size  Used Avail Use% Mounted on
/dev/mapper/tank-data xfs   8.7T  1.1T  7.7T  12% /srv

Let's double check what is in there and what can be deleted (pretty much everything for sure)

Event Timeline

Marostegui triaged this task as Medium priority.Nov 4 2025, 11:20 AM
Marostegui moved this task from Triage to Ready on the DBA board.

Top 30 databases on db1176 by size:

+--------------------------+-----------+
| Database                 | Size (GB) |
+--------------------------+-----------+
| phabricator_repository   |    204.95 |
| phabricator_file         |    104.70 |
| phabricator_metamta      |     44.58 |
| phabricator_maniphest    |     41.45 |
| phabricator_herald       |     10.92 |
| phabricator_feed         |      8.30 |
| phabricator_search       |      6.14 |
| phabricator_audit        |      5.96 |
| phabricator_cache        |      4.69 |
| phabricator_paste        |      4.45 |
| phabricator_conduit      |      3.35 |
| phabricator_project      |      1.25 |
| phabricator_draft        |      1.17 |
| phabricator_user         |      1.12 |
| phabricator_fact         |      0.93 |
| phabricator_worker       |      0.75 |
| phabricator_system       |      0.71 |
| bugzilla_migration       |      0.54 |
| rt_migration             |      0.19 |
| phabricator_differential |      0.19 |
| phabricator_phame        |      0.10 |
| phabricator_harbormaster |      0.08 |
| phabricator_calendar     |      0.07 |
| phabricator_multimeter   |      0.07 |
| phabricator_conpherence  |      0.05 |
| phabricator_dashboard    |      0.04 |
| phabricator_daemon       |      0.04 |
| phabricator_pholio       |      0.02 |
| phabricator_token        |      0.02 |
| phabricator_legalpad     |      0.01 |
+--------------------------+-----------+

Databases dropped as discussed on IRC. I'm also seeing what appears to be a backup dir from 14 Apr 2025:

ls /srv/sqldata.m5_backup/ -sSr1 | tail
 1040124 db1176-bin.006645
 1040208 db1176-bin.006596
 1040576 db1176-bin.006539
 1040744 db1176-bin.006611
 1040748 db1176-bin.006444
 1040752 db1176-bin.006505
 1041480 db1176-bin.006598
 1041516 db1176-bin.006483
 1048576 ib_logfile0
10039296 ibdata1

ls /srv/sqldata.m5_backup/mailman3web/ -sSr1 | tail
   11268 django_mailman3_profile.ibd
   12288 hyperkitty_lastview.ibd
   14336 account_emailaddress.ibd
   16384 django_q_task.ibd
   17408 django_q_ormq.ibd
   18432 auth_user.ibd
   22528 hyperkitty_sender.ibd
  323584 hyperkitty_thread.ibd
10051620 hyperkitty_email.ibd
36487240 hyperkitty_attachment.ibd

@Marostegui on db2230 I'm seeing binary logs probably from past test, can I purge all of them to clean up space? https://phabricator.wikimedia.org/P84738

Databases dropped as discussed on IRC. I'm also seeing what appears to be a backup dir from 14 Apr 2025:

ls /srv/sqldata.m5_backup/ -sSr1 | tail
 1040124 db1176-bin.006645
 1040208 db1176-bin.006596
 1040576 db1176-bin.006539
 1040744 db1176-bin.006611
 1040748 db1176-bin.006444
 1040752 db1176-bin.006505
 1041480 db1176-bin.006598
 1041516 db1176-bin.006483
 1048576 ib_logfile0
10039296 ibdata1

ls /srv/sqldata.m5_backup/mailman3web/ -sSr1 | tail
   11268 django_mailman3_profile.ibd
   12288 hyperkitty_lastview.ibd
   14336 account_emailaddress.ibd
   16384 django_q_task.ibd
   17408 django_q_ormq.ibd
   18432 auth_user.ibd
   22528 hyperkitty_sender.ibd
  323584 hyperkitty_thread.ibd
10051620 hyperkitty_email.ibd
36487240 hyperkitty_attachment.ibd

Yeah, you can remove that dir.

@Marostegui on db2230 I'm seeing binary logs probably from past test, can I purge all of them to clean up space? https://phabricator.wikimedia.org/P84738

Anything that is not db1176- or db2230- should be old binlogs and can be removed.

Marostegui claimed this task.

I think this is all as clean as it can get.