Page MenuHomePhabricator

Please optimize logging table in ruwiki
Closed, ResolvedPublic

Description

Yesterday I removed 35M rows from 75M rows of ruwiki's logging table as part of T285608: Stop logging and clean up auto review logs. I can brush off a couple more millions but that's not super straightforward. Can we optimize the table for now to use the benefits?

Progress

Event Timeline

Marostegui moved this task from Triage to Ready on the DBA board.

I have tried this to see the benefits:
Compressed table:

root@db1096:~# ls -lh /srv/sqldata.s6/ruwiki/logging.ibd
-rw-rw---- 1 mysql mysql 20G Jul  5 10:07 /srv/sqldata.s6/ruwiki/logging.ibd

After:

root@db1096:~# ls -lh /srv/sqldata.s6/ruwiki/logging.ibd
-rw-rw---- 1 mysql mysql 9.1G Jul  5 10:27 /srv/sqldata.s6/ruwiki/logging.ibd

Non compressed table:

root@db1131:~# ls -lh /srv/sqldata/ruwiki/logging.ibd
-rw-rw---- 1 mysql mysql 38G Jul  5 10:07 /srv/sqldata/ruwiki/logging.ibd

After

root@db1131:~# ls -lh /srv/sqldata/ruwiki/logging.ibd
-rw-rw---- 1 mysql mysql 19G Jul  5 10:28 /srv/sqldata/ruwiki/logging.ibd

Mentioned in SAL (#wikimedia-operations) [2021-07-05T10:29:31Z] <marostegui> Optimize ruwiki.logging on s6 eqiad with replication T286102

Marostegui changed the task status from Open to Stalled.Jul 5 2021, 11:19 AM
Marostegui claimed this task.
Marostegui updated the task description. (Show Details)
Marostegui moved this task from Ready to Blocked on the DBA board.

eqiad is done, codfw will be done once we switch back.

Marostegui changed the task status from Stalled to Open.Sep 15 2021, 5:31 AM

This is affected by https://jira.mariadb.org/browse/MDEV-26618 so eqiad needs to be done again (the master is done)

  • dbstore1005
  • db1180
  • db1173
  • db1168
  • db1165
  • db1155
  • db1140
  • db1131
  • db1113
  • db1098
  • db1096
  • clouddb1021
  • clouddb1019
  • clouddb1015

Mentioned in SAL (#wikimedia-operations) [2021-09-23T05:24:49Z] <marostegui> Optimize ruwiki.logging on codfw T286102