Page MenuHomePhabricator
Create Task
Maniphest T254462

Compress enwiki InnoDB tables
Closed, ResolvedPublic
Actions

Description

Let's compress InnoDB on enwiki
Not super urgent, but creating this ticket so we don't forget.
This might result on more CPU usage as we've seen on s8, so ideally do this first on MariaDB 10.4 hosts.

  • labsdb1012
  • labsdb1011
  • labsdb1010
  • labsdb1009
  • dbstore1003
  • db2130
  • db2116
  • db2112
  • db2103
  • db2097
  • db2094
  • db2092
  • db2088
  • db2085
  • db2072
  • db2071
  • db1140
  • db1139
  • db1134
  • db1124
  • db1119
  • db1118
  • db1107
  • db1106
  • db1105
  • db1099
  • db1091
  • db1089
  • db1083
  • db1080 (copied to db1135)

Details

Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Marostegui updated the task description. (Show Details)Jun 8 2020, 12:18 PM
Marostegui updated the task description. (Show Details)Jun 9 2020, 9:39 AM
Stashbot added a comment.Jun 9 2020, 9:41 AM

Mentioned in SAL (#wikimedia-operations) [2020-06-09T09:40:59Z] <marostegui> Compress InnoDB on db2072 T254462

Marostegui moved this task from Pending comment to In progress on the DBA board.Jun 9 2020, 1:47 PM
Marostegui updated the task description. (Show Details)Jun 12 2020, 8:41 AM
Marostegui updated the task description. (Show Details)
gerritbot added a comment.Jun 12 2020, 8:43 AM

Change 605161 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db2092: Disable notifications

https://gerrit.wikimedia.org/r/605161

gerritbot added a project: Patch-For-Review.Jun 12 2020, 8:43 AM
Stashbot added a comment.Jun 12 2020, 8:44 AM

Mentioned in SAL (#wikimedia-operations) [2020-06-12T08:44:21Z] <marostegui> Compress InnoDB on db2092 - T254462

gerritbot added a comment.Jun 12 2020, 8:44 AM

Change 605161 merged by Marostegui:
[operations/puppet@production] db2092: Disable notifications

https://gerrit.wikimedia.org/r/605161

Maintenance_bot removed a project: Patch-For-Review.Jun 12 2020, 9:11 AM
Marostegui updated the task description. (Show Details)Jun 15 2020, 1:55 PM
gerritbot added a comment.Jun 16 2020, 4:50 AM

Change 605732 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db2092: Enable notifications

https://gerrit.wikimedia.org/r/605732

gerritbot added a project: Patch-For-Review.Jun 16 2020, 4:50 AM
gerritbot added a comment.Jun 16 2020, 4:57 AM

Change 605732 merged by Marostegui:
[operations/puppet@production] db2092: Enable notifications

https://gerrit.wikimedia.org/r/605732

Maintenance_bot removed a project: Patch-For-Review.Jun 16 2020, 5:10 AM
Stashbot added a comment.Jun 16 2020, 6:56 AM

Mentioned in SAL (#wikimedia-operations) [2020-06-16T06:56:01Z] <marostegui@cumin2001> dbctl commit (dc=all): 'Depool db1134 for InnoDB compression T254462', diff saved to https://phabricator.wikimedia.org/P11522 and previous config saved to /var/cache/conftool/dbconfig/20200616-065600-marostegui.json

Stashbot added a comment.Jun 16 2020, 6:57 AM

Mentioned in SAL (#wikimedia-operations) [2020-06-16T06:57:00Z] <marostegui> Compress InnoDB on db1134 T254462

gerritbot added a comment.Jun 16 2020, 6:58 AM

Change 605811 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1134: Disable notifications

https://gerrit.wikimedia.org/r/605811

gerritbot added a project: Patch-For-Review.Jun 16 2020, 6:58 AM

Change 605811 merged by Marostegui:
[operations/puppet@production] db1134: Disable notifications

https://gerrit.wikimedia.org/r/605811

Maintenance_bot removed a project: Patch-For-Review.Jun 16 2020, 7:10 AM
Stashbot added a comment.Jun 16 2020, 1:32 PM

Mentioned in SAL (#wikimedia-operations) [2020-06-16T13:32:42Z] <marostegui@cumin2001> dbctl commit (dc=all): 'Repool db2092 T254462', diff saved to https://phabricator.wikimedia.org/P11535 and previous config saved to /var/cache/conftool/dbconfig/20200616-133241-marostegui.json

Marostegui updated the task description. (Show Details)Jun 22 2020, 4:46 AM
gerritbot added a comment.Jun 22 2020, 4:47 AM

Change 606849 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1134: Enable notifications

https://gerrit.wikimedia.org/r/606849

gerritbot added a project: Patch-For-Review.Jun 22 2020, 4:47 AM

Change 606849 merged by Marostegui:
[operations/puppet@production] db1134: Enable notifications

https://gerrit.wikimedia.org/r/606849

Maintenance_bot removed a project: Patch-For-Review.Jun 22 2020, 5:10 AM
gerritbot added a comment.Jun 22 2020, 5:33 AM

Change 606850 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Reimage db1118 to Buster.

https://gerrit.wikimedia.org/r/606850

gerritbot added a project: Patch-For-Review.Jun 22 2020, 5:33 AM

Change 606850 merged by Marostegui:
[operations/puppet@production] install_server: Reimage db1118 to Buster.

https://gerrit.wikimedia.org/r/606850

Stashbot added a comment.Jun 22 2020, 5:58 AM

Mentioned in SAL (#wikimedia-operations) [2020-06-22T05:58:45Z] <marostegui> Compress InnoDb on db1118 T254462

Maintenance_bot removed a project: Patch-For-Review.Jun 22 2020, 6:10 AM
Marostegui updated the task description. (Show Details)Jun 22 2020, 3:30 PM
gerritbot added a comment.Jun 23 2020, 4:49 AM

Change 607165 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1118: Enable notifications

https://gerrit.wikimedia.org/r/607165

gerritbot added a project: Patch-For-Review.Jun 23 2020, 4:49 AM
gerritbot added a comment.Jun 23 2020, 4:55 AM

Change 607165 merged by Marostegui:
[operations/puppet@production] db1118: Enable notifications

https://gerrit.wikimedia.org/r/607165

Maintenance_bot removed a project: Patch-For-Review.Jun 23 2020, 5:10 AM
gerritbot added a comment.Jun 23 2020, 5:11 AM

Change 607167 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1080: Disable notifications

https://gerrit.wikimedia.org/r/607167

gerritbot added a project: Patch-For-Review.Jun 23 2020, 5:11 AM

Change 607167 merged by Marostegui:
[operations/puppet@production] db1080: Disable notifications

https://gerrit.wikimedia.org/r/607167

Stashbot added a comment.Jun 23 2020, 5:24 AM

Mentioned in SAL (#wikimedia-operations) [2020-06-23T05:24:20Z] <marostegui> Compress InnoDB on db1080 T254462

Maintenance_bot removed a project: Patch-For-Review.Jun 23 2020, 6:10 AM
Marostegui updated the task description. (Show Details)Jun 29 2020, 4:26 AM
Marostegui updated the task description. (Show Details)Jun 29 2020, 8:03 AM
gerritbot added a comment.Jun 29 2020, 8:58 AM

Change 608267 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1089: Disable notifications

https://gerrit.wikimedia.org/r/c/operations/puppet/ /608267

gerritbot added a project: Patch-For-Review.Jun 29 2020, 8:58 AM
Stashbot added a comment.Jun 29 2020, 8:58 AM

Mentioned in SAL (#wikimedia-operations) [2020-06-29T08:58:54Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1089 for InnoDB compression T254462', diff saved to https://phabricator.wikimedia.org/P11690 and previous config saved to /var/cache/conftool/dbconfig/20200629-085854-marostegui.json

gerritbot added a comment.Jun 29 2020, 8:59 AM

Change 608267 merged by Marostegui:
[operations/puppet@production] db1089: Disable notifications

https://gerrit.wikimedia.org/r/c/operations/puppet/ /608267

Stashbot added a comment.Jun 29 2020, 8:59 AM

Mentioned in SAL (#wikimedia-operations) [2020-06-29T08:59:39Z] <marostegui> Compress InnoDB on db1089 (this will cause lag and will take a few days) - T254462

Marostegui updated the task description. (Show Details)Jul 6 2020, 4:42 AM
gerritbot added a comment.Jul 6 2020, 4:42 AM

Change 609613 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1089: Enable notifications

https://gerrit.wikimedia.org/r/609613

gerritbot added a comment.Jul 6 2020, 4:45 AM

Change 609613 merged by Marostegui:
[operations/puppet@production] db1089: Enable notifications

https://gerrit.wikimedia.org/r/609613

Stashbot added a comment.Jul 6 2020, 11:07 AM

Mentioned in SAL (#wikimedia-operations) [2020-07-06T11:07:23Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1107 T254462', diff saved to https://phabricator.wikimedia.org/P11745 and previous config saved to /var/cache/conftool/dbconfig/20200706-110723-marostegui.json

gerritbot added a comment.Jul 6 2020, 11:08 AM

Change 609765 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1107: Disable notifications

https://gerrit.wikimedia.org/r/609765

Marostegui added a parent task: T243318: FY2020-2021 Q1 codfw -> eqiad switchback.Jul 6 2020, 11:08 AM
Stashbot added a comment.Jul 6 2020, 11:09 AM

Mentioned in SAL (#wikimedia-operations) [2020-07-06T11:09:45Z] <marostegui> Compress InnoDB on db1107 T254462

gerritbot added a comment.Jul 6 2020, 11:09 AM

Change 609765 merged by Marostegui:
[operations/puppet@production] db1107: Disable notifications

https://gerrit.wikimedia.org/r/609765

Marostegui updated the task description. (Show Details)Jul 10 2020, 4:56 AM
gerritbot added a comment.Jul 10 2020, 4:57 AM

Change 611075 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1107: Enable notifications

https://gerrit.wikimedia.org/r/611075

gerritbot added a comment.Jul 10 2020, 4:58 AM

Change 611075 merged by Marostegui:
[operations/puppet@production] db1107: Enable notifications

https://gerrit.wikimedia.org/r/611075

gerritbot added a comment.Jul 10 2020, 6:34 AM

Change 611165 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1124: Disable notifications

https://gerrit.wikimedia.org/r/611165

Stashbot added a comment.Jul 10 2020, 6:35 AM

Mentioned in SAL (#wikimedia-operations) [2020-07-10T06:35:05Z] <marostegui> Compress InnoDB on db1124:3311 (Sanitarium - lag will appear on s1 on labsdb) - T254462

gerritbot added a comment.Jul 10 2020, 6:35 AM

Change 611165 merged by Marostegui:
[operations/puppet@production] db1124: Disable notifications

https://gerrit.wikimedia.org/r/611165

Marostegui updated the task description. (Show Details)Jul 13 2020, 5:12 AM
gerritbot added a comment.Jul 13 2020, 5:13 AM

Change 611957 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1119: Disable notifications

https://gerrit.wikimedia.org/r/611957

gerritbot added a comment.Jul 13 2020, 5:15 AM

Change 611957 merged by Marostegui:
[operations/puppet@production] db1119: Disable notifications

https://gerrit.wikimedia.org/r/611957

Marostegui claimed this task.Jul 13 2020, 7:14 AM
Marostegui updated the task description. (Show Details)Jul 20 2020, 5:21 AM
gerritbot added a comment.Jul 21 2020, 5:11 AM

Change 614917 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1119: Enable notifications

https://gerrit.wikimedia.org/r/614917

gerritbot added a comment.Jul 21 2020, 5:13 AM

Change 614917 merged by Marostegui:
[operations/puppet@production] db1119: Enable notifications

https://gerrit.wikimedia.org/r/614917

gerritbot added a comment.Jul 27 2020, 12:37 PM

Change 616513 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1106: Disable notifications

https://gerrit.wikimedia.org/r/616513

Stashbot added a comment.Jul 27 2020, 12:38 PM

Mentioned in SAL (#wikimedia-operations) [2020-07-27T12:38:34Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1106 and pool db1105:3311 as vslow T254462', diff saved to https://phabricator.wikimedia.org/P12050 and previous config saved to /var/cache/conftool/dbconfig/20200727-123833-marostegui.json

gerritbot added a comment.Jul 27 2020, 12:40 PM

Change 616513 merged by Marostegui:
[operations/puppet@production] db1106: Disable notifications

https://gerrit.wikimedia.org/r/616513

Stashbot added a comment.Jul 27 2020, 12:41 PM

Mentioned in SAL (#wikimedia-operations) [2020-07-27T12:41:00Z] <marostegui> Compress innodb on db1106, this will generate lag on enwiki on labsdb hosts (wiki replicas) T254462

RhinosF1 subscribed.Jul 31 2020, 4:23 PM
Jtmorgan subscribed.Jul 31 2020, 8:03 PM
Proc subscribed.Aug 1 2020, 10:08 AM
• MZMcBride subscribed.Aug 2 2020, 8:40 AM
AntiCompositeNumber subscribed.Aug 2 2020, 7:35 PM
Marostegui updated the task description. (Show Details)Aug 3 2020, 4:59 AM
gerritbot added a comment.Aug 3 2020, 4:59 AM

Change 617875 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1106: Enable notifications

https://gerrit.wikimedia.org/r/617875

gerritbot added a comment.Aug 3 2020, 5:00 AM

Change 617875 merged by Marostegui:
[operations/puppet@production] db1106: Enable notifications

https://gerrit.wikimedia.org/r/617875

Marostegui changed the task status from Open to Stalled.Aug 3 2020, 5:02 AM
Marostegui moved this task from In progress to Blocked external/Not db team on the DBA board.

This is all done except the master, which will be done once the DC switchover is done and eqiad is stand by.

Stashbot added a comment.Aug 3 2020, 5:04 AM

Mentioned in SAL (#wikimedia-operations) [2020-08-03T05:04:38Z] <marostegui> Remove db1108:3321 and db1108:3322 from tendril and add db1108:3351 and db1108:3352 T254462

Marostegui changed the task status from Stalled to Open.Sep 7 2020, 4:34 AM
Marostegui moved this task from Blocked external/Not db team to In progress on the DBA board.
Stashbot added a comment.Sep 7 2020, 4:56 AM

Mentioned in SAL (#wikimedia-operations) [2020-09-07T04:56:17Z] <marostegui> Compress InnoDB on s1 eqiad master - this will generate a few day of lag on s1 and labsdb for enwiki T254462

Marostegui mentioned this in T262239: enwiki database replicas (Toolforge and Cloud VPS) are more than 24h+ lagged.Sep 8 2020, 4:55 PM
Marostegui closed this task as Resolved.Sep 11 2020, 2:03 PM
Marostegui updated the task description. (Show Details)

This is all done

Pppery removed a project: Patch-For-Review.Sep 11 2020, 3:05 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits