Page MenuHomePhabricator

Productionize db114[1-9]
Open, MediumPublic

Description

These hosts are the ones that will replace the ones in s4

  • db1141 -> db1081 (candidate master) This host is temp. being used to test labsdb1011 issues T249188
  • db1142 -> db1084
  • db1143 -> db1091
  • db1144 -> db1097 (multi-instance with s5 as well)
  • db1145 -> db1102 (backup source with s5 as well)
  • db1146 -> db1103 (multi-instance with s2 as well)
  • db1147 -> extra host for performance growth
  • db1148 -> db1121 (sanitarium master)
  • db1149 -> db1138 (current master)

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptTue, May 12, 8:41 AM
Marostegui triaged this task as Medium priority.Tue, May 12, 8:41 AM
Marostegui moved this task from Triage to Next on the DBA board.

Change 596650 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] install: Disable reimage of db114[1-9], db213[6-9] and db2140

https://gerrit.wikimedia.org/r/596650

Change 596650 merged by Marostegui:
[operations/puppet@production] install: Disable reimage of db114[1-9], db213[6-9] and db2140

https://gerrit.wikimedia.org/r/596650

Marostegui updated the task description. (Show Details)Wed, May 20, 7:05 AM

Change 597468 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] mariadb: Place db1142 into s4

https://gerrit.wikimedia.org/r/597468

Change 597468 merged by Marostegui:
[operations/puppet@production] mariadb: Place db1142 into s4

https://gerrit.wikimedia.org/r/597468

Mentioned in SAL (#wikimedia-operations) [2020-05-20T07:10:10Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1084 to clone db1142 T252512', diff saved to https://phabricator.wikimedia.org/P11241 and previous config saved to /var/cache/conftool/dbconfig/20200520-071010-marostegui.json

Mentioned in SAL (#wikimedia-operations) [2020-05-20T08:57:57Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1142 with minimum weight for the first time T252512', diff saved to https://phabricator.wikimedia.org/P11245 and previous config saved to /var/cache/conftool/dbconfig/20200520-085757-marostegui.json

Change 597475 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1142: Enable notifications

https://gerrit.wikimedia.org/r/597475

Change 597475 merged by Marostegui:
[operations/puppet@production] db1142: Enable notifications

https://gerrit.wikimedia.org/r/597475

Marostegui moved this task from Next to In progress on the DBA board.Wed, May 20, 9:36 AM
Marostegui updated the task description. (Show Details)Wed, May 20, 11:10 AM
Marostegui changed the status of subtask T253217: Relocate "old" s4 hosts from Open to Stalled.Wed, May 20, 11:30 AM
jcrespo updated the task description. (Show Details)Wed, May 20, 11:35 AM

Change 597685 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] mariadb: Add db1143 to s4

https://gerrit.wikimedia.org/r/597685

Mentioned in SAL (#wikimedia-operations) [2020-05-21T06:58:59Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1091 - T252512', diff saved to https://phabricator.wikimedia.org/P11261 and previous config saved to /var/cache/conftool/dbconfig/20200521-065858-marostegui.json

Change 597685 merged by Marostegui:
[operations/puppet@production] mariadb: Add db1143 to s4

https://gerrit.wikimedia.org/r/597685

Mentioned in SAL (#wikimedia-operations) [2020-05-21T08:42:27Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1143 to the list of s4 hosts, depooled - T252512', diff saved to https://phabricator.wikimedia.org/P11264 and previous config saved to /var/cache/conftool/dbconfig/20200521-084226-marostegui.json

Mentioned in SAL (#wikimedia-operations) [2020-05-21T08:49:33Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1143 with minimal weight for the first time T252512', diff saved to https://phabricator.wikimedia.org/P11265 and previous config saved to /var/cache/conftool/dbconfig/20200521-084933-marostegui.json

Change 597746 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1143: Enable notifications

https://gerrit.wikimedia.org/r/597746

Change 597746 merged by Marostegui:
[operations/puppet@production] db1143: Enable notifications

https://gerrit.wikimedia.org/r/597746

Marostegui updated the task description. (Show Details)Thu, May 21, 12:10 PM

Mentioned in SAL (#wikimedia-operations) [2020-05-22T04:34:19Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1081 - T252512', diff saved to https://phabricator.wikimedia.org/P11272 and previous config saved to /var/cache/conftool/dbconfig/20200522-043418-marostegui.json

Change 597916 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] mariadb: Place db1149 into s4

https://gerrit.wikimedia.org/r/597916

Change 597916 merged by Marostegui:
[operations/puppet@production] mariadb: Place db1149 into s4

https://gerrit.wikimedia.org/r/597916

Change 597988 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1149: Enable notifications

https://gerrit.wikimedia.org/r/597988

Change 597988 merged by Marostegui:
[operations/puppet@production] db1149: Enable notifications

https://gerrit.wikimedia.org/r/597988

Marostegui updated the task description. (Show Details)Fri, May 22, 8:34 AM

Mentioned in SAL (#wikimedia-operations) [2020-05-22T10:44:37Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1097:3314, db1097:3315 - T252512', diff saved to https://phabricator.wikimedia.org/P11281 and previous config saved to /var/cache/conftool/dbconfig/20200522-104437-marostegui.json

Change 598014 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] mariadb: Productionize db1144 into s4 and s5

https://gerrit.wikimedia.org/r/598014

Mentioned in SAL (#wikimedia-operations) [2020-05-22T10:48:33Z] <marostegui> Stop MySQL on db1097:3314, db1097:3315 to clone db1144 - T252512

Change 598014 merged by Marostegui:
[operations/puppet@production] mariadb: Productionize db1144 into s4 and s5

https://gerrit.wikimedia.org/r/598014

Change 598041 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1144: Enable notifications

https://gerrit.wikimedia.org/r/598041

Change 598041 merged by Marostegui:
[operations/puppet@production] db1144: Enable notifications

https://gerrit.wikimedia.org/r/598041

Marostegui updated the task description. (Show Details)Fri, May 22, 2:36 PM

Mentioned in SAL (#wikimedia-operations) [2020-05-25T11:23:18Z] <marostegui> Extend /srv 1100G on db114[1-9] T252512

Change 598972 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] mariadb: Place db1146 into s2 and s4

https://gerrit.wikimedia.org/r/598972

Mentioned in SAL (#wikimedia-operations) [2020-05-27T08:47:14Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1103:3312 db1103:3314 to clone db1146 T252512', diff saved to https://phabricator.wikimedia.org/P11308 and previous config saved to /var/cache/conftool/dbconfig/20200527-084713-marostegui.json

Change 598972 merged by Marostegui:
[operations/puppet@production] mariadb: Place db1146 into s2 and s4

https://gerrit.wikimedia.org/r/598972

Change 599010 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1146: Enable notifications

https://gerrit.wikimedia.org/r/599010

Change 599010 merged by Marostegui:
[operations/puppet@production] db1146: Enable notifications

https://gerrit.wikimedia.org/r/599010

Mentioned in SAL (#wikimedia-operations) [2020-05-27T13:08:20Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1146:3312 and db1146:3314 to dbctl T252512', diff saved to https://phabricator.wikimedia.org/P11312 and previous config saved to /var/cache/conftool/dbconfig/20200527-130820-marostegui.json

Marostegui updated the task description. (Show Details)Wed, May 27, 2:16 PM
Marostegui updated the task description. (Show Details)Mon, Jun 1, 7:02 AM

Change 601175 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] mariadb: Productionize db1147

https://gerrit.wikimedia.org/r/601175

Mentioned in SAL (#wikimedia-operations) [2020-06-01T07:05:19Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1142 to clone db1147 T252512', diff saved to https://phabricator.wikimedia.org/P11339 and previous config saved to /var/cache/conftool/dbconfig/20200601-070519-marostegui.json

Change 601175 merged by Marostegui:
[operations/puppet@production] mariadb: Productionize db1147

https://gerrit.wikimedia.org/r/601175

Mentioned in SAL (#wikimedia-operations) [2020-06-01T09:18:10Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1147 to dbctl, depooled T252512', diff saved to https://phabricator.wikimedia.org/P11341 and previous config saved to /var/cache/conftool/dbconfig/20200601-091809-marostegui.json

Change 601305 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1147: Enable notifications

https://gerrit.wikimedia.org/r/601305

Change 601305 merged by Marostegui:
[operations/puppet@production] db1147: Enable notifications

https://gerrit.wikimedia.org/r/601305

Mentioned in SAL (#wikimedia-operations) [2020-06-01T09:22:21Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1142, db1147 T252512', diff saved to https://phabricator.wikimedia.org/P11342 and previous config saved to /var/cache/conftool/dbconfig/20200601-092220-marostegui.json

Mentioned in SAL (#wikimedia-operations) [2020-06-01T11:30:33Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1142, db1147 T252512', diff saved to https://phabricator.wikimedia.org/P11343 and previous config saved to /var/cache/conftool/dbconfig/20200601-113032-marostegui.json

Mentioned in SAL (#wikimedia-operations) [2020-06-01T11:44:41Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1142, db1147 T252512', diff saved to https://phabricator.wikimedia.org/P11344 and previous config saved to /var/cache/conftool/dbconfig/20200601-114440-marostegui.json

Mentioned in SAL (#wikimedia-operations) [2020-06-01T12:00:00Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1142, db1147 T252512', diff saved to https://phabricator.wikimedia.org/P11345 and previous config saved to /var/cache/conftool/dbconfig/20200601-120000-marostegui.json

Marostegui updated the task description. (Show Details)Mon, Jun 1, 12:00 PM