Page MenuHomePhabricator
Create Task
Maniphest T313569

Productionize db1185.eqiad.wmnet - db1195.eqiad.wmnet
Closed, ResolvedPublic
Actions

Description

We need to make a plan to place them accordingly.

  • db1185 s5
  • db1186 s1
  • db1187 s6
  • db1188 s2
  • db1189 s3
  • db1190 s4
  • db1191 s7
  • db1192 s8
  • db1193 s8
  • db1194 s7
  • db1195 s1 (temporarily serving in m1, used as a floating host to reboot all misc clusters, db1107 (m5 now) will be placed in s1 to replace db1195).
  • Verify all hosts are in zarcillo
  • Verify all hosts are active on netbox

Details

ProjectBranchLines +/-Subject
operations/puppetproduction+1 -0instances.yaml: Add db1194 to dbctl
operations/puppetproduction+0 -1db1194: Enable notifications
operations/puppetproduction+1 -0instances.yaml: Add db1193 to dbctl
operations/puppetproduction+0 -1db1193: Enable notifications
operations/puppetproduction+1 -0instances.yaml: Add db1192 to dbctl
operations/puppetproduction+0 -1db1192: Enable notifications
operations/puppetproduction+1 -0instances.yaml: Add db1185 to dbctl
operations/puppetproduction+0 -6site.pp: Remove insetup from db1194
operations/puppetproduction+2 -1mariadb: Productionize db1194
operations/puppetproduction+1 -1install_server: Do not reimage db1192 and db1193
operations/puppetproduction+1 -1site.pp: Remove db1193 from insetup
operations/puppetproduction+2 -1mariadb: Productionize db1193
operations/puppetproduction+3 -2mariadb: Productionize db1192
operations/puppetproduction+1 -0instances.yaml: Add db1191 to dbctl
operations/puppetproduction+1 -1site.pp: Remove insetup from db1185
operations/puppetproduction+3 -2mariadb: Productionize db1185
operations/puppetproduction+0 -1db1191: Enable notifications
operations/puppetproduction+1 -0instances.yaml: Add db1190 to dbctl
operations/puppetproduction+1 -0instances.yaml: Add db1188 to dbctl
operations/puppetproduction+0 -1db1188: Enable notifications
operations/puppetproduction+1 -0instances.yaml: Add db1186 to dbctl
operations/puppetproduction+0 -1db1186: Enable notifications
operations/puppetproduction+1 -1install_server: Do not reimage db1191
operations/puppetproduction+1 -1install_server: Do not reimage db1190
operations/puppetproduction+1 -1site.pp: Remove insetup from db1191
operations/puppetproduction+2 -1mariadb: Productionize db1191
operations/puppetproduction+1 -1site.pp: Remove insetup from db1190
operations/puppetproduction+2 -1mariadb: Productionize db1190
operations/puppetproduction+1 -1site.pp: Remove insetup from db1188
operations/puppetproduction+1 -1site.pp: Remove insetup from db1186
operations/puppetproduction+2 -1mariadb: Productionize db1188
operations/puppetproduction+2 -1mariadb: Productionize db1186
operations/puppetproduction+1 -0instances.yaml: Add db1187 to dbctl
operations/puppetproduction+0 -1db1187: Enable notifications
operations/puppetproduction+1 -0instances.yaml: Add db1189 to dbctl
operations/puppetproduction+0 -1db1189: Enable notifications
operations/puppetproduction+1 -1site.pp: Remove db1189 from insetup
operations/puppetproduction+1 -1install_server: Do not reimage db1187
operations/puppetproduction+2 -1mariadb: Productionize db1189
operations/puppetproduction+2 -1mariadb: Productionize db1187
operations/puppetproduction+1 -1site.pp: Remove insetup from db1195
operations/puppetproduction+22 -0db1185-db1195: Disable notifications
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Marostegui added a comment.Aug 24 2022, 7:12 AM

db1186 is now replicating in s1

Marostegui added a comment.Aug 24 2022, 7:55 AM

db1188 is now replicating in s2

gerritbot added a comment.Aug 24 2022, 8:02 AM

Change 826206 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] mariadb: Productionize db1190

https://gerrit.wikimedia.org/r/826206

gerritbot added a comment.Aug 24 2022, 8:04 AM

Change 826206 merged by Marostegui:

[operations/puppet@production] mariadb: Productionize db1190

https://gerrit.wikimedia.org/r/826206

gerritbot added a comment.Aug 24 2022, 8:22 AM

Change 826209 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] site.pp: Remove insetup from db1190

https://gerrit.wikimedia.org/r/826209

gerritbot added a comment.Aug 24 2022, 8:23 AM

Change 826209 merged by Marostegui:

[operations/puppet@production] site.pp: Remove insetup from db1190

https://gerrit.wikimedia.org/r/826209

gerritbot added a comment.Aug 24 2022, 8:30 AM

Change 826213 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] mariadb: Productionize db1191

https://gerrit.wikimedia.org/r/826213

gerritbot added a comment.Aug 24 2022, 8:32 AM

Change 826213 merged by Marostegui:

[operations/puppet@production] mariadb: Productionize db1191

https://gerrit.wikimedia.org/r/826213

Marostegui added a comment.Aug 24 2022, 9:52 AM

db1190 replicating in s4

gerritbot added a comment.Aug 24 2022, 10:18 AM

Change 826231 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] site.pp: Remove insetup from db1191

https://gerrit.wikimedia.org/r/826231

gerritbot added a comment.Aug 24 2022, 10:18 AM

Change 826231 merged by Marostegui:

[operations/puppet@production] site.pp: Remove insetup from db1191

https://gerrit.wikimedia.org/r/826231

Marostegui added a comment.Aug 24 2022, 11:57 AM

db1191 replicating in s7

gerritbot added a comment.Aug 24 2022, 12:20 PM

Change 826278 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] install_server: Do not reimage db1190

https://gerrit.wikimedia.org/r/826278

gerritbot added a comment.Aug 24 2022, 12:21 PM

Change 826278 merged by Marostegui:

[operations/puppet@production] install_server: Do not reimage db1190

https://gerrit.wikimedia.org/r/826278

gerritbot added a comment.Aug 24 2022, 12:36 PM

Change 826286 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] install_server: Do not reimage db1191

https://gerrit.wikimedia.org/r/826286

gerritbot added a comment.Aug 24 2022, 12:37 PM

Change 826286 merged by Marostegui:

[operations/puppet@production] install_server: Do not reimage db1191

https://gerrit.wikimedia.org/r/826286

gerritbot added a comment.Aug 25 2022, 5:06 AM

Change 826416 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db1186: Enable notifications

https://gerrit.wikimedia.org/r/826416

gerritbot added a comment.Aug 25 2022, 5:08 AM

Change 826416 merged by Marostegui:

[operations/puppet@production] db1186: Enable notifications

https://gerrit.wikimedia.org/r/826416

gerritbot added a comment.Aug 25 2022, 5:09 AM

Change 826417 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Add db1186 to dbctl

https://gerrit.wikimedia.org/r/826417

gerritbot added a comment.Aug 25 2022, 5:10 AM

Change 826417 merged by Marostegui:

[operations/puppet@production] instances.yaml: Add db1186 to dbctl

https://gerrit.wikimedia.org/r/826417

Stashbot added a comment.Aug 25 2022, 5:11 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T05:11:56Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1186 with minimal weight in s1 T313569', diff saved to https://phabricator.wikimedia.org/P33011 and previous config saved to /var/cache/conftool/dbconfig/20220825-051155-root.json

Marostegui updated the task description. (Show Details)Aug 25 2022, 5:12 AM
gerritbot added a comment.Aug 25 2022, 5:13 AM

Change 826418 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db1188: Enable notifications

https://gerrit.wikimedia.org/r/826418

gerritbot added a comment.Aug 25 2022, 5:14 AM

Change 826418 merged by Marostegui:

[operations/puppet@production] db1188: Enable notifications

https://gerrit.wikimedia.org/r/826418

gerritbot added a comment.Aug 25 2022, 5:15 AM

Change 826419 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Add db1188 to dbctl

https://gerrit.wikimedia.org/r/826419

gerritbot added a comment.Aug 25 2022, 5:16 AM

Change 826419 merged by Marostegui:

[operations/puppet@production] instances.yaml: Add db1188 to dbctl

https://gerrit.wikimedia.org/r/826419

Stashbot added a comment.Aug 25 2022, 5:17 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T05:17:37Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1188 to dbctl T313569', diff saved to https://phabricator.wikimedia.org/P33012 and previous config saved to /var/cache/conftool/dbconfig/20220825-051737-marostegui.json

Stashbot added a comment.Aug 25 2022, 5:17 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T05:17:55Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1188 with minimal weight in s2 T313569', diff saved to https://phabricator.wikimedia.org/P33013 and previous config saved to /var/cache/conftool/dbconfig/20220825-051754-root.json

gerritbot added a comment.Aug 25 2022, 5:30 AM

Change 826421 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Add db1190 to dbctl

https://gerrit.wikimedia.org/r/826421

gerritbot added a comment.Aug 25 2022, 5:32 AM

Change 826421 merged by Marostegui:

[operations/puppet@production] instances.yaml: Add db1190 to dbctl

https://gerrit.wikimedia.org/r/826421

Stashbot added a comment.Aug 25 2022, 5:32 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T05:32:53Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1190 to dbctl T313569', diff saved to https://phabricator.wikimedia.org/P33016 and previous config saved to /var/cache/conftool/dbconfig/20220825-053253-marostegui.json

Stashbot added a comment.Aug 25 2022, 5:33 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T05:33:11Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1190 with minimal weight in s4 T313569', diff saved to https://phabricator.wikimedia.org/P33017 and previous config saved to /var/cache/conftool/dbconfig/20220825-053310-root.json

gerritbot added a comment.Aug 25 2022, 5:35 AM

Change 826422 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db1191: Enable notifications

https://gerrit.wikimedia.org/r/826422

gerritbot added a comment.Aug 25 2022, 5:37 AM

Change 826422 merged by Marostegui:

[operations/puppet@production] db1191: Enable notifications

https://gerrit.wikimedia.org/r/826422

gerritbot added a comment.Aug 25 2022, 5:40 AM

Change 826423 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] mariadb: Productionize db1185

https://gerrit.wikimedia.org/r/826423

gerritbot added a comment.Aug 25 2022, 5:41 AM

Change 826423 merged by Marostegui:

[operations/puppet@production] mariadb: Productionize db1185

https://gerrit.wikimedia.org/r/826423

gerritbot added a comment.Aug 25 2022, 5:43 AM

Change 826424 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] site.pp: Remove insetup from db1185

https://gerrit.wikimedia.org/r/826424

gerritbot added a comment.Aug 25 2022, 5:44 AM

Change 826424 merged by Marostegui:

[operations/puppet@production] site.pp: Remove insetup from db1185

https://gerrit.wikimedia.org/r/826424

gerritbot added a comment.Aug 25 2022, 5:48 AM

Change 826425 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Add db1191 to dbctl

https://gerrit.wikimedia.org/r/826425

gerritbot added a comment.Aug 25 2022, 5:49 AM

Change 826425 merged by Marostegui:

[operations/puppet@production] instances.yaml: Add db1191 to dbctl

https://gerrit.wikimedia.org/r/826425

Stashbot added a comment.Aug 25 2022, 5:50 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T05:50:39Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1191 to dbctl T313569', diff saved to https://phabricator.wikimedia.org/P33018 and previous config saved to /var/cache/conftool/dbconfig/20220825-055038-marostegui.json

Stashbot added a comment.Aug 25 2022, 5:50 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-25T05:50:58Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1191 with minimal weight in s7 T313569', diff saved to https://phabricator.wikimedia.org/P33019 and previous config saved to /var/cache/conftool/dbconfig/20220825-055057-root.json

Marostegui added a comment.Aug 25 2022, 6:03 AM

db1185 is now replicating in s5

Marostegui updated the task description. (Show Details)Aug 25 2022, 7:29 AM
Marostegui added a comment.Aug 25 2022, 7:39 AM

db1186, db1188, db1190 and db1191 are being slowly pooled.

gerritbot added a comment.Aug 25 2022, 7:44 AM

Change 826495 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] mariadb: Productionize db1192

https://gerrit.wikimedia.org/r/826495

gerritbot added a comment.Aug 25 2022, 7:45 AM

Change 826495 merged by Marostegui:

[operations/puppet@production] mariadb: Productionize db1192

https://gerrit.wikimedia.org/r/826495

gerritbot added a comment.Aug 25 2022, 8:03 AM

Change 826498 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] mariadb: Productionize db1193

https://gerrit.wikimedia.org/r/826498

gerritbot added a comment.Aug 25 2022, 8:06 AM

Change 826498 merged by Marostegui:

[operations/puppet@production] mariadb: Productionize db1193

https://gerrit.wikimedia.org/r/826498

gerritbot added a comment.Aug 25 2022, 9:23 AM

Change 826514 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] site.pp: Remove db1193 from insetup

https://gerrit.wikimedia.org/r/826514

gerritbot added a comment.Aug 25 2022, 9:24 AM

Change 826514 merged by Marostegui:

[operations/puppet@production] site.pp: Remove db1193 from insetup

https://gerrit.wikimedia.org/r/826514

Marostegui added a comment.Aug 25 2022, 9:27 AM

db1192 and db1193 now replicating in s8

gerritbot added a comment.Aug 25 2022, 9:28 AM

Change 826515 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] install_server: Do not reimage db1192 and db1193

https://gerrit.wikimedia.org/r/826515

gerritbot added a comment.Aug 25 2022, 9:32 AM

Change 826515 merged by Marostegui:

[operations/puppet@production] install_server: Do not reimage db1192 and db1193

https://gerrit.wikimedia.org/r/826515

gerritbot added a comment.Aug 25 2022, 10:02 AM

Change 826524 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] mariadb: Productionize db1194

https://gerrit.wikimedia.org/r/826524

gerritbot added a comment.Aug 25 2022, 10:04 AM

Change 826524 merged by Marostegui:

[operations/puppet@production] mariadb: Productionize db1194

https://gerrit.wikimedia.org/r/826524

gerritbot added a comment.Aug 25 2022, 10:24 AM

Change 826526 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] site.pp: Remove insetup from db1194

https://gerrit.wikimedia.org/r/826526

gerritbot added a comment.Aug 25 2022, 10:26 AM

Change 826526 merged by Marostegui:

[operations/puppet@production] site.pp: Remove insetup from db1194

https://gerrit.wikimedia.org/r/826526

Marostegui added a comment.Aug 25 2022, 12:05 PM

db1194 replicating in s7

gerritbot added a comment.Aug 26 2022, 5:15 AM

Change 826690 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Add db1185 to dbctl

https://gerrit.wikimedia.org/r/826690

gerritbot added a comment.Aug 26 2022, 5:16 AM

Change 826690 merged by Marostegui:

[operations/puppet@production] instances.yaml: Add db1185 to dbctl

https://gerrit.wikimedia.org/r/826690

Stashbot added a comment.Aug 26 2022, 5:17 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-26T05:17:22Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1185 for the first time in s5 T313569', diff saved to https://phabricator.wikimedia.org/P33176 and previous config saved to /var/cache/conftool/dbconfig/20220826-051721-marostegui.json

gerritbot added a comment.Aug 26 2022, 5:18 AM

Change 826691 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db1192: Enable notifications

https://gerrit.wikimedia.org/r/826691

gerritbot added a comment.Aug 26 2022, 5:19 AM

Change 826691 merged by Marostegui:

[operations/puppet@production] db1192: Enable notifications

https://gerrit.wikimedia.org/r/826691

gerritbot added a comment.Aug 26 2022, 5:20 AM

Change 826693 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Add db1192 to dbctl

https://gerrit.wikimedia.org/r/826693

gerritbot added a comment.Aug 26 2022, 5:21 AM

Change 826693 merged by Marostegui:

[operations/puppet@production] instances.yaml: Add db1192 to dbctl

https://gerrit.wikimedia.org/r/826693

Stashbot added a comment.Aug 26 2022, 5:22 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-26T05:22:33Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1192 to dbctl T313569', diff saved to https://phabricator.wikimedia.org/P33178 and previous config saved to /var/cache/conftool/dbconfig/20220826-052233-marostegui.json

gerritbot added a comment.Aug 26 2022, 5:23 AM

Change 826694 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db1193: Enable notifications

https://gerrit.wikimedia.org/r/826694

gerritbot added a comment.Aug 26 2022, 5:24 AM

Change 826694 merged by Marostegui:

[operations/puppet@production] db1193: Enable notifications

https://gerrit.wikimedia.org/r/826694

gerritbot added a comment.Aug 26 2022, 5:25 AM

Change 826695 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Add db1193 to dbctl

https://gerrit.wikimedia.org/r/826695

Marostegui updated the task description. (Show Details)Aug 26 2022, 5:25 AM
gerritbot added a comment.Aug 26 2022, 5:26 AM

Change 826695 merged by Marostegui:

[operations/puppet@production] instances.yaml: Add db1193 to dbctl

https://gerrit.wikimedia.org/r/826695

Stashbot added a comment.Aug 26 2022, 5:27 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-26T05:27:16Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1193 to dbctl T313569', diff saved to https://phabricator.wikimedia.org/P33181 and previous config saved to /var/cache/conftool/dbconfig/20220826-052715-marostegui.json

Marostegui updated the task description. (Show Details)Aug 26 2022, 5:28 AM
Marostegui updated the task description. (Show Details)
gerritbot added a comment.Aug 26 2022, 5:36 AM

Change 826696 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] db1194: Enable notifications

https://gerrit.wikimedia.org/r/826696

gerritbot added a comment.Aug 26 2022, 5:36 AM

Change 826696 merged by Marostegui:

[operations/puppet@production] db1194: Enable notifications

https://gerrit.wikimedia.org/r/826696

gerritbot added a comment.Aug 26 2022, 5:38 AM

Change 826697 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Add db1194 to dbctl

https://gerrit.wikimedia.org/r/826697

gerritbot added a comment.Aug 26 2022, 5:38 AM

Change 826697 merged by Marostegui:

[operations/puppet@production] instances.yaml: Add db1194 to dbctl

https://gerrit.wikimedia.org/r/826697

Stashbot added a comment.Aug 26 2022, 5:39 AM

Mentioned in SAL (#wikimedia-operations) [2022-08-26T05:39:54Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1194 for the first time in s7 T313569', diff saved to https://phabricator.wikimedia.org/P33184 and previous config saved to /var/cache/conftool/dbconfig/20220826-053954-marostegui.json

Marostegui updated the task description. (Show Details)Aug 26 2022, 5:43 AM
Marostegui updated the task description. (Show Details)
Marostegui closed this task as Resolved.Aug 26 2022, 11:12 AM
Marostegui updated the task description. (Show Details)

All hosts in production now.
db1195 is a floating host helping to reboot all the misc masters.

Maintenance_bot moved this task from In progress to Done on the DBA board.Aug 26 2022, 11:15 AM
Marostegui closed subtask T315856: Move db1195 to m1 and switchover m1 master as Resolved.Aug 29 2022, 5:41 AM
Marostegui added a subtask: T316870: Move db1107 to s1.Sep 1 2022, 2:10 PM
Marostegui closed subtask T316870: Move db1107 to s1 as Resolved.Sep 6 2022, 8:45 AM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL