Page MenuHomePhabricator
Create Task
Maniphest T255408

Upgrade dbproxyXXXX to Buster
Closed, ResolvedPublic
Actions

Description

We need to upgrade dbproxyXXXX to Buster.
Buster runs HAProxy 1.8 whereas Stretch runs 1.7

dbproxy1016 is running buster and serving as active proxy, so far so good.
Let's migrate the rest of hosts from Stretch and HAProxy 1.7 to Buster and HAProxy 1.8

DO NOT MIGRATE: dbproxy1003 (to be decommissioned)
DO NOT MIGRATE: dbproxy1008 (to be decommissioned T255406)

  • dbproxy1012
  • dbproxy1013
  • dbproxy1014
  • dbproxy1015
  • dbproxy1016
  • dbproxy1017
  • dbproxy1018
  • dbproxy1019
  • dbproxy1020
  • dbproxy1021
  • dbproxy2001
  • dbproxy2002
  • dbproxy2003
  • dbproxy2004

Details

SubjectRepoBranchLines +/-
wikireplicas_dns: Depool dbproxy1019operations/puppetproduction+8 -8
install_server: Reimage dbproxy1019 to Buster.operations/puppetproduction+1 -2
wikireplica_dns.yaml: Depool dbproxy1018operations/puppetproduction+8 -8
install_server: Reimage dbproxy1018 to Busteroperations/puppetproduction+1 -1
dbproxy1015: Enable notificationsoperations/puppetproduction+0 -1
mariadb: Reimage dbproxy1015 to Busteroperations/puppetproduction+2 -2
wmnet: Change m2-master to dbproxy1013operations/dnsmaster+1 -1
dbproxy1012: Enable notificationsoperations/puppetproduction+0 -1
install_server: Reimage dbproxy1012 as Busteroperations/puppetproduction+2 -2
wmnet: Failover m1 dbproxy; dbproxy1012 to dbproxy1014operations/dnsmaster+1 -1
dbproxy1017: Enable notificationsoperations/puppetproduction+0 -1
install_server: Reimage dbproxy107 to Busteroperations/puppetproduction+1 -2
dbproxy1014: Enable notificationsoperations/puppetproduction+0 -1
install_server: Reimage dbproxy1014 to Busteroperations/puppetproduction+2 -1
install_server: Reimage dbproxy1021 to busteroperations/puppetproduction+1 -2
dbproxy1013: Enable notificationsoperations/puppetproduction+0 -1
dbproxy1013: Reimage to Busteroperations/puppetproduction+2 -2
install_server: Reimage dbproxy1014 to Busteroperations/puppetproduction+1 -2
dbproxy2001: Enable notificationsoperations/puppetproduction+0 -1
dbproxy2001: Disable notificationsoperations/puppetproduction+1 -0
install_server: Do not reimage dbproxy2003, dbproxy2004.operations/puppetproduction+1 -1
install_server: Upgrade dbproxy2* to Busteroperations/puppetproduction+1 -5
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
• Marostegui updated the task description. (Show Details)Jun 15 2020, 12:15 PM
gerritbot added a comment.Jun 15 2020, 12:24 PM

Change 605573 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Do not reimage dbproxy2003, dbproxy2004.

https://gerrit.wikimedia.org/r/605573

gerritbot added a project: Patch-For-Review.Jun 15 2020, 12:24 PM
gerritbot added a comment.Jun 15 2020, 12:50 PM

Change 605573 merged by Marostegui:
[operations/puppet@production] install_server: Do not reimage dbproxy2003, dbproxy2004.

https://gerrit.wikimedia.org/r/605573

Maintenance_bot removed a project: Patch-For-Review.Jun 15 2020, 1:10 PM
ops-monitoring-bot added a comment.Jun 15 2020, 1:25 PM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['dbproxy2002.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202006151325_marostegui_32418.log.

ops-monitoring-bot added a comment.Jun 15 2020, 1:49 PM

Completed auto-reimage of hosts:

['dbproxy2002.codfw.wmnet']

and were ALL successful.

• Marostegui updated the task description. (Show Details)Jun 15 2020, 1:53 PM
• Marostegui moved this task from Pending comment to In progress on the DBA board.Jun 16 2020, 7:17 AM
gerritbot added a comment.Jun 16 2020, 7:58 AM

Change 605826 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] dbproxy2001: Disable notifications

https://gerrit.wikimedia.org/r/605826

gerritbot added a project: Patch-For-Review.Jun 16 2020, 7:58 AM

Change 605826 merged by Marostegui:
[operations/puppet@production] dbproxy2001: Disable notifications

https://gerrit.wikimedia.org/r/605826

Maintenance_bot removed a project: Patch-For-Review.Jun 16 2020, 8:10 AM
ops-monitoring-bot added a comment.Jun 16 2020, 8:28 AM

Script wmf-auto-reimage was launched by marostegui on cumin2001.codfw.wmnet for hosts:

['dbproxy2001.codfw.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202006160828_marostegui_19144.log.

ops-monitoring-bot added a comment.Jun 16 2020, 8:48 AM

Completed auto-reimage of hosts:

['dbproxy2001.codfw.wmnet']

and were ALL successful.

• Marostegui updated the task description. (Show Details)Jun 16 2020, 8:52 AM
gerritbot added a comment.Jun 16 2020, 8:54 AM

Change 605845 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] dbproxy2001: Enable notifications

https://gerrit.wikimedia.org/r/605845

gerritbot added a project: Patch-For-Review.Jun 16 2020, 8:54 AM

Change 605845 merged by Marostegui:
[operations/puppet@production] dbproxy2001: Enable notifications

https://gerrit.wikimedia.org/r/605845

gerritbot added a comment.Jun 16 2020, 9:02 AM

Change 605847 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Reimage dbproxy1014 to Buster

https://gerrit.wikimedia.org/r/605847

gerritbot added a comment.Jun 16 2020, 9:24 AM

Change 605847 merged by Marostegui:
[operations/puppet@production] install_server: Reimage dbproxy1014 to Buster

https://gerrit.wikimedia.org/r/605847

Maintenance_bot removed a project: Patch-For-Review.Jun 16 2020, 10:10 AM
gerritbot added a comment.Jun 17 2020, 5:02 AM

Change 606067 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] dbproxy1013: Reimage to Buster

https://gerrit.wikimedia.org/r/606067

gerritbot added a project: Patch-For-Review.Jun 17 2020, 5:02 AM

Change 606067 merged by Marostegui:
[operations/puppet@production] dbproxy1013: Reimage to Buster

https://gerrit.wikimedia.org/r/606067

Maintenance_bot removed a project: Patch-For-Review.Jun 17 2020, 5:10 AM
ops-monitoring-bot added a comment.Jun 17 2020, 8:35 AM

Script wmf-auto-reimage was launched by marostegui on cumin2001.codfw.wmnet for hosts:

['dbproxy1013.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202006170835_marostegui_17922.log.

ops-monitoring-bot added a comment.Jun 17 2020, 8:56 AM

Completed auto-reimage of hosts:

['dbproxy1013.eqiad.wmnet']

and were ALL successful.

• Marostegui updated the task description. (Show Details)Jun 17 2020, 9:11 AM
gerritbot added a comment.Jun 17 2020, 9:11 AM

Change 606134 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] dbproxy1013: Enable notifications

https://gerrit.wikimedia.org/r/606134

gerritbot added a project: Patch-For-Review.Jun 17 2020, 9:11 AM

Change 606134 merged by Marostegui:
[operations/puppet@production] dbproxy1013: Enable notifications

https://gerrit.wikimedia.org/r/606134

Maintenance_bot removed a project: Patch-For-Review.Jun 17 2020, 10:10 AM
gerritbot added a comment.Jun 24 2020, 7:30 AM

Change 607436 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Reimage dbproxy1021 to buster

https://gerrit.wikimedia.org/r/607436

gerritbot added a project: Patch-For-Review.Jun 24 2020, 7:30 AM

Change 607436 merged by Marostegui:
[operations/puppet@production] install_server: Reimage dbproxy1021 to buster

https://gerrit.wikimedia.org/r/607436

ops-monitoring-bot added a comment.Jun 24 2020, 7:33 AM

Script wmf-auto-reimage was launched by marostegui on cumin2001.codfw.wmnet for hosts:

['dbproxy1021.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202006240733_marostegui_23970.log.

• Marostegui updated the task description. (Show Details)Jun 24 2020, 7:33 AM
ops-monitoring-bot added a comment.Jun 24 2020, 7:51 AM

Script wmf-auto-reimage was launched by marostegui on cumin2001.codfw.wmnet for hosts:

['dbproxy1021.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202006240751_marostegui_26654.log.

Maintenance_bot removed a project: Patch-For-Review.Jun 24 2020, 8:10 AM
ops-monitoring-bot added a comment.Jun 24 2020, 8:11 AM

Completed auto-reimage of hosts:

['dbproxy1021.eqiad.wmnet']

and were ALL successful.

• Marostegui updated the task description. (Show Details)Jun 24 2020, 8:11 AM
gerritbot added a comment.Jun 26 2020, 4:45 AM

Change 607927 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Reimage dbproxy1014 to Buster

https://gerrit.wikimedia.org/r/607927

gerritbot added a project: Patch-For-Review.Jun 26 2020, 4:45 AM

Change 607927 merged by Marostegui:
[operations/puppet@production] install_server: Reimage dbproxy1014 to Buster

https://gerrit.wikimedia.org/r/607927

ops-monitoring-bot added a comment.Jun 26 2020, 4:50 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['dbproxy1014.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202006260449_marostegui_27706.log.

Maintenance_bot removed a project: Patch-For-Review.Jun 26 2020, 5:10 AM
ops-monitoring-bot added a comment.Jun 26 2020, 5:10 AM

Completed auto-reimage of hosts:

['dbproxy1014.eqiad.wmnet']

and were ALL successful.

gerritbot added a comment.Jun 26 2020, 5:12 AM

Change 607928 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] dbproxy1014: Enable notifications

https://gerrit.wikimedia.org/r/607928

gerritbot added a project: Patch-For-Review.Jun 26 2020, 5:12 AM

Change 607928 merged by Marostegui:
[operations/puppet@production] dbproxy1014: Enable notifications

https://gerrit.wikimedia.org/r/607928

• Marostegui updated the task description. (Show Details)Jun 26 2020, 5:17 AM
Maintenance_bot removed a project: Patch-For-Review.Jun 26 2020, 6:10 AM
gerritbot added a comment.Jul 9 2020, 8:42 AM

Change 610712 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Reimage dbproxy107 to Buster

https://gerrit.wikimedia.org/r/610712

gerritbot added a project: Patch-For-Review.Jul 9 2020, 8:42 AM
Stashbot added a comment.Jul 9 2020, 8:44 AM

Mentioned in SAL (#wikimedia-operations) [2020-07-09T08:44:18Z] <marostegui> Stop haproxy on dbproxy1017 before upgrading to buster - T255408

gerritbot added a comment.Jul 9 2020, 9:13 AM

Change 610712 merged by Marostegui:
[operations/puppet@production] install_server: Reimage dbproxy107 to Buster

https://gerrit.wikimedia.org/r/610712

ops-monitoring-bot added a comment.Jul 9 2020, 9:18 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['dbproxy1017.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202007090917_marostegui_5135.log.

• Marostegui updated the task description. (Show Details)Jul 9 2020, 9:38 AM
ops-monitoring-bot added a comment.Jul 9 2020, 9:38 AM

Completed auto-reimage of hosts:

['dbproxy1017.eqiad.wmnet']

and were ALL successful.

gerritbot added a comment.Jul 10 2020, 4:42 AM

Change 611067 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] dbproxy1017: Enable notifications

https://gerrit.wikimedia.org/r/611067

gerritbot added a comment.Jul 10 2020, 4:45 AM

Change 611067 merged by Marostegui:
[operations/puppet@production] dbproxy1017: Enable notifications

https://gerrit.wikimedia.org/r/611067

gerritbot added a comment.Jul 20 2020, 6:57 AM

Change 614606 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/dns@master] wmnet: Failover m1 dbproxy; dbproxy1012 to dbproxy1014

https://gerrit.wikimedia.org/r/614606

gerritbot added a comment.Jul 20 2020, 7:29 AM

Change 614606 merged by Marostegui:
[operations/dns@master] wmnet: Failover m1 dbproxy; dbproxy1012 to dbproxy1014

https://gerrit.wikimedia.org/r/614606

Stashbot added a comment.Jul 20 2020, 7:29 AM

Mentioned in SAL (#wikimedia-operations) [2020-07-20T07:29:54Z] <marostegui> Move m1-master from dbproxy1012 to dbproxy1014 - T255408

gerritbot added a comment.Jul 21 2020, 11:40 AM

Change 615184 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Reimage dbproxy1012 as Buster

https://gerrit.wikimedia.org/r/615184

gerritbot added a comment.Jul 21 2020, 11:41 AM

Change 615184 merged by Marostegui:
[operations/puppet@production] install_server: Reimage dbproxy1012 as Buster

https://gerrit.wikimedia.org/r/615184

Stashbot added a comment.Jul 21 2020, 12:54 PM

Mentioned in SAL (#wikimedia-operations) [2020-07-21T12:54:41Z] <marostegui> Stop haproxy on dbproxy1012 - T255408

ops-monitoring-bot added a comment.Jul 21 2020, 12:57 PM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['dbproxy1012.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202007211257_marostegui_32663.log.

ops-monitoring-bot added a comment.Jul 21 2020, 1:18 PM

Completed auto-reimage of hosts:

['dbproxy1012.eqiad.wmnet']

and were ALL successful.

gerritbot added a comment.Jul 22 2020, 5:11 AM

Change 615324 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] dbproxy1012: Enable notifications

https://gerrit.wikimedia.org/r/615324

gerritbot added a comment.Jul 22 2020, 5:12 AM

Change 615324 merged by Marostegui:
[operations/puppet@production] dbproxy1012: Enable notifications

https://gerrit.wikimedia.org/r/615324

• Marostegui updated the task description. (Show Details)Jul 22 2020, 5:12 AM
gerritbot added a comment.Jul 27 2020, 5:19 AM

Change 616341 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/dns@master] wmnet: Change m2-master to dbproxy1013

https://gerrit.wikimedia.org/r/616341

gerritbot added a comment.Jul 27 2020, 8:27 AM

Change 616341 merged by Marostegui:
[operations/dns@master] wmnet: Change m2-master to dbproxy1013

https://gerrit.wikimedia.org/r/616341

gerritbot added a comment.Jul 28 2020, 7:13 AM

Change 616703 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] mariadb: Reimage dbproxy1015 to Buster

https://gerrit.wikimedia.org/r/616703

gerritbot added a comment.Jul 28 2020, 7:14 AM

Change 616703 merged by Marostegui:
[operations/puppet@production] mariadb: Reimage dbproxy1015 to Buster

https://gerrit.wikimedia.org/r/616703

ops-monitoring-bot added a comment.Jul 28 2020, 7:18 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['dbproxy1015.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202007280718_marostegui_9296.log.

ops-monitoring-bot added a comment.Jul 28 2020, 7:39 AM

Completed auto-reimage of hosts:

['dbproxy1015.eqiad.wmnet']

and were ALL successful.

gerritbot added a comment.Jul 28 2020, 7:42 AM

Change 616708 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] dbproxy1015: Enable notifications

https://gerrit.wikimedia.org/r/616708

gerritbot added a comment.Jul 28 2020, 7:47 AM

Change 616708 merged by Marostegui:
[operations/puppet@production] dbproxy1015: Enable notifications

https://gerrit.wikimedia.org/r/616708

• Marostegui updated the task description. (Show Details)Jul 28 2020, 7:47 AM
gerritbot added a comment.Aug 4 2020, 12:50 PM

Change 618283 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] wikireplica_dns.yaml: Depool dbproxy1018

https://gerrit.wikimedia.org/r/618283

gerritbot added a comment.Aug 5 2020, 6:40 AM

Change 618283 merged by Marostegui:
[operations/puppet@production] wikireplica_dns.yaml: Depool dbproxy1018

https://gerrit.wikimedia.org/r/618283

gerritbot added a comment.Aug 6 2020, 6:02 AM

Change 618659 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Reimage dbproxy1018 to Buster

https://gerrit.wikimedia.org/r/618659

gerritbot added a comment.Aug 6 2020, 6:03 AM

Change 618659 merged by Marostegui:
[operations/puppet@production] install_server: Reimage dbproxy1018 to Buster

https://gerrit.wikimedia.org/r/618659

ops-monitoring-bot added a comment.Aug 6 2020, 6:07 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['dbproxy1018.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202008060607_marostegui_15685.log.

ops-monitoring-bot added a comment.Aug 6 2020, 6:43 AM

Completed auto-reimage of hosts:

['dbproxy1018.eqiad.wmnet']

and were ALL successful.

• Marostegui updated the task description. (Show Details)Aug 6 2020, 6:47 AM
gerritbot added a comment.Aug 7 2020, 1:41 PM

Change 618986 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] wikireplicas_dns: Depool dbproxy1019

https://gerrit.wikimedia.org/r/618986

gerritbot added a comment.Aug 10 2020, 4:46 AM

Change 618986 merged by Marostegui:
[operations/puppet@production] wikireplicas_dns: Depool dbproxy1019

https://gerrit.wikimedia.org/r/618986

Stashbot added a comment.Aug 10 2020, 4:46 AM

Mentioned in SAL (#wikimedia-operations) [2020-08-10T04:46:39Z] <marostegui> Depool dbproxy1019 for reimage T255408

gerritbot added a comment.Aug 10 2020, 5:01 AM

Change 619172 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Reimage dbproxy1019 to Buster.

https://gerrit.wikimedia.org/r/619172

gerritbot added a comment.Aug 10 2020, 5:02 AM

Change 619172 merged by Marostegui:
[operations/puppet@production] install_server: Reimage dbproxy1019 to Buster.

https://gerrit.wikimedia.org/r/619172

ops-monitoring-bot added a comment.Aug 10 2020, 8:08 AM

Script wmf-auto-reimage was launched by marostegui on cumin1001.eqiad.wmnet for hosts:

['dbproxy1019.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202008100808_marostegui_24573.log.

ops-monitoring-bot added a comment.Aug 10 2020, 8:44 AM

Completed auto-reimage of hosts:

['dbproxy1019.eqiad.wmnet']

and were ALL successful.

Stashbot added a comment.Aug 10 2020, 9:21 AM

Mentioned in SAL (#wikimedia-operations) [2020-08-10T09:21:36Z] <marostegui> Promote dbproxy1019 back T255408

• Marostegui closed this task as Resolved.Aug 10 2020, 9:27 AM
• Marostegui updated the task description. (Show Details)

All dbproxies upgraded to Buster and HAproxy 1.8.19-1

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL