Page MenuHomePhabricator
Create Task
Maniphest T245984

Upgrade load balancers to buster
Closed, ResolvedPublic
Actions

Description

Upgrade our LVS instances to buster:

  • eqiad
    • lvs1013
    • lvs1014
    • lvs1015
    • lvs1016
  • codfw
  • esams
    • lvs3005
    • lvs3006
    • lvs3007
  • ulsfo
    • lvs4005
    • lvs4006
    • lvs4007
  • eqsin
    • lvs5001
    • lvs5002
    • lvs5003

Details

ProjectBranchLines +/-Subject
operations/puppetproduction+0 -1lvs: Re-enable BGP in lvs1013
operations/puppetproduction+1 -1install_server,lvs: Reimage lvs1013 with buster
operations/puppetproduction+0 -1lvs: Re-enable BGP in lvs1014
operations/puppetproduction+1 -1install_server,lvs: Reimage lvs1014 with buster
operations/puppetproduction+0 -1lvs: Re-enable BGP in lvs1015
operations/puppetproduction+1 -1install_server,lvs: Reimage lvs1015 with buster
operations/puppetproduction+0 -1install_server: Reimage lvs1016 with buster
operations/puppetproduction+0 -1lvs: Re-enable BGP in lvs3005
operations/puppetproduction+0 -1install_server: Reimage lvs3005 with buster
operations/puppetproduction+3 -2install_server,lvs: Reimage lvs3005 with buster
operations/puppetproduction+0 -1lvs: Re-enable BGP in lvs3006
operations/puppetproduction+3 -3install_server,lvs: Reimage lvs3006 with buster
operations/puppetproduction+2 -2lvs: rename lvs3007 NIC interfaces
operations/puppetproduction+0 -1install_server: Reimage lvs3007 with buster
operations/puppetproduction+0 -1lvs: Re-enable BGP in lvs5001
operations/puppetproduction+1 -1install_server,lvs: Reimage lvs5001 with buster
operations/puppetproduction+0 -1lvs: Re-enable BGP in lvs5002
operations/puppetproduction+1 -1install_server,lvs: Reimage lvs5002 with buster
operations/puppetproduction+0 -1install_server: Reimage lvs5003 with buster
operations/puppetproduction+0 -1lvs: Re-enable BGP in lvs4005
operations/puppetproduction+1 -1install_server,lvs: Reimage lvs4005 with buster
operations/puppetproduction+0 -1lvs: Re-enable BGP in lvs4006
operations/puppetproduction+1 -1install_server,lvs: Reimage lvs4006 with buster
operations/puppetproduction+0 -1install_server: Reimage lvs4007 with buster
operations/puppetproduction+1 -2lvs: Replace lvs2003 with lvs2009
operations/puppetproduction+1 -1lvs: Replace lvs2006 with lvs2010
operations/puppetproduction+0 -1lvs: Enable BGP in lvs2009
operations/puppetproduction+32 -9lvs: Set up lvs2009 as a low-traffic LVS
operations/puppetproduction+1 -0lvs: Set BGP peers for lvs2010
operations/puppetproduction+6 -4lvs: Set lvs2010 as a secondary LVS
operations/puppetproduction+5 -5pybal: Allow overriding BGP med
operations/puppetproduction+4 -4lvs: Set txqlen for the proper ifaces on lvs2010
operations/puppetproduction+7 -7lvs: Rename ifaces for lvs2010
operations/puppetproduction+0 -1install_server: Reimage lvs2010 as buster
operations/puppetproduction+0 -1install_server: Reimage pybal-test2001 as buster
operations/debs/pybal1.15-stretch+6 -0Release 1.15.8
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
gerritbot added a comment.Mar 2 2020, 11:48 AM

Change 575997 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs5002

https://gerrit.wikimedia.org/r/575997

Stashbot added a comment.Mar 2 2020, 11:54 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-02T11:54:05Z] <vgutierrez> enable BGP in lvs5002 - T245984

Vgutierrez updated the task description. (Show Details)Mar 2 2020, 11:54 AM
Maintenance_bot removed a project: Patch-For-Review.Mar 2 2020, 12:10 PM
gerritbot added a comment.Mar 2 2020, 1:33 PM

Change 576031 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server,lvs: Reimage lvs5001 with buster

https://gerrit.wikimedia.org/r/576031

gerritbot added a project: Patch-For-Review.Mar 2 2020, 1:33 PM
gerritbot added a comment.Mar 2 2020, 1:38 PM

Change 576031 merged by Vgutierrez:
[operations/puppet@production] install_server,lvs: Reimage lvs5001 with buster

https://gerrit.wikimedia.org/r/576031

Stashbot added a comment.Mar 2 2020, 1:48 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-02T13:48:15Z] <vgutierrez> reimage lvs5001 with buster - T245984

ops-monitoring-bot added a comment.Mar 2 2020, 1:48 PM

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs5001.eqsin.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003021347_vgutierrez_47826_lvs5001_eqsin_wmnet.log.

Maintenance_bot removed a project: Patch-For-Review.Mar 2 2020, 2:10 PM
ops-monitoring-bot added a comment.Mar 2 2020, 2:30 PM

Completed auto-reimage of hosts:

['lvs5001.eqsin.wmnet']

and were ALL successful.

gerritbot added a comment.Mar 2 2020, 2:38 PM

Change 576047 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: Re-enable BGP in lvs5001

https://gerrit.wikimedia.org/r/576047

gerritbot added a project: Patch-For-Review.Mar 2 2020, 2:38 PM

Change 576047 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs5001

https://gerrit.wikimedia.org/r/576047

Stashbot added a comment.Mar 2 2020, 2:42 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-02T14:42:43Z] <vgutierrez> Re-enable BGP in lvs5001 - T245984

Vgutierrez updated the task description. (Show Details)Mar 2 2020, 2:44 PM
gerritbot added a comment.Mar 2 2020, 2:50 PM

Change 576052 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server: Reimage lvs3007 with buster

https://gerrit.wikimedia.org/r/576052

gerritbot added a comment.Mar 2 2020, 2:53 PM

Change 576052 merged by Vgutierrez:
[operations/puppet@production] install_server: Reimage lvs3007 with buster

https://gerrit.wikimedia.org/r/576052

Stashbot added a comment.Mar 2 2020, 3:30 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-02T15:30:42Z] <vgutierrez> reimage lvs3007 with buster - T245984

ops-monitoring-bot added a comment.Mar 2 2020, 3:30 PM

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs3007.esams.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003021530_vgutierrez_66801_lvs3007_esams_wmnet.log.

Vgutierrez updated the task description. (Show Details)Mar 2 2020, 3:36 PM
ops-monitoring-bot added a comment.Mar 2 2020, 3:54 PM

Completed auto-reimage of hosts:

['lvs3007.esams.wmnet']

Of which those FAILED:

['lvs3007.esams.wmnet']
gerritbot added a comment.Mar 2 2020, 4:07 PM

Change 576075 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: rename lvs3007 NIC interfaces

https://gerrit.wikimedia.org/r/576075

gerritbot added a comment.Mar 2 2020, 4:21 PM

Change 576075 merged by Vgutierrez:
[operations/puppet@production] lvs: rename lvs3007 NIC interfaces

https://gerrit.wikimedia.org/r/576075

Vgutierrez updated the task description. (Show Details)Mar 2 2020, 5:03 PM
Maintenance_bot removed a project: Patch-For-Review.Mar 2 2020, 5:11 PM
gerritbot added a comment.Mar 3 2020, 6:42 AM

Change 576191 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server,lvs: Reimage lvs3006 with buster

https://gerrit.wikimedia.org/r/576191

gerritbot added a project: Patch-For-Review.Mar 3 2020, 6:42 AM
gerritbot added a comment.Mar 3 2020, 6:47 AM

Change 576191 merged by Vgutierrez:
[operations/puppet@production] install_server,lvs: Reimage lvs3006 with buster

https://gerrit.wikimedia.org/r/576191

Stashbot added a comment.Mar 3 2020, 6:51 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-03T06:51:34Z] <vgutierrez> reimage lvs3006 with buster - T245984

ops-monitoring-bot added a comment.Mar 3 2020, 6:52 AM

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs3006.esams.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003030650_vgutierrez_234717_lvs3006_esams_wmnet.log.

Maintenance_bot removed a project: Patch-For-Review.Mar 3 2020, 7:10 AM
ops-monitoring-bot added a comment.Mar 3 2020, 7:29 AM

Completed auto-reimage of hosts:

['lvs3006.esams.wmnet']

and were ALL successful.

gerritbot added a comment.Mar 3 2020, 7:31 AM

Change 576265 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: Re-enable BGP in lvs3006

https://gerrit.wikimedia.org/r/576265

gerritbot added a project: Patch-For-Review.Mar 3 2020, 7:31 AM

Change 576265 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs3006

https://gerrit.wikimedia.org/r/576265

Stashbot added a comment.Mar 3 2020, 7:41 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-03T07:41:07Z] <vgutierrez> Re-enable BGP in lvs3006 - T245984

Maintenance_bot removed a project: Patch-For-Review.Mar 3 2020, 8:10 AM
gerritbot added a comment.Mar 3 2020, 9:30 AM

Change 576283 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server,lvs: Reimage lvs3005 with buster

https://gerrit.wikimedia.org/r/576283

gerritbot added a project: Patch-For-Review.Mar 3 2020, 9:30 AM
gerritbot added a comment.Mar 3 2020, 9:39 AM

Change 576283 merged by Vgutierrez:
[operations/puppet@production] install_server,lvs: Reimage lvs3005 with buster

https://gerrit.wikimedia.org/r/576283

Stashbot added a comment.Mar 3 2020, 9:43 AM

Mentioned in SAL (#wikimedia-operations) [2020-03-03T09:43:10Z] <vgutierrez> reimage lvs3005 with buster - T245984

ops-monitoring-bot added a comment.Mar 3 2020, 9:43 AM

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs3005.esams.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003030942_vgutierrez_6188_lvs3005_esams_wmnet.log.

ops-monitoring-bot added a comment.Mar 3 2020, 10:02 AM

Completed auto-reimage of hosts:

['lvs3005.esams.wmnet']

Of which those FAILED:

['lvs3005.esams.wmnet']
Maintenance_bot removed a project: Patch-For-Review.Mar 3 2020, 10:10 AM
gerritbot added a comment.Mar 3 2020, 10:28 AM

Change 576294 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server: Reimage lvs3005 with buster

https://gerrit.wikimedia.org/r/576294

gerritbot added a project: Patch-For-Review.Mar 3 2020, 10:28 AM
gerritbot added a comment.Mar 3 2020, 10:30 AM

Change 576294 merged by Vgutierrez:
[operations/puppet@production] install_server: Reimage lvs3005 with buster

https://gerrit.wikimedia.org/r/576294

ops-monitoring-bot added a comment.Mar 3 2020, 10:34 AM

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs3005.esams.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003031034_vgutierrez_14407_lvs3005_esams_wmnet.log.

Maintenance_bot removed a project: Patch-For-Review.Mar 3 2020, 11:10 AM
ops-monitoring-bot added a comment.Mar 3 2020, 11:12 AM

Completed auto-reimage of hosts:

['lvs3005.esams.wmnet']

and were ALL successful.

gerritbot added a comment.Mar 3 2020, 1:30 PM

Change 576332 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: Re-enable BGP in lvs3005

https://gerrit.wikimedia.org/r/576332

gerritbot added a project: Patch-For-Review.Mar 3 2020, 1:30 PM

Change 576332 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs3005

https://gerrit.wikimedia.org/r/576332

Stashbot added a comment.Mar 3 2020, 1:34 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-03T13:34:46Z] <vgutierrez> Re-enable BGP in lvs3005 - T245984

Vgutierrez updated the task description. (Show Details)Mar 3 2020, 1:37 PM
gerritbot added a comment.Mar 3 2020, 1:45 PM

Change 576336 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server: Reimage lvs1016 with buster

https://gerrit.wikimedia.org/r/576336

gerritbot added a comment.Mar 3 2020, 1:48 PM

Change 576336 merged by Vgutierrez:
[operations/puppet@production] install_server: Reimage lvs1016 with buster

https://gerrit.wikimedia.org/r/576336

Stashbot added a comment.Mar 3 2020, 1:54 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-03T13:54:07Z] <vgutierrez> reimage lvs1016 with buster - T245984

ops-monitoring-bot added a comment.Mar 3 2020, 1:54 PM

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs1016.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003031353_vgutierrez_56595_lvs1016_eqiad_wmnet.log.

Maintenance_bot removed a project: Patch-For-Review.Mar 3 2020, 2:10 PM
ops-monitoring-bot added a comment.Mar 3 2020, 2:14 PM

Completed auto-reimage of hosts:

['lvs1016.eqiad.wmnet']

and were ALL successful.

Vgutierrez updated the task description. (Show Details)Mar 3 2020, 2:51 PM
gerritbot added a comment.Mar 3 2020, 2:54 PM

Change 576358 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server,lvs: Reimage lvs1015 with buster

https://gerrit.wikimedia.org/r/576358

gerritbot added a project: Patch-For-Review.Mar 3 2020, 2:54 PM
gerritbot added a comment.Mar 3 2020, 2:57 PM

Change 576358 merged by Vgutierrez:
[operations/puppet@production] install_server,lvs: Reimage lvs1015 with buster

https://gerrit.wikimedia.org/r/576358

Stashbot added a comment.Mar 3 2020, 3:00 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-03T15:00:57Z] <vgutierrez> reimage lvs1015 with buster - T245984

ops-monitoring-bot added a comment.Mar 3 2020, 3:01 PM

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs1015.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003031501_vgutierrez_71068_lvs1015_eqiad_wmnet.log.

Maintenance_bot removed a project: Patch-For-Review.Mar 3 2020, 3:11 PM
ops-monitoring-bot added a comment.Mar 3 2020, 3:19 PM

Completed auto-reimage of hosts:

['lvs1015.eqiad.wmnet']

and were ALL successful.

gerritbot added a comment.Mar 3 2020, 3:23 PM

Change 576369 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: Re-enable BGP in lvs1015

https://gerrit.wikimedia.org/r/576369

gerritbot added a project: Patch-For-Review.Mar 3 2020, 3:23 PM
gerritbot added a comment.Mar 3 2020, 3:29 PM

Change 576369 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs1015

https://gerrit.wikimedia.org/r/576369

Stashbot added a comment.Mar 3 2020, 3:31 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-03T15:31:20Z] <vgutierrez> Re-enable BGP in lvs1015 - T245984

gerritbot added a comment.Mar 3 2020, 3:33 PM

Change 576371 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server,lvs: Reimage lvs1014 with buster

https://gerrit.wikimedia.org/r/576371

gerritbot added a comment.Mar 3 2020, 3:42 PM

Change 576371 merged by Vgutierrez:
[operations/puppet@production] install_server,lvs: Reimage lvs1014 with buster

https://gerrit.wikimedia.org/r/576371

Stashbot added a comment.Mar 3 2020, 3:44 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-03T15:44:58Z] <vgutierrez> reimage lvs1014 with buster - T245984

ops-monitoring-bot added a comment.Mar 3 2020, 3:45 PM

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs1014.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003031544_vgutierrez_80625_lvs1014_eqiad_wmnet.log.

ops-monitoring-bot added a comment.Mar 3 2020, 4:04 PM

Completed auto-reimage of hosts:

['lvs1014.eqiad.wmnet']

and were ALL successful.

gerritbot added a comment.Mar 3 2020, 4:08 PM

Change 576379 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: Re-enable BGP in lvs1014

https://gerrit.wikimedia.org/r/576379

gerritbot added a comment.Mar 3 2020, 4:10 PM

Change 576379 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs1014

https://gerrit.wikimedia.org/r/576379

Stashbot added a comment.Mar 3 2020, 4:13 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-03T16:13:02Z] <vgutierrez> Re-enable BGP in lvs1014 - T245984

Vgutierrez updated the task description. (Show Details)Mar 3 2020, 4:13 PM
gerritbot added a comment.Mar 3 2020, 4:15 PM

Change 576381 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server,lvs: Reimage lvs1013 with buster

https://gerrit.wikimedia.org/r/576381

gerritbot added a comment.Mar 3 2020, 4:21 PM

Change 576381 merged by Vgutierrez:
[operations/puppet@production] install_server,lvs: Reimage lvs1013 with buster

https://gerrit.wikimedia.org/r/576381

Stashbot added a comment.Mar 3 2020, 4:32 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-03T16:32:27Z] <vgutierrez> reimage lvs1013 with buster - T245984

ops-monitoring-bot added a comment.Mar 3 2020, 4:32 PM

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs1013.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003031632_vgutierrez_89619_lvs1013_eqiad_wmnet.log.

ops-monitoring-bot added a comment.Mar 3 2020, 4:52 PM

Completed auto-reimage of hosts:

['lvs1013.eqiad.wmnet']

and were ALL successful.

gerritbot added a comment.Mar 3 2020, 4:55 PM

Change 576388 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: Re-enable BGP in lvs1013

https://gerrit.wikimedia.org/r/576388

gerritbot added a comment.Mar 3 2020, 4:56 PM

Change 576388 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs1013

https://gerrit.wikimedia.org/r/576388

Stashbot added a comment.Mar 3 2020, 4:58 PM

Mentioned in SAL (#wikimedia-operations) [2020-03-03T16:58:37Z] <vgutierrez> Re-enable BGP in lvs1013 - T245984

Vgutierrez closed this task as Resolved.Mar 3 2020, 4:59 PM
Vgutierrez claimed this task.
Vgutierrez removed a project: Patch-For-Review.
Vgutierrez updated the task description. (Show Details)
• ema mentioned this in T297187: Upgrade pybal-test200[23] from Stretch to Buster.Dec 7 2021, 10:12 AM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL