Page MenuHomePhabricator

Upgrade load balancers to buster
Closed, ResolvedPublic

Description

Upgrade our LVS instances to buster:

  • eqiad
    • lvs1013
    • lvs1014
    • lvs1015
    • lvs1016
  • codfw
  • esams
    • lvs3005
    • lvs3006
    • lvs3007
  • ulsfo
    • lvs4005
    • lvs4006
    • lvs4007
  • eqsin
    • lvs5001
    • lvs5002
    • lvs5003

Details

Related Gerrit Patches:
operations/puppet : productionlvs: Re-enable BGP in lvs1013
operations/puppet : productioninstall_server,lvs: Reimage lvs1013 with buster
operations/puppet : productionlvs: Re-enable BGP in lvs1014
operations/puppet : productioninstall_server,lvs: Reimage lvs1014 with buster
operations/puppet : productionlvs: Re-enable BGP in lvs1015
operations/puppet : productioninstall_server,lvs: Reimage lvs1015 with buster
operations/puppet : productioninstall_server: Reimage lvs1016 with buster
operations/puppet : productionlvs: Re-enable BGP in lvs3005
operations/puppet : productioninstall_server: Reimage lvs3005 with buster
operations/puppet : productioninstall_server,lvs: Reimage lvs3005 with buster
operations/puppet : productionlvs: Re-enable BGP in lvs3006
operations/puppet : productioninstall_server,lvs: Reimage lvs3006 with buster
operations/puppet : productionlvs: rename lvs3007 NIC interfaces
operations/puppet : productioninstall_server: Reimage lvs3007 with buster
operations/puppet : productionlvs: Re-enable BGP in lvs5001
operations/puppet : productioninstall_server,lvs: Reimage lvs5001 with buster
operations/puppet : productionlvs: Re-enable BGP in lvs5002
operations/puppet : productioninstall_server,lvs: Reimage lvs5002 with buster
operations/puppet : productioninstall_server: Reimage lvs5003 with buster
operations/puppet : productionlvs: Re-enable BGP in lvs4005
operations/puppet : productioninstall_server,lvs: Reimage lvs4005 with buster
operations/puppet : productionlvs: Re-enable BGP in lvs4006
operations/puppet : productioninstall_server,lvs: Reimage lvs4006 with buster
operations/puppet : productioninstall_server: Reimage lvs4007 with buster
operations/puppet : productionlvs: Replace lvs2003 with lvs2009
operations/puppet : productionlvs: Replace lvs2006 with lvs2010
operations/puppet : productionlvs: Enable BGP in lvs2009
operations/puppet : productionlvs: Set up lvs2009 as a low-traffic LVS
operations/puppet : productionlvs: Set BGP peers for lvs2010
operations/puppet : productionlvs: Set lvs2010 as a secondary LVS
operations/puppet : productionpybal: Allow overriding BGP med
operations/puppet : productionlvs: Set txqlen for the proper ifaces on lvs2010
operations/puppet : productionlvs: Rename ifaces for lvs2010
operations/puppet : productioninstall_server: Reimage lvs2010 as buster
operations/puppet : productioninstall_server: Reimage pybal-test2001 as buster
operations/debs/pybal : 1.15-stretchRelease 1.15.8

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Change 575997 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: Re-enable BGP in lvs5002

https://gerrit.wikimedia.org/r/575997

Change 575997 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs5002

https://gerrit.wikimedia.org/r/575997

Mentioned in SAL (#wikimedia-operations) [2020-03-02T11:54:05Z] <vgutierrez> enable BGP in lvs5002 - T245984

Vgutierrez updated the task description. (Show Details)Mon, Mar 2, 11:54 AM

Change 576031 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server,lvs: Reimage lvs5001 with buster

https://gerrit.wikimedia.org/r/576031

Change 576031 merged by Vgutierrez:
[operations/puppet@production] install_server,lvs: Reimage lvs5001 with buster

https://gerrit.wikimedia.org/r/576031

Mentioned in SAL (#wikimedia-operations) [2020-03-02T13:48:15Z] <vgutierrez> reimage lvs5001 with buster - T245984

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs5001.eqsin.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003021347_vgutierrez_47826_lvs5001_eqsin_wmnet.log.

Completed auto-reimage of hosts:

['lvs5001.eqsin.wmnet']

and were ALL successful.

Change 576047 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: Re-enable BGP in lvs5001

https://gerrit.wikimedia.org/r/576047

Change 576047 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs5001

https://gerrit.wikimedia.org/r/576047

Mentioned in SAL (#wikimedia-operations) [2020-03-02T14:42:43Z] <vgutierrez> Re-enable BGP in lvs5001 - T245984

Vgutierrez updated the task description. (Show Details)Mon, Mar 2, 2:44 PM

Change 576052 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server: Reimage lvs3007 with buster

https://gerrit.wikimedia.org/r/576052

Change 576052 merged by Vgutierrez:
[operations/puppet@production] install_server: Reimage lvs3007 with buster

https://gerrit.wikimedia.org/r/576052

Mentioned in SAL (#wikimedia-operations) [2020-03-02T15:30:42Z] <vgutierrez> reimage lvs3007 with buster - T245984

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs3007.esams.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003021530_vgutierrez_66801_lvs3007_esams_wmnet.log.

Vgutierrez updated the task description. (Show Details)Mon, Mar 2, 3:36 PM

Completed auto-reimage of hosts:

['lvs3007.esams.wmnet']

Of which those FAILED:

['lvs3007.esams.wmnet']

Change 576075 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: rename lvs3007 NIC interfaces

https://gerrit.wikimedia.org/r/576075

Change 576075 merged by Vgutierrez:
[operations/puppet@production] lvs: rename lvs3007 NIC interfaces

https://gerrit.wikimedia.org/r/576075

Vgutierrez updated the task description. (Show Details)Mon, Mar 2, 5:03 PM

Change 576191 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server,lvs: Reimage lvs3006 with buster

https://gerrit.wikimedia.org/r/576191

Change 576191 merged by Vgutierrez:
[operations/puppet@production] install_server,lvs: Reimage lvs3006 with buster

https://gerrit.wikimedia.org/r/576191

Mentioned in SAL (#wikimedia-operations) [2020-03-03T06:51:34Z] <vgutierrez> reimage lvs3006 with buster - T245984

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs3006.esams.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003030650_vgutierrez_234717_lvs3006_esams_wmnet.log.

Completed auto-reimage of hosts:

['lvs3006.esams.wmnet']

and were ALL successful.

Change 576265 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: Re-enable BGP in lvs3006

https://gerrit.wikimedia.org/r/576265

Change 576265 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs3006

https://gerrit.wikimedia.org/r/576265

Mentioned in SAL (#wikimedia-operations) [2020-03-03T07:41:07Z] <vgutierrez> Re-enable BGP in lvs3006 - T245984

Change 576283 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server,lvs: Reimage lvs3005 with buster

https://gerrit.wikimedia.org/r/576283

Change 576283 merged by Vgutierrez:
[operations/puppet@production] install_server,lvs: Reimage lvs3005 with buster

https://gerrit.wikimedia.org/r/576283

Mentioned in SAL (#wikimedia-operations) [2020-03-03T09:43:10Z] <vgutierrez> reimage lvs3005 with buster - T245984

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs3005.esams.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003030942_vgutierrez_6188_lvs3005_esams_wmnet.log.

Completed auto-reimage of hosts:

['lvs3005.esams.wmnet']

Of which those FAILED:

['lvs3005.esams.wmnet']

Change 576294 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server: Reimage lvs3005 with buster

https://gerrit.wikimedia.org/r/576294

Change 576294 merged by Vgutierrez:
[operations/puppet@production] install_server: Reimage lvs3005 with buster

https://gerrit.wikimedia.org/r/576294

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs3005.esams.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003031034_vgutierrez_14407_lvs3005_esams_wmnet.log.

Completed auto-reimage of hosts:

['lvs3005.esams.wmnet']

and were ALL successful.

Change 576332 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: Re-enable BGP in lvs3005

https://gerrit.wikimedia.org/r/576332

Change 576332 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs3005

https://gerrit.wikimedia.org/r/576332

Mentioned in SAL (#wikimedia-operations) [2020-03-03T13:34:46Z] <vgutierrez> Re-enable BGP in lvs3005 - T245984

Vgutierrez updated the task description. (Show Details)Tue, Mar 3, 1:37 PM

Change 576336 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server: Reimage lvs1016 with buster

https://gerrit.wikimedia.org/r/576336

Change 576336 merged by Vgutierrez:
[operations/puppet@production] install_server: Reimage lvs1016 with buster

https://gerrit.wikimedia.org/r/576336

Mentioned in SAL (#wikimedia-operations) [2020-03-03T13:54:07Z] <vgutierrez> reimage lvs1016 with buster - T245984

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs1016.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003031353_vgutierrez_56595_lvs1016_eqiad_wmnet.log.

Completed auto-reimage of hosts:

['lvs1016.eqiad.wmnet']

and were ALL successful.

Vgutierrez updated the task description. (Show Details)Tue, Mar 3, 2:51 PM

Change 576358 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server,lvs: Reimage lvs1015 with buster

https://gerrit.wikimedia.org/r/576358

Change 576358 merged by Vgutierrez:
[operations/puppet@production] install_server,lvs: Reimage lvs1015 with buster

https://gerrit.wikimedia.org/r/576358

Mentioned in SAL (#wikimedia-operations) [2020-03-03T15:00:57Z] <vgutierrez> reimage lvs1015 with buster - T245984

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs1015.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003031501_vgutierrez_71068_lvs1015_eqiad_wmnet.log.

Completed auto-reimage of hosts:

['lvs1015.eqiad.wmnet']

and were ALL successful.

Change 576369 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: Re-enable BGP in lvs1015

https://gerrit.wikimedia.org/r/576369

Change 576369 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs1015

https://gerrit.wikimedia.org/r/576369

Mentioned in SAL (#wikimedia-operations) [2020-03-03T15:31:20Z] <vgutierrez> Re-enable BGP in lvs1015 - T245984

Change 576371 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server,lvs: Reimage lvs1014 with buster

https://gerrit.wikimedia.org/r/576371

Change 576371 merged by Vgutierrez:
[operations/puppet@production] install_server,lvs: Reimage lvs1014 with buster

https://gerrit.wikimedia.org/r/576371

Mentioned in SAL (#wikimedia-operations) [2020-03-03T15:44:58Z] <vgutierrez> reimage lvs1014 with buster - T245984

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs1014.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003031544_vgutierrez_80625_lvs1014_eqiad_wmnet.log.

Completed auto-reimage of hosts:

['lvs1014.eqiad.wmnet']

and were ALL successful.

Change 576379 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: Re-enable BGP in lvs1014

https://gerrit.wikimedia.org/r/576379

Change 576379 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs1014

https://gerrit.wikimedia.org/r/576379

Mentioned in SAL (#wikimedia-operations) [2020-03-03T16:13:02Z] <vgutierrez> Re-enable BGP in lvs1014 - T245984

Vgutierrez updated the task description. (Show Details)Tue, Mar 3, 4:13 PM

Change 576381 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] install_server,lvs: Reimage lvs1013 with buster

https://gerrit.wikimedia.org/r/576381

Change 576381 merged by Vgutierrez:
[operations/puppet@production] install_server,lvs: Reimage lvs1013 with buster

https://gerrit.wikimedia.org/r/576381

Mentioned in SAL (#wikimedia-operations) [2020-03-03T16:32:27Z] <vgutierrez> reimage lvs1013 with buster - T245984

Script wmf-auto-reimage was launched by vgutierrez on cumin1001.eqiad.wmnet for hosts:

lvs1013.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202003031632_vgutierrez_89619_lvs1013_eqiad_wmnet.log.

Completed auto-reimage of hosts:

['lvs1013.eqiad.wmnet']

and were ALL successful.

Change 576388 had a related patch set uploaded (by Vgutierrez; owner: Vgutierrez):
[operations/puppet@production] lvs: Re-enable BGP in lvs1013

https://gerrit.wikimedia.org/r/576388

Change 576388 merged by Vgutierrez:
[operations/puppet@production] lvs: Re-enable BGP in lvs1013

https://gerrit.wikimedia.org/r/576388

Mentioned in SAL (#wikimedia-operations) [2020-03-03T16:58:37Z] <vgutierrez> Re-enable BGP in lvs1013 - T245984

Vgutierrez closed this task as Resolved.Tue, Mar 3, 4:59 PM
Vgutierrez claimed this task.
Vgutierrez removed a project: Patch-For-Review.
Vgutierrez updated the task description. (Show Details)