Page MenuHomePhabricator

upgrade planet.wikimedia.org backends to buster
Closed, ResolvedPublic

Description

planet1001 and planet2001 are the backends for https://en.planet.wikimedia.org (and the other language versions) and are currently on stretch.

they should be replaced with new backends planet[12]002 running buster

time frame: by the end of Q2 2020

Event Timeline

Change 584612 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] add planet1002.eqiad.wmnet

https://gerrit.wikimedia.org/r/584612

Change 584612 merged by Dzahn:
[operations/dns@master] add planet1002.eqiad.wmnet

https://gerrit.wikimedia.org/r/584612

Change 584887 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] switch backend for planet to planet1002

https://gerrit.wikimedia.org/r/584887

Change 584887 merged by Dzahn:
[operations/dns@master] switch backend for planet to planet1002

https://gerrit.wikimedia.org/r/584887

Mentioned in SAL (#wikimedia-operations) [2020-04-01T09:05:58Z] <mutante> planet - the backend server has been switched from planet1001 (stretch) to planet1002 (buster) - T247651

Change 585183 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] add planet2002.codfw.wmnet

https://gerrit.wikimedia.org/r/585183

Change 585183 merged by Dzahn:
[operations/dns@master] add planet2002.codfw.wmnet

https://gerrit.wikimedia.org/r/585183

Change 585186 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] DHCP: add planet2002.codfw.wmnet

https://gerrit.wikimedia.org/r/585186

Change 585186 merged by Dzahn:
[operations/puppet@production] DHCP: add planet2002.codfw.wmnet

https://gerrit.wikimedia.org/r/585186

Change 585218 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] decom planet1001.eqiad.wmnet

https://gerrit.wikimedia.org/r/585218

Icinga downtime for 1 day, 0:00:00 set by dzahn@cumin1001 on 1 host(s) and their services with reason: reinstall

planet1001.eqiad.wmnet

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: planet1001.eqiad.wmnet

  • planet1001.eqiad.wmnet (PASS)
    • Downtimed host on Icinga
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti01.svc.eqiad.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: planet2001.codfw.wmnet

  • planet2001.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti01.svc.codfw.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed

Change 585218 merged by Dzahn:
[operations/puppet@production] decom planet1001 and planet2001

https://gerrit.wikimedia.org/r/585218

Change 585473 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] remove planet1001 and planet2001

https://gerrit.wikimedia.org/r/585473

Change 585473 merged by Dzahn:
[operations/dns@master] remove planet1001 and planet2001

https://gerrit.wikimedia.org/r/585473

done. planet1002 and planet2002 on buster have replaced 1001/2001 and the old stretch VMs have been decom'ed.