Page MenuHomePhabricator

Upgrade codfw1dev cloudservices nodes to OpenStack 'Wallaby'
Closed, ResolvedPublic

Description

The release notes (https://docs.openstack.org/releasenotes/designate/) for the change between V and W are essentially empty, so this should be an easy one.

  • prepare a patch that upgrades the openstack version /only/ on cloudservices (via profile::openstack::<deployent>::version settings in puppet/hieradata/hosts/<hostnames>)

https://gerrit.wikimedia.org/r/c/operations/puppet/+/773806

  • disable puppet on cloudservices nodes from cumin1001.eqiad.wmnet

    $ sudo cumin 'cloudservices200*' "disable-puppet 'Upgrading to openstack Wallaby - T304702 - ${USER}'"
  • merge above patch

One node at a time: [x] cloudservices2002-dev.wikimedia.org [] cloudservices2003-dev.wikimedia.org

  • puppet agent --enable && puppet agent -tv
  • apt-get update
  • DEBIAN_FRONTEND=noninteractive apt-get install python3-designate designate-sink designate-central designate-worker designate-mdns designate-api -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold"
  • DEBIAN_FRONTEND=noninteractive apt-get upgrade -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold"
  • puppet agent -tv
  • designate-manage database sync
  • puppet agent -tv
  • reboot host
  • systemctl list-units --failed (should show nothing failed)

Test by digging @ both the pdns-recursor ip and the pdns auth ip, a couple of randomly-chosen VM fqdns.
for cloudservices2002-dev.wikimedia.org:
dig @ns0.openstack.codfw1dev.wikimediacloud.org util-codfw1dev.andrewtestproject.codfw1dev.wikimedia.cloud

for cloudservices2003-dev.wikimedia.org:
dig @ns1.openstack.codfw1dev.wikimediacloud.org util-codfw1dev.andrewtestproject.codfw1dev.wikimedia.cloud

Details

Event Timeline

Change 773806 had a related patch set uploaded (by Vivian Rook; author: Vivian Rook):

[operations/puppet@production] Update codfw1dev cloudservices openstack

https://gerrit.wikimedia.org/r/773806

Change 773806 merged by Vivian Rook:

[operations/puppet@production] Update codfw1dev cloudservices openstack

https://gerrit.wikimedia.org/r/773806

rook renamed this task from Upgrade cloudservices nodes to OpenStack 'Wallaby' to Upgrade codfw1dev cloudservices nodes to OpenStack 'Wallaby'.Mar 28 2022, 2:19 PM
rook updated the task description. (Show Details)