Page MenuHomePhabricator

Migrate Ganeti installations in ulsfo to a fixed KVM machine type
Closed, ResolvedPublic

Description

As a preparation for the Bullseye update we need to switch the KVM machine type for the Ganeti cluster to pc-i440fx-3.1 (the "hardware" provided by qemu 3.1). Otherwise we wouldn't be able to migrate machines between Bullseye (which would default to pc-i440fx-5.0) and Buster nodes.

This requires the following steps:

  • sudo gnt-cluster modify --hypervisor-parameters kvm:machine_version=pc-i440fx-3.1

Restart all instances of the cluster. A reboot from within the OS isn't sufficient, this needs to be rebooted on the Ganeti level so that the KVM instance gets restarted (kind of comparable to resetting a computer with the power button). There's a cookbook for this: sre.ganeti.reboot-vm FQDN

  • bast4003.wikimedia.org
  • doh4001.wikimedia.org
  • doh4002.wikimedia.org
  • durum4001.ulsfo.wmnet
  • durum4002.ulsfo.wmnet
  • install4001.wikimedia.org
  • ncredir4001.ulsfo.wmnet
  • ncredir4002.ulsfo.wmnet
  • netflow4002.ulsfo.wmnet
  • prometheus4001.ulsfo.wmnet

Event Timeline

VM bast4003.wikimedia.org rebooted by jmm@cumin2002 with reason: None

VM install4001.wikimedia.org rebooted by jmm@cumin2002 with reason: None

VM netflow4002.ulsfo.wmnet rebooted by jmm@cumin2002 with reason: None

Mentioned in SAL (#wikimedia-operations) [2022-05-06T13:20:00Z] <sukhe> depool Wikidough and durum in ulsfo for T307425

VM doh4001.wikimedia.org rebooted by sukhe@cumin2002 with reason: None

VM doh4002.wikimedia.org rebooted by sukhe@cumin2002 with reason: None

VM durum4001.ulsfo.wmnet rebooted by sukhe@cumin2002 with reason: None

VM durum4002.ulsfo.wmnet rebooted by sukhe@cumin2002 with reason: None

Mentioned in SAL (#wikimedia-operations) [2022-05-06T13:39:16Z] <sukhe> depool Wikidough and durum in esams for T307425

MoritzMuehlenhoff claimed this task.
MoritzMuehlenhoff triaged this task as Medium priority.
MoritzMuehlenhoff updated the task description. (Show Details)

This is complete