As a preparation for the Buster update we need to switch the KVM machine type for the Ganeti cluster to pc-i440fx-2.8 (the hardware provided by qemu 2.8). Otherwise we wouldn't be able to migrate machines between Stretch and Buster nodes (which would default to pc-i440fx-3.1). One the Buster migration is complete we switch back to pc-i440fx-3.1.
This requires the following steps:
1. sudo gnt-cluster modify --hypervisor-parameters kvm:machine_version=pc-i440fx-2.8
2. Restart all instances of the cluster. A reboot from within the OS isn't sufficient, this needs to be rebooted on the Ganeti level so that the KVM instance gets restarted (kind of comparable to resetting a computer with the power button). There's a new cookbook for this: sre.ganeti.reboot-vm
[] acmechief2001.codfw.wmnet
[] acmechief-test2001.codfw.wmnet
[x] apt2001.wikimedia.org
[] chartmuseum2001.codfw.wmnet
[x] debmonitor2002.codfw.wmnet
[x] deneb.codfw.wmnet
[x] doc2001.codfw.wmnet
[x] doh2001.wikimedia.org
[x] doh2002.wikimedia.org
[x] dragonfly-supernode2001.codfw.wmnet
[x] durum2001.codfw.wmnet
[x] durum2002.codfw.wmnet
[x] failoid2002.codfw.wmnet
[x] gitlab2001.wikimedia.org
[x] grafana2001.codfw.wmnet
[x] idp2001.wikimedia.org
[x] idp-test2001.wikimedia.org
[x] install2003.wikimedia.org
[] irc2001.wikimedia.org
[] kafkamon2002.codfw.wmnet
[] kubemaster2001.codfw.wmnet
[] kubemaster2002.codfw.wmnet
[] kubernetes2005.codfw.wmnet
[] kubernetes2006.codfw.wmnet
[] kubernetes2015.codfw.wmnet
[] kubernetes2016.codfw.wmnet
[] kubestagemaster2001.codfw.wmnet
[] kubestagetcd2001.codfw.wmnet
[] kubestagetcd2002.codfw.wmnet
[] kubestagetcd2003.codfw.wmnet
[] kubetcd2004.codfw.wmnet
[] kubetcd2005.codfw.wmnet
[] kubetcd2006.codfw.wmnet
[x] ldap-corp2001.wikimedia.org
[x] ldap-replica2005.wikimedia.org
[x] ldap-replica2006.wikimedia.org
[x] logstash2004.codfw.wmnet
[x] logstash2005.codfw.wmnet
[x] logstash2006.codfw.wmnet
[x] logstash2023.codfw.wmnet
[x] logstash2024.codfw.wmnet
[x] logstash2025.codfw.wmnet
[x] logstash2030.codfw.wmnet
[x] logstash2031.codfw.wmnet
[x] miscweb2002.codfw.wmnet
[x] ml-etcd2001.codfw.wmnet
[x] ml-etcd2002.codfw.wmnet
[x] ml-etcd2003.codfw.wmnet
[x] ml-serve-ctrl2001.codfw.wmnet
[x] ml-serve-ctrl2002.codfw.wmnet
[x] mwdebug2001.codfw.wmnet
[x] mwdebug2002.codfw.wmnet
[x] mx2001.wikimedia.org
[] ncredir2001.codfw.wmnet
[] ncredir2002.codfw.wmnet
[x] netbox2001.wikimedia.org
[x] netbox-dev2001.wikimedia.org
[x] netboxdb2001.codfw.wmnet
[x] netflow2001.codfw.wmnet
[x] orespoolcounter2003.codfw.wmnet
[x] orespoolcounter2004.codfw.wmnet
[x] people2002.codfw.wmnet
[x] ping2001.codfw.wmnet
[x] planet2002.codfw.wmnet
[x] poolcounter2003.codfw.wmnet
[x] poolcounter2004.codfw.wmnet
[x] puppetboard2001.codfw.wmnet
[x] puppetboard2002.codfw.wmnet
[x] puppetdb2002.codfw.wmnet
[x] pybal-test2001.codfw.wmnet
[x] pybal-test2002.codfw.wmnet
[x] pybal-test2003.codfw.wmnet
[] registry2003.codfw.wmnet
[] registry2004.codfw.wmnet
[x] releases2002.codfw.wmnet
[x] rpki2002.codfw.wmnet
[] schema2003.codfw.wmnet
[] schema2004.codfw.wmnet
[x] search-loader2001.codfw.wmnet
[x] serpens.wikimedia.org
[x] urldownloader2001.wikimedia.org
[x] urldownloader2002.wikimedia.org
[x] webperf2001.codfw.wmnet
[x] webperf2002.codfw.wmnet
[x] xhgui2001.codfw.wmnet