As a preparation for the Buster update we need to switch the KVM machine type for the Ganeti cluster to pc-i440fx-2.8 (the hardware provided by qemu 2.8). Otherwise we wouldn't be able to migrate machines between Stretch and Buster nodes (which would default to pc-i440fx-3.1). One the Buster migration is complete we switch back to pc-i440fx-3.1.
This requires the following steps:
1. sudo gnt-cluster modify --hypervisor-parameters kvm:machine_version=pc-i440fx-2.8
2. Restart all instances of the cluster. A reboot from within the OS isn't sufficient, this needs to be rebooted on the Ganeti level so that the KVM instance gets restarted (kind of comparable to resetting a computer with the power button). There's a new cookbook for this: sre.ganeti.reboot-vm
[x] acmechief1001.eqiad.wmnet
[x] acmechief-test1001.eqiad.wmnet
[] an-airflow1001.eqiad.wmnet
[] an-airflow1002.eqiad.wmnet
[] an-airflow1003.eqiad.wmnet
[] an-test-client1001.eqiad.wmnet
[] an-test-druid1001.eqiad.wmnet
[] an-test-presto1001.eqiad.wmnet
[] an-test-ui1001.eqiad.wmnet
[] an-tool1005.eqiad.wmnet
[] an-tool1007.eqiad.wmnet
[] an-tool1008.eqiad.wmnet
[] an-tool1009.eqiad.wmnet
[] aphlict1001.eqiad.wmnet
[] apt1001.wikimedia.org
[] archiva1002.wikimedia.org
[x] chartmuseum1001.eqiad.wmnet
[] cloudbackup1001-dev.eqiad.wmnet
[] cloudbackup1002-dev.eqiad.wmnet
[] cuminunpriv1001.eqiad.wmnet
[] d-i-test.eqiad.wmnet
[x] dbmonitor1002.wikimedia.org
[x] dborch1001.wikimedia.org
[x] debmonitor1002.eqiad.wmnet
[x] doc1001.eqiad.wmnet
[x] doc1002.eqiad.wmnet
[x] doh1001.wikimedia.org
[x] doh1002.wikimedia.org
[x] dragonfly-supernode1001.eqiad.wmnet
[x] durum1001.eqiad.wmnet
[x] durum1002.eqiad.wmnet
[x] etherpad1002.eqiad.wmnet
[] eventlog1003.eqiad.wmnet
[x] failoid1002.eqiad.wmnet
[] flowspec1001.eqiad.wmnet
[x] gitlab1001.wikimedia.org
[x] gitlab-runner1001.eqiad.wmnet
[x] grafana1002.eqiad.wmnet
[] idp1001.wikimedia.org
[x] idp-test1001.wikimedia.org
[] install1003.wikimedia.org
[x] irc1001.wikimedia.org
[x] kafka-test1006.eqiad.wmnet
[] kafka-test1007.eqiad.wmnet
[] kafka-test1008.eqiad.wmnet
[] kafka-test1009.eqiad.wmnet
[] kafka-test1010.eqiad.wmnet
[] kafkamon1002.eqiad.wmnet
[x] kubemaster1001.eqiad.wmnet
[x] kubemaster1002.eqiad.wmnet
[x] kubernetes1005.eqiad.wmnet
[x] kubernetes1006.eqiad.wmnet
[x] kubernetes1015.eqiad.wmnet
[x] kubernetes1016.eqiad.wmnet
[x] kubestagemaster1001.eqiad.wmnet
[x] kubestagetcd1004.eqiad.wmnet
[x] kubestagetcd1005.eqiad.wmnet
[x] kubestagetcd1006.eqiad.wmnet
[] kubetcd1004.eqiad.wmnet
[] kubetcd1005.eqiad.wmnet
[] kubetcd1006.eqiad.wmnet
[] ldap-corp1001.wikimedia.org
[] ldap-replica1003.wikimedia.org
[] ldap-replica1004.wikimedia.org
[x] lists1001.wikimedia.org
[x] logstash1007.eqiad.wmnet
[x] logstash1008.eqiad.wmnet
[x] logstash1009.eqiad.wmnet
[x] logstash1023.eqiad.wmnet
[x] logstash1024.eqiad.wmnet
[x] logstash1025.eqiad.wmnet
[x] logstash1030.eqiad.wmnet
[x] logstash1031.eqiad.wmnet
[x] logstash1032.eqiad.wmnet
[] matomo1002.eqiad.wmnet
[x] miscweb1002.eqiad.wmnet
[] ml-etcd1001.eqiad.wmnet
[] ml-etcd1002.eqiad.wmnet
[] ml-etcd1003.eqiad.wmnet
[] ml-serve-ctrl1001.eqiad.wmnet
[] ml-serve-ctrl1002.eqiad.wmnet
[x] moscovium.eqiad.wmnet
[x] mwdebug1001.eqiad.wmnet
[x] mwdebug1002.eqiad.wmnet
[x] mx1001.wikimedia.org
[x] ncredir1001.eqiad.wmnet
[x] ncredir1002.eqiad.wmnet
[x] netbox1001.wikimedia.org
[x] netboxdb1001.eqiad.wmnet
[x] netflow1001.eqiad.wmnet
[x] orespoolcounter1003.eqiad.wmnet
[x] orespoolcounter1004.eqiad.wmnet
[x] otrs1001.eqiad.wmnet
[x] people1003.eqiad.wmnet
[x] ping1002.eqiad.wmnet
[x] planet1002.eqiad.wmnet
[x] poolcounter1004.eqiad.wmnet
[x] poolcounter1005.eqiad.wmnet
[x] puppetboard1001.eqiad.wmnet (decom)
[x] puppetboard1002.eqiad.wmnet
[x] puppetdb1002.eqiad.wmnet
[x] registry1003.eqiad.wmnet
[x] registry1004.eqiad.wmnet
[x] releases1002.eqiad.wmnet
[x] rpki1001.eqiad.wmnet
[] schema1003.eqiad.wmnet
[] schema1004.eqiad.wmnet
[] seaborgium.wikimedia.org
[] search-loader1001.eqiad.wmnet
[] testreduce1001.eqiad.wmnet
[] urldownloader1001.wikimedia.org
[] urldownloader1002.wikimedia.org
[x] webperf1001.eqiad.wmnet
[x] webperf1002.eqiad.wmnet
[x] xhgui1001.eqiad.wmnet
[x] zookeeper-test1002.eqiad.wmnet