- Add component/ganeti216 to all nodes
- Upgrade all nodes using "cumin A:ganeti-codfw 'apt-get install -y ganeti'"
- cumin A:ganeti-codfw 'chown gnt-metad /var/log/ganeti/meta-daemon.log'
- sudo gnt-cluster renew-crypto --new-cluster-certificate --new-rapi-certificate --new-spice-certificate
- sudo gnt-cluster upgrade --to 2.16
- sudo gnt-cluster renew-crypto --new-node-certificates (might not be needed for future updates if the hashing algo stays the same)
Following that empty/reimage/readd the following virtualisation servers:
- ganeti2007.codfw.wmnet
- ganeti2008.codfw.wmnet
- ganeti2009.codfw.wmnet
- ganeti2010.codfw.wmnet
- ganeti2011.codfw.wmnet
- ganeti2012.codfw.wmnet
- ganeti2013.codfw.wmnet
- ganeti2014.codfw.wmnet
- ganeti2015.codfw.wmnet
- ganeti2016.codfw.wmnet
- ganeti2017.codfw.wmnet
- ganeti2018.codfw.wmnet
- ganeti2019.codfw.wmnet
- ganeti2020.codfw.wmnet
- ganeti2021.codfw.wmnet
- ganeti2022.codfw.wmnet
- ganeti2023.codfw.wmnet
- ganeti2024.codfw.wmnet
The following instances were temporarily converted from plain disk storage to DRBD:
- ml-etcd2001
- ml-etcd2003
- kubetcd2004.codfw.wmnet (and reverted back to plain)
- kubetcd2005.codfw.wmnet (and reverted back to plain)
- kubetcd2006.codfw.wmnet (and reverted back to plain)