Steps to upgrade:
[x] Sanitarium hosts on both DCs (already done https://phabricator.wikimedia.org/T275112 https://phabricator.wikimedia.org/T272008)
[x] Sanitarium masters on both DCs (https://phabricator.wikimedia.org/T280492) - ensure sanitarium replicates from a 10.4 host.
[x] Available backup source on the standby DC db2139 (to be confirmed by @jcrespo)
[x] Candidate master on the standby DC
[x] Master on the standby DC (reimaged a month ago by @Marostegui)
[x] Switchover backup generation standby DC (to be coordinated/confirmed with @jcrespo)
[] Candidate master on the primary DC
[x] Available backup source on the primary DC db1102 (to be confirmed by @jcrespo)
[] Switchover on the primary DC to promote a Buster+10.4 host to master:
[] Switchover backup generation Primary DC https://gerrit.wikimedia.org/r/692845
[] Upgrade the old master and make it a candidate master.
[] Add s3 to orchestrator
[] Cleanup (remove) old backup sources from both DCs
Please read the [[ https://docs.google.com/document/d/1tYfOYROB_XjD0x_vrCRn8KpjCPUflCDuhKz8cXJvtFk/edit?ts=607fb79e | doc ]] about procedure for more details.
Original master: db1123
Original candidate master: db1157