Change Details

After the DC switch (scheduled for 14th Sept 2021) [x] Sanitarium hosts on both DCs (already done https://phabricator.wikimedia.org/T275112 https://phabricator.wikimedia.org/T272008) [x] Sanitarium masters on both DCs (https://phabricator.wikimedia.org/T280492) - ensure sanitarium replicates from a 10.4 host. [x] Available backup source on the standby DC (db2141 - all sections have sources everywhere now) [x] Switchover backup generation standby DC (Ready to deploy: https://gerrit.wikimedia.org/r/c/operations/puppet/+/721285 ) [x] Candidate master on the standby DC (db2112) blocked on T293740 [x] Master on the standby DC (db2103) [x] Candidate master on the primary DC [x] Available backup source on the primary DC (db1140 - all sections have sources everywhere now) [] Switchover backup generation Primary DC (Ready to deploy: https://gerrit.wikimedia.org/r/c/operations/puppet/+/721286 ) [x] Switchover on the primary DC to promote a Buster+10.4 host to master: T293964 [] Upgrade the old master and make it a candidate master, pool it [] Cleanup (remove) old backup sources from both DCs Please read the [[ https://docs.google.com/document/d/1tYfOYROB_XjD0x_vrCRn8KpjCPUflCDuhKz8cXJvtFk/edit?ts=607fb79e | doc ]] about procedure for more details.

After the DC switch (scheduled for 14th Sept 2021) [x] Sanitarium hosts on both DCs (already done https://phabricator.wikimedia.org/T275112 https://phabricator.wikimedia.org/T272008) [x] Sanitarium masters on both DCs (https://phabricator.wikimedia.org/T280492) - ensure sanitarium replicates from a 10.4 host. [x] Available backup source on the standby DC (db2141 - all sections have sources everywhere now) [x] Switchover backup generation standby DC (Ready to deploy: https://gerrit.wikimedia.org/r/c/operations/puppet/+/721285 ) [x] Candidate master on the standby DC (db2112) blocked on T293740 [x] Master on the standby DC (db2103) [x] Candidate master on the primary DC [x] Available backup source on the primary DC (db1140 - all sections have sources everywhere now) [x] Switchover backup generation Primary DC (Ready to deploy: https://gerrit.wikimedia.org/r/c/operations/puppet/+/721286 ) [x] Switchover on the primary DC to promote a Buster+10.4 host to master: T293964 [] Upgrade the old master and make it a candidate master, pool it [] Cleanup (remove) old backup sources from both DCs Please read the [[ https://docs.google.com/document/d/1tYfOYROB_XjD0x_vrCRn8KpjCPUflCDuhKz8cXJvtFk/edit?ts=607fb79e | doc ]] about procedure for more details.

After the DC switch (scheduled for 14th Sept 2021) [x] Sanitarium hosts on both DCs (already done https://phabricator.wikimedia.org/T275112 https://phabricator.wikimedia.org/T272008) [x] Sanitarium masters on both DCs (https://phabricator.wikimedia.org/T280492) - ensure sanitarium replicates from a 10.4 host. [x] Available backup source on the standby DC (db2141 - all sections have sources everywhere now) [x] Switchover backup generation standby DC (Ready to deploy: https://gerrit.wikimedia.org/r/c/operations/puppet/+/721285 ) [x] Candidate master on the standby DC (db2112) blocked on T293740 [x] Master on the standby DC (db2103) [x] Candidate master on the primary DC [x] Available backup source on the primary DC (db1140 - all sections have sources everywhere now) [x] Switchover backup generation Primary DC (Ready to deploy: https://gerrit.wikimedia.org/r/c/operations/puppet/+/721286 ) [x] Switchover on the primary DC to promote a Buster+10.4 host to master: T293964 [] Upgrade the old master and make it a candidate master, pool it [] Cleanup (remove) old backup sources from both DCs Please read the [[ https://docs.google.com/document/d/1tYfOYROB_XjD0x_vrCRn8KpjCPUflCDuhKz8cXJvtFk/edit?ts=607fb79e | doc ]] about procedure for more details.