Change Details

After the DC switch (scheduled for 14th Sept 2021) [x] Sanitarium hosts on both DCs (already done https://phabricator.wikimedia.org/T275112 https://phabricator.wikimedia.org/T272008) [x] Sanitarium masters on both DCs (https://phabricator.wikimedia.org/T280492) - ensure sanitarium replicates from a 10.4 host. [x] Available backup source on the standby DC (db2098 - all sections have sources everywhere now) [x] Switchover backup generation standby DC (Ready to deploy: https://gerrit.wikimedia.org/r/c/operations/puppet/+/731404 ) [x] Candidate master on the standby DC [x] Master on the standby DC [x] Candidate master on the primary DC [x] Available backup source on the primary DC (db1171 - all sections have sources everywhere now) [] Switchover backup generation Primary DC @jcrespo https://gerrit.wikimedia.org/r/c/operations/puppet/+/736946 [x] Switchover on the primary DC to promote a Buster+10.4 host to master: T294321 [] Upgrade the old master and make it a candidate master, pool it [] Cleanup (remove) old backup sources from both DCs Please read the [[ https://docs.google.com/document/d/1tYfOYROB_XjD0x_vrCRn8KpjCPUflCDuhKz8cXJvtFk/edit?ts=607fb79e | doc ]] about procedure for more details.

After the DC switch (scheduled for 14th Sept 2021) [x] Sanitarium hosts on both DCs (already done https://phabricator.wikimedia.org/T275112 https://phabricator.wikimedia.org/T272008) [x] Sanitarium masters on both DCs (https://phabricator.wikimedia.org/T280492) - ensure sanitarium replicates from a 10.4 host. [x] Available backup source on the standby DC (db2098 - all sections have sources everywhere now) [x] Switchover backup generation standby DC (Ready to deploy: https://gerrit.wikimedia.org/r/c/operations/puppet/+/731404 ) [x] Candidate master on the standby DC [x] Master on the standby DC [x] Candidate master on the primary DC [x] Available backup source on the primary DC (db1171 - all sections have sources everywhere now) [x] Switchover backup generation Primary DC @jcrespo https://gerrit.wikimedia.org/r/c/operations/puppet/+/736946 [x] Switchover on the primary DC to promote a Buster+10.4 host to master: T294321 [] Upgrade the old master and make it a candidate master, pool it [] Cleanup (remove) old backup sources from both DCs Please read the [[ https://docs.google.com/document/d/1tYfOYROB_XjD0x_vrCRn8KpjCPUflCDuhKz8cXJvtFk/edit?ts=607fb79e | doc ]] about procedure for more details.

After the DC switch (scheduled for 14th Sept 2021) [x] Sanitarium hosts on both DCs (already done https://phabricator.wikimedia.org/T275112 https://phabricator.wikimedia.org/T272008) [x] Sanitarium masters on both DCs (https://phabricator.wikimedia.org/T280492) - ensure sanitarium replicates from a 10.4 host. [x] Available backup source on the standby DC (db2098 - all sections have sources everywhere now) [x] Switchover backup generation standby DC (Ready to deploy: https://gerrit.wikimedia.org/r/c/operations/puppet/+/731404 ) [x] Candidate master on the standby DC [x] Master on the standby DC [x] Candidate master on the primary DC [x] Available backup source on the primary DC (db1171 - all sections have sources everywhere now) [x] Switchover backup generation Primary DC @jcrespo https://gerrit.wikimedia.org/r/c/operations/puppet/+/736946 [x] Switchover on the primary DC to promote a Buster+10.4 host to master: T294321 [] Upgrade the old master and make it a candidate master, pool it [] Cleanup (remove) old backup sources from both DCs Please read the [[ https://docs.google.com/document/d/1tYfOYROB_XjD0x_vrCRn8KpjCPUflCDuhKz8cXJvtFk/edit?ts=607fb79e | doc ]] about procedure for more details.