Change Details

Given that the switch back will be in September, let's upgrade s4 to fully Buster and MariaDB 10.4 [x] Sanitarium hosts on both DCs (already done https://phabricator.wikimedia.org/T275112 https://phabricator.wikimedia.org/T272008) [x] Sanitarium masters on both DCs (https://phabricator.wikimedia.org/T280492) - ensure sanitarium replicates from a 10.4 host. [x] Available backup source on the standby DC (db1150 - all sections have sources everywhere now) [x] Switchover backup generation standby DC (waiting for DBAs to merge) https://gerrit.wikimedia.org/r/c/operations/puppet/+/714704 [x] Candidate master on the standby DC [x] Master on the standby DC [x] Candidate master on the primary DC [x] Available backup source on the primary DC (db2139 - all sections have sources everywhere now) [] Switchover backup generation Primary DC (waiting for switchover date https://gerrit.wikimedia.org/r/c/operations/puppet/+/715919 ) [x] Switchover on the primary DC to promote a Buster+10.4 host to master: T289650 [] Upgrade the old master and make it a candidate master, pool it [] Cleanup (remove) old backup sources from both DCs Please read the [[ https://docs.google.com/document/d/1tYfOYROB_XjD0x_vrCRn8KpjCPUflCDuhKz8cXJvtFk/edit?ts=607fb79e | doc ]] about procedure for more details.

Given that the switch back will be in September, let's upgrade s4 to fully Buster and MariaDB 10.4 [x] Sanitarium hosts on both DCs (already done https://phabricator.wikimedia.org/T275112 https://phabricator.wikimedia.org/T272008) [x] Sanitarium masters on both DCs (https://phabricator.wikimedia.org/T280492) - ensure sanitarium replicates from a 10.4 host. [x] Available backup source on the standby DC (db1150 - all sections have sources everywhere now) [x] Switchover backup generation standby DC (waiting for DBAs to merge) https://gerrit.wikimedia.org/r/c/operations/puppet/+/714704 [x] Candidate master on the standby DC [x] Master on the standby DC [x] Candidate master on the primary DC [x] Available backup source on the primary DC (db2139 - all sections have sources everywhere now) [x] Switchover backup generation Primary DC (waiting for switchover date https://gerrit.wikimedia.org/r/c/operations/puppet/+/715919 ) [x] Switchover on the primary DC to promote a Buster+10.4 host to master: T289650 [] Upgrade the old master and make it a candidate master, pool it [] Cleanup (remove) old backup sources from both DCs Please read the [[ https://docs.google.com/document/d/1tYfOYROB_XjD0x_vrCRn8KpjCPUflCDuhKz8cXJvtFk/edit?ts=607fb79e | doc ]] about procedure for more details.

Given that the switch back will be in September, let's upgrade s4 to fully Buster and MariaDB 10.4 [x] Sanitarium hosts on both DCs (already done https://phabricator.wikimedia.org/T275112 https://phabricator.wikimedia.org/T272008) [x] Sanitarium masters on both DCs (https://phabricator.wikimedia.org/T280492) - ensure sanitarium replicates from a 10.4 host. [x] Available backup source on the standby DC (db1150 - all sections have sources everywhere now) [x] Switchover backup generation standby DC (waiting for DBAs to merge) https://gerrit.wikimedia.org/r/c/operations/puppet/+/714704 [x] Candidate master on the standby DC [x] Master on the standby DC [x] Candidate master on the primary DC [x] Available backup source on the primary DC (db2139 - all sections have sources everywhere now) [x] Switchover backup generation Primary DC (waiting for switchover date https://gerrit.wikimedia.org/r/c/operations/puppet/+/715919 ) [x] Switchover on the primary DC to promote a Buster+10.4 host to master: T289650 [] Upgrade the old master and make it a candidate master, pool it [] Cleanup (remove) old backup sources from both DCs Please read the [[ https://docs.google.com/document/d/1tYfOYROB_XjD0x_vrCRn8KpjCPUflCDuhKz8cXJvtFk/edit?ts=607fb79e | doc ]] about procedure for more details.