Page MenuHomePhabricator

Upgrade s8 to Buster + MariaDB 10.4
Open, MediumPublic

Description

After the DC switch (scheduled for 14th Sept 2021)

  • Available backup source on the standby DC (db2098 - all sections have sources everywhere now)
  • Switchover backup generation standby DC (Ready to deploy: https://gerrit.wikimedia.org/r/c/operations/puppet/+/721288 )
  • Candidate master on the standby DC
  • Master on the standby DC
  • Candidate master on the primary DC
  • Available backup source on the primary DC (db1171 - all sections have sources everywhere now)
  • Switchover backup generation Primary DC @jcrespo
  • Switchover on the primary DC to promote a Buster+10.4 host to master: TO-DO
  • Upgrade the old master and make it a candidate master, pool it
  • Cleanup (remove) old backup sources from both DCs

Please read the doc about procedure for more details.

Event Timeline

Marostegui triaged this task as Medium priority.Mon, Sep 13, 1:17 PM
Marostegui moved this task from Triage to Ready on the DBA board.

I made a typo on initial upload of https://gerrit.wikimedia.org/r/c/operations/puppet/+/721288 , now fixed, so the bot didn't warn here about it.

The patch assumes s1 codfw will be done before or around the same time, so dbprov2001 can be reimaged immediatelly.

I will wait for the eqiad patch, depending on the order in which the other switchovers happen, to not work twice.

Change 721288 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Migrate s8 backups db2100 -> db2098; reimage dbprov2001

https://gerrit.wikimedia.org/r/721288

Mentioned in SAL (#wikimedia-operations) [2021-09-23T11:19:53Z] <marostegui> Upgrade db2081 db2082 db2083 db2084 db2091 db2152 T290868

All s8 core codfw replica hosts upgraded to the minor 10.4.21