Page MenuHomePhabricator

Switchover s1 master (db1118 -> db1163)
Closed, ResolvedPublic

Description

When: During a pre-defined DBA maintenance windows

Affected wikis:: https://noc.wikimedia.org/conf/highlight.php?file=dblists/s1.dblist

Checklist:

NEW primary: db1163
OLD primary: db1118

  • Check configuration differences between new and old primary:
sudo pt-config-diff --defaults-file /root/.my.cnf h=db1118.eqiad.wmnet h=db1163.eqiad.wmnet

Failover prep:

  • Silence alerts on all hosts:
sudo cookbook sre.hosts.downtime --hours 1 -r "Primary switchover s1 T334375" 'A:db-section-s1'
  • Set NEW primary with weight 0 (and depool it from API or vslow/dump groups if it is present).
sudo dbctl instance db1163 set-weight 0
sudo dbctl config commit -m "Set db1163 with weight 0 T334375"
  • Topology changes, move all replicas under NEW primary
sudo db-switchover --timeout=25 --replicating-master --read-only-master --only-slave-move db1118 db1163
  • Disable puppet on both nodes
sudo cumin 'db1118* or db1163*' 'disable-puppet "primary switchover T334375"'

Failover:

  • Log the failover:
!log Starting s1 eqiad failover from db1118 to db1163 - T334375
  • Switch primaries:
sudo db-switchover --replicating-master --read-only-master --skip-slave-move db1118 db1163
echo "===== db1118 (OLD)"; sudo db-mysql db1118 -e 'show slave status\G'
echo "===== db1163 (NEW)"; sudo db-mysql db1163 -e 'show slave status\G'
  • Promote NEW primary in dbctl
sudo dbctl --scope eqiad section s1 set-master db1163
sudo dbctl config commit -m "Promote db1163 to s1 primary T334375"
  • Restart puppet on both hosts:
sudo cumin 'db1118* or db1163*' 'run-puppet-agent -e "primary switchover T334375"'

Clean up tasks:

  • Clean up heartbeat table(s).
sudo db-mysql db1163 heartbeat -e "delete from heartbeat where file like 'db1118%';"
  • change events for query killer:
events_coredb_master.sql on the new primary db1163
events_coredb_slave.sql on the new slave db1118
  • Update candidate primary dbctl and orchestrator notes
sudo dbctl instance db1118 set-candidate-master --section s1 true
sudo dbctl instance db1163 set-candidate-master --section s1 false
(dborch1001): sudo orchestrator-client -c untag -i db1163 --tag name=candidate
(dborch1001): sudo orchestrator-client -c tag -i db1118 --tag name=candidate
sudo db-mysql db1115 zarcillo -e "select * from masters where section = 's1';"
  • (If needed): Depool db1118 for maintenance.
sudo dbctl instance db1118 depool
sudo dbctl config commit -m "Depool db1118 T334375"
  • Change db1118 weight to mimic the previous weight db1163:
sudo dbctl instance db1118 edit
  • Update/resolve this ticket.

Event Timeline

Change 906698 had a related patch set uploaded (by Gerrit maintenance bot; author: Gerrit maintenance bot):

[operations/puppet@production] mariadb: Promote db1163 to s1 master

https://gerrit.wikimedia.org/r/906698

Marostegui triaged this task as Medium priority.
Marostegui updated the task description. (Show Details)
Marostegui moved this task from Triage to In progress on the DBA board.

Mentioned in SAL (#wikimedia-operations) [2023-04-11T06:20:19Z] <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on 37 hosts with reason: Primary switchover s1 T334375

Mentioned in SAL (#wikimedia-operations) [2023-04-11T06:21:12Z] <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 37 hosts with reason: Primary switchover s1 T334375

Mentioned in SAL (#wikimedia-operations) [2023-04-11T06:21:28Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Set db1163 with weight 0 T334375', diff saved to https://phabricator.wikimedia.org/P46250 and previous config saved to /var/cache/conftool/dbconfig/20230411-062127-root.json

Change 906698 merged by Marostegui:

[operations/puppet@production] mariadb: Promote db1163 to s1 master

https://gerrit.wikimedia.org/r/906698

Mentioned in SAL (#wikimedia-operations) [2023-04-11T06:56:15Z] <marostegui> Starting s1 eqiad failover from db1118 to db1163 - T334375

Mentioned in SAL (#wikimedia-operations) [2023-04-11T06:56:40Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Promote db1163 to s1 primary T334375', diff saved to https://phabricator.wikimedia.org/P46257 and previous config saved to /var/cache/conftool/dbconfig/20230411-065639-root.json

Mentioned in SAL (#wikimedia-operations) [2023-04-11T06:57:35Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1118 T334375', diff saved to https://phabricator.wikimedia.org/P46258 and previous config saved to /var/cache/conftool/dbconfig/20230411-065734-marostegui.json

Marostegui updated the task description. (Show Details)

This is done