Page MenuHomePhabricator

reclone x2 codfw hosts
Closed, ResolvedPublic

Description

Since the investigation is done, we need to fix the state of codfw replicas.

  • db2144 (master)
  • db2143
  • db2142

Related Objects

StatusSubtypeAssignedTask
Resolvedaaron
Resolvedjijiki
Resolvedaaron
ResolvedKrinkle
Resolvedtstarling
Resolvedaaron
ResolvedPRODUCTION ERRORtstarling
Resolvedtstarling
Resolvedtstarling
Resolvedaaron
Resolvedaaron
ResolvedKrinkle
Resolvedaaron
ResolvedEevans
Resolvedaaron
ResolvedKrinkle
ResolvedPapaul
ResolvedMarostegui
Resolvedaaron
ResolvedKrinkle
Resolvedtstarling
Resolvedtstarling
ResolvedMarostegui
Resolvedtstarling
ResolvedKrinkle
ResolvedEevans
Resolvedtstarling
ResolvedLadsgroup
Resolvedtstarling
ResolvedVgutierrez
Resolvedtstarling
Resolvedaaron
Resolvedjcrespo
Resolvedjcrespo
Resolved Cmjohnson
ResolvedGehel
Resolvedjcrespo
Resolvedjcrespo
Resolvedjcrespo
ResolvedMarostegui
DuplicateNone
Resolvedjcrespo
Resolvedaaron
Resolvedjcrespo
Resolvedtstarling
Resolvedtstarling
Resolvedaaron
ResolvedKrinkle

Event Timeline

Ladsgroup moved this task from Triage to Ready on the DBA board.
Marostegui moved this task from Ready to In progress on the DBA board.

I have recloned both replicas, now I need to perform a master switchover to reclone the master.

Change 825354 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] mariadb: Promote db2142 to x2 master

https://gerrit.wikimedia.org/r/825354

Mentioned in SAL (#wikimedia-operations) [2022-08-22T14:24:23Z] <marostegui> Starting x2 codfw failover from db2144 to db2142 - T315853

Change 825354 merged by Marostegui:

[operations/puppet@production] mariadb: Promote db2142 to x2 master

https://gerrit.wikimedia.org/r/825354

Mentioned in SAL (#wikimedia-operations) [2022-08-22T14:32:44Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Promote db2144 to x2 primary T315853', diff saved to https://phabricator.wikimedia.org/P32752 and previous config saved to /var/cache/conftool/dbconfig/20220822-143243-root.json

I have switched over x2 codfw master, db2142 is the new master.

Marostegui updated the task description. (Show Details)

This is all done