Page MenuHomePhabricator

switchdc should verify active/active DBs are read-write in both datacenters
Closed, ResolvedPublic

Description

Currently the switchdc cookbooks via spicerack ignore active/active dbs (parsercache, x2). It would be a good improvement if it verified that active/active dbs are read-write in both DCs. Or at the very least verify it's read-write in the new primary DC.

Suggested by @RLazarus in https://gerrit.wikimedia.org/r/c/operations/software/spicerack/+/701474/5/spicerack/mysql_legacy.py#253

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript
LSobanski subscribed.

Certainly makes sense. To be sure I understand the expectations, who owns making the change?

@Legoktm since we are getting closer to the switch back, is this task a requirement to proceed or will the manual steps be accounted for in the manual procedure?

Certainly makes sense. To be sure I understand the expectations, who owns making the change?

I don't really know how much DBAs have worked on the spicerack stuff so far if y'all want to do it, otherwise this is on my list of stuff to get to eventually, but I don't want to cookie lick.

@Legoktm since we are getting closer to the switch back, is this task a requirement to proceed or will the manual steps be accounted for in the manual procedure?

No, I don't think this is a blocker (sidenote: I tried to add everything I actually thought was a blocker to the tracking task) because the status quo is that we've never automatically checked parsercache is read-write in both DCs and x2 still isn't in use yet. I added a note that parsercaches should be manually checked: https://wikitech.wikimedia.org/w/index.php?title=Switch_Datacenter&type=revision&diff=1922601&oldid=1921550

LSobanski added subscribers: Kormat, Marostegui.

@Legoktm Thanks! I'd say this is not top of our priority list right now so the cookie is all yours.

CC'ing @Marostegui and @Kormat in case they have a different opinion.

Clement_Goubert claimed this task.

Since we removed all RW sections from mysql_legacy, I think it can be.