Page MenuHomePhabricator

March 2023 Datacenter Switchover eqiad pooling schedule
Closed, ResolvedPublic

Description

This task is for discussing the pooling schedule for eqiad during the March 2023 Datacenter Switchover.

Tentative schedule according to https://wikitech.wikimedia.org/wiki/Switch_Datacenter#Overall_switchover_flow is that we'll leave eqiad completely depooled at the traffic level for 1 week, followed by 7 weeks of multi-DC with eqiad as the RO datacenter.

February 28th: Depool eqiad at traffic layer
March 8th: Repool eqiad at traffic layer
March 14th: Repool A/A services and mediawiki RO in eqiad
March 28th: Depool A/A and mediawiki RO in eqiad for T330165: eqiad row B switches upgrade

Discussion started in T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

If we are going to leave eqiad fully depooled for a week...can we do the switches operation during that time or leave eqiad depooled for longer and fit them there? @ayounsi thoughts?

It's technically possible but a more aggressive schedule would require the buy-in from everybody (including services that only live in eqiad like analytics).
We can see it as "ripping the band-aid" vs. going carefully.

Event Timeline

Clement_Goubert renamed this task from March 2023 Datacenter Switchover eqiad pooling calendar to March 2023 Datacenter Switchover eqiad pooling schedule.
Clement_Goubert triaged this task as Medium priority.
Clement_Goubert moved this task from Incoming 🐫 to this.quarter 🍕 on the serviceops board.

We are now out of the window of eqiad complete depool, according to schedule. Traffic layer has been repooled, active/active services and mediawiki RO services will follow on March 14th.

Clement_Goubert updated the task description. (Show Details)