Page MenuHomePhabricator

CommRel support for September 2021 Switchover
Closed, ResolvedPublic

Description

Hi CommRel,

We are planning a datacenter switchover (switching back from codfw -> eqiad) for the week of Sept 13th - do you see any issues/conflicts with those dates and do they work for you?

Past: T281209: CommRel support for June 2021 Switchover, https://office.wikimedia.org/wiki/Community_Relations_Specialists/codfw

Planning

Three weeks before - Aug 16

  • Tech News (initial warning)
  • Update the message to communities
  • Have the message being translated by emailing both:
    • translators-l for translations
    • wikitech-l for information and translations
  • Monitor the message's talk page

Two weeks before - Aug 30

  • Set the banner for a display on all wikis 30 minutes before it happens
    • Note: the banner will be used for a read-only on August 25. Please don't edit it until Aug 30 week.

The week before - Sept 6

  • Emailing mailing lists:
    • wikitech-l and translators once again
  • Added to the news on the Meta front page
  • Message communities
    • non-technical village pumps
    • bot coordination pages

The week it happens - Sept 13

  • Tech News (this is happening this week)

The week after

  • Debrief

Details

Other Assignee
Trizek-WMF

Event Timeline

@sgrabarczuk @Trizek-WMF looking forward to seeing how you're going to use the primary and secondary owner fields here!

sgrabarczuk updated Other Assignee, added: Trizek-WMF.

I've added my two cents in T285806#7254431. These dates work for us.

@Trizek-WMF @Quiddity could you please verify whether the "two weeks before" tasks have been completed? If so, please mark them done. Thanks

@Trizek-WMF @Quiddity could you please verify whether the "two weeks before" tasks have been completed? If so, please mark them done. Thanks

I just done the tasks. We are a bit late, but since we are on the very early stages, the final result won't be impacted.

@Legoktm I'd like to check again because I may need to make a tweak in the announcement. The switchover will take place in the week of Sep 13th, and editing will only be affected on Sep 14, won't it?

@Legoktm I'd like to check again because I may need to make a tweak in the announcement. The switchover will take place in the week of Sep 13th, and editing will only be affected on Sep 14, won't it?

Yes, the MediaWiki part of the switchover will be Sept 14th 14:00 UTC. Sorry for not reviewing at the announcement earlier.

I made two updates to our message to communies:

  • the date
  • the fact that the deployment train will run

I informed the translators about these changes.

@sgrabarczuk, @Trizek-WMF Hi, @AntiCompositeNumber pointed out that the centralnotice is up, but it seems to be pointing to T289660: Read-only window needed for s4 (Commonswiki) instead of the switchover page/task.

I'm seeing the banner right now, and it says the maintenance will be from 6:00 UTC to 6:30 UTC

However, banner time is set from 13:30 UTC to 14:01 UTC. That doesn't look right

https://meta.wikimedia.org/w/index.php?title=Special:CentralNotice&subaction=noticeDetail&notice=20200914_read_only

What was set to correct times was the campaign times, but the campaign used the same banner as from the 6th, and that banner should've been edited for proper reuse :) (which is what I did now)

We got a delayed start today, so I asked @Urbanecm to extend the banner time to 15:00 UTC.

I changed the hour on the banner. I can't change the Central information page though, but it is not a big deal IMO, since it says "starting at 14:00 UTC", meaning that it can last longer.

I changed the hour on the banner. I can't change the Central information page though, but it is not a big deal IMO, since it says "starting at 14:00 UTC", meaning that it can last longer.

Current expectation is that the RO will end at 15:00 UTC (at worse), starting at any time. I changed the message back to match. I did that based on #wikimedia-operations IRC discussion with the SREs doing the switch :-).

Can this be closed then?

Szymon and I will debrief it next week. Then we will close it.

We debriefed and we are going to improve the processes so that they will be less time consuming, more reliable and less volunteer-time demanding.