Page MenuHomePhabricator

Story idea for Blog: June 2021 DC Switchover
Closed, ResolvedPublic

Description

Please provide the following information.

  • Provide a short summary of your proposed post for the Wikimedia Technical Blog. Blog readers will see this as the preview to your post:

Most user traffic was switched from our primary Virginia datacenter to our secondary one in Texas, this post covers how it went and what issues popped up

This is primarily "An important detail" but a bit of "Big picture" since we haven't done one of these posts in a while.

  • Which audience or audiences do you think your post is appropriate for?:

Wikimedians interested in how the switch went and others learning about how we keep the site resilient

  • Will you need assistance with writing your blog post, or do you already have a draft? If you have a draft, please provide a link here:

https://www.mediawiki.org/wiki/User:Legoktm/Blog/June_2021_switchover

  • Does your post need to be published by a certain date? No, but certain relative times like "Earlier this week" will need to be adjusted.

Something from https://commons.wikimedia.org/wiki/Category:Wikimedia_servers_in_Carrollton maybe?

  • Do you have any other questions or comments?

I'm very much unsure how to describe the list of services that moved. The actual list is: apertium, api-gateway, aqs, citoid, cxserver, echostore, eventgate-analytics, eventgate-analytics-external, eventgate-logging-external, eventgate-main, eventstreams, eventstreams-internal, helm-charts, kartotherian, kibana, linkrecommendation, logstash, mathoid, mobileapps, ores, proton, push-notifications, recommendation-api, restbase, schema, search, sessionstore, shellbox, similar-users, swift, swift-ro, swift-rw, termbox, thanos-query, thanos-swift, thumbor, wdqs, wdqs-internal, wikifeeds, zotero.

It's just a grab bag of 40 different and unrelated things.

cc @wkandek, @RLazarus, @JMeybohm, @Joe for feedback on the draft itself

Event Timeline

I have added a bit of text to explain services

wkandek triaged this task as Medium priority.Sat, Jul 3, 12:58 AM
wkandek moved this task from Incoming 🐫 to Doing 😎 on the serviceops board.

@Legoktm and @wkandek Thank you for this (and your patience while I was out on vacation). I will move this over to the blog this week to format for publication!

@Legoktm I decided to move this into a Google doc for editing before moving this over to the blog. Can you take a quick look and accept/decline the suggested edits before I move this over?

https://docs.google.com/document/d/1XcFOm41kxY5Ge4C69c1BkzapaN7gyr6NE4E_mKdwBS8/edit#

@Legoktm I decided to move this into a Google doc for editing before moving this over to the blog. Can you take a quick look and accept/decline the suggested edits before I move this over?

Done!

Awesome! I will move this over to the blog and will let you know when it is published (likely tomorrow, 23 July, or Monday 26 July.

This has been posted! https://techblog.wikimedia.org/2021/07/23/june-2021-data-center-switchover/

Let me know if it looks good to you, and I'll announce it more widely.

Is it possible to stack the Citoid graphs instead of putting them side-by-side? Everything else looks great, thank you!