Page MenuHomePhabricator
Create Task
Maniphest T330090

Switchover static miscweb services to codfw
Closed, ResolvedPublic
Actions

Description

A task to track the failover of static miscweb services during the March 2023 Datacenter Switchover (T327920).

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
wdqs/wcqs: switch query.wikidata.org and wcqs to bullseye backendsoperations/puppetproduction+4 -4
remove commons-query virtual host from httpd on miscweboperations/puppetproduction+0 -4
trafficserver/wdqs: switch query-preview.wikidata.org to new backendoperations/puppetproduction+2 -2
switch (www).wikiworkshop.org from eqiad to codfwoperations/puppetproduction+2 -2
httpbb/miscweb: add missing/new virtual hosts to testsoperations/puppetproduction+16 -0
switch design.wikimedia.org from eqiad to codfwoperations/puppetproduction+1 -1
switch transparency.wikimedia.org from eqiad to codfwoperations/puppetproduction+1 -1
switch transparency-archive.wikimedia.org from eqiad to codfwoperations/puppetproduction+1 -1
switch static-codereview.wikimedia.org from eqiad to codfwoperations/puppetproduction+1 -1
switch research.wikimedia.org from eqiad to codfwoperations/puppetproduction+1 -1
switch os-reports.wikimedia.org from eqiad to codfwoperations/puppetproduction+1 -1
switch tendril.wikimedia.org and dbtree.wikimedia.org to codfwoperations/puppetproduction+2 -2
switch sitemaps.wikimedia.org from eqiad to codfwoperations/puppetproduction+1 -1
switch security.wikimedia.org from eqiad to codfwoperations/puppetproduction+1 -1
switch https://bienvenida.wikimedia.org from eqiad to codfwoperations/puppetproduction+1 -1
swich https://15.wikipedia.org from eqiad to codfwoperations/puppetproduction+1 -1
switch annual.wikimedia.org from eqiad to codfwoperations/puppetproduction+1 -1
httpbb: update/fix tests for miscweboperations/puppetproduction+2 -2
re-introduce webserver-misc-static.discovery.wmnetoperations/dnsmaster+2 -0
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

LSobanski created this task.Feb 20 2023, 3:11 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 20 2023, 3:11 PM
LSobanski renamed this task from Failover static miscweb services to codfw to Switchover static miscweb services to codfw.Feb 20 2023, 3:14 PM
LSobanski added a project: Datacenter-Switchover.Feb 20 2023, 3:58 PM
LSobanski triaged this task as High priority.Feb 20 2023, 4:23 PM
LSobanski moved this task from Incoming to Backlog on the collaboration-services board.
akosiaris added a parent task: T327920: March 2023 Datacenter Switchover.Feb 21 2023, 3:23 PM
Clement_Goubert subscribed.Feb 21 2023, 3:26 PM
Dzahn claimed this task.Feb 23 2023, 12:46 AM
gerritbot added a comment.Feb 23 2023, 12:57 AM

Change 891384 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/dns@master] re-introduce webserver-misc-static.discovery.wmnet

https://gerrit.wikimedia.org/r/891384

gerritbot added a project: Patch-For-Review.Feb 23 2023, 12:57 AM
Dzahn added a comment.Feb 23 2023, 12:58 AM

In the past we had separate pairs of VMs, one for
static sites and one for applications.

Later these were merged into a single pair of machines.

Now we want the ability back to switch only the static
sites between data centers but not touch the apps.

Therefore we introduce 2 separate names to have that flexibility
even though it does NOT mean we add new VMs again.

After that we can flip some of the static HTML sites without breaking other things.

gerritbot added a comment.Feb 23 2023, 1:05 AM

Change 891406 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] switch annual.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/891406

Jelto moved this task from Backlog to Work in Progress on the collaboration-services board.Feb 27 2023, 4:35 PM
gerritbot added a comment.Feb 27 2023, 5:33 PM

Change 891384 merged by Dzahn:

[operations/dns@master] re-introduce webserver-misc-static.discovery.wmnet

https://gerrit.wikimedia.org/r/891384

gerritbot added a comment.Feb 27 2023, 9:28 PM

Change 892564 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] httpbb: update/fix tests for miscweb

https://gerrit.wikimedia.org/r/892564

gerritbot added a comment.Feb 27 2023, 9:34 PM

Change 892564 merged by Dzahn:

[operations/puppet@production] httpbb: update/fix tests for miscweb

https://gerrit.wikimedia.org/r/892564

gerritbot added a comment.Feb 27 2023, 10:29 PM

Change 891406 merged by Dzahn:

[operations/puppet@production] switch annual.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/891406

Maintenance_bot removed a project: Patch-For-Review.Feb 27 2023, 10:30 PM
Stashbot added a comment.Feb 27 2023, 10:36 PM

Mentioned in SAL (#wikimedia-operations) [2023-02-27T22:36:57Z] <mutante> switching https://annual.wikimedia.org from eqiad to codfw T330090

Dzahn updated the task description. (Show Details)Feb 27 2023, 10:41 PM

The following test shows it all at once (after fixing tests):

[deploy2002:~] $ httpbb --hosts webserver-misc-static.discovery.wmnet /srv/deployment/httpbb-tests/miscweb/test_miscweb.yaml
Sending to webserver-misc-static.discovery.wmnet...
PASS: 33 requests sent to webserver-misc-static.discovery.wmnet. All assertions passed.

We are using the new discovery name we recreated. We are testing various URL across all the misc sites (33 tests) and we are doing all that from the codfw deployment server to the codfw backend.

gerritbot added a comment.Feb 27 2023, 10:49 PM

Change 892571 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] swich https://15.wikipedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/892571

gerritbot added a project: Patch-For-Review.Feb 27 2023, 10:49 PM
gerritbot added a comment.Feb 27 2023, 11:09 PM

Change 892571 merged by Dzahn:

[operations/puppet@production] swich https://15.wikipedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/892571

Maintenance_bot removed a project: Patch-For-Review.Feb 27 2023, 11:10 PM
gerritbot added a comment.Feb 27 2023, 11:32 PM

Change 892574 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] switch https://bienvenida.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/892574

gerritbot added a project: Patch-For-Review.Feb 27 2023, 11:32 PM

Change 892574 merged by Dzahn:

[operations/puppet@production] switch https://bienvenida.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/892574

Maintenance_bot removed a project: Patch-For-Review.Feb 28 2023, 12:10 AM
gerritbot added a comment.Feb 28 2023, 12:15 AM

Change 892579 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] switch security.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/892579

gerritbot added a project: Patch-For-Review.Feb 28 2023, 12:15 AM
Dzahn updated the task description. (Show Details)Feb 28 2023, 12:16 AM
gerritbot added a comment.Feb 28 2023, 12:17 AM

Change 892579 merged by Dzahn:

[operations/puppet@production] switch security.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/892579

gerritbot added a comment.Feb 28 2023, 12:24 AM

Change 892580 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] switch sitemaps.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/892580

gerritbot added a comment.Feb 28 2023, 12:25 AM

Change 892580 merged by Dzahn:

[operations/puppet@production] switch sitemaps.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/892580

Dzahn updated the task description. (Show Details)EditedFeb 28 2023, 12:26 AM

@Clement_Goubert @LSobanski The following things have been switched today:

Maintenance_bot removed a project: Patch-For-Review.Feb 28 2023, 12:30 AM
gerritbot added a comment.Feb 28 2023, 12:33 AM

Change 892582 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] switch tendril.wikimedia.org and dbtree.wikimedia.org to codfw

https://gerrit.wikimedia.org/r/892582

gerritbot added a project: Patch-For-Review.Feb 28 2023, 12:33 AM

Change 892582 merged by Dzahn:

[operations/puppet@production] switch tendril.wikimedia.org and dbtree.wikimedia.org to codfw

https://gerrit.wikimedia.org/r/892582

Dzahn updated the task description. (Show Details)Feb 28 2023, 12:34 AM
gerritbot added a comment.Feb 28 2023, 12:40 AM

Change 892583 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] switch os-reports.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/892583

gerritbot added a comment.Feb 28 2023, 12:41 AM

Change 892583 merged by Dzahn:

[operations/puppet@production] switch os-reports.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/892583

Dzahn updated the task description. (Show Details)Feb 28 2023, 12:42 AM
gerritbot added a comment.Feb 28 2023, 12:46 AM

Change 892584 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] switch research.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/892584

gerritbot added a comment.Feb 28 2023, 12:48 AM

Change 892584 merged by Dzahn:

[operations/puppet@production] switch research.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/892584

Dzahn updated the task description. (Show Details)Feb 28 2023, 12:51 AM
Maintenance_bot removed a project: Patch-For-Review.Feb 28 2023, 1:10 AM
gerritbot added a comment.Feb 28 2023, 10:53 PM

Change 893069 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] switch static-codereview.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/893069

gerritbot added a project: Patch-For-Review.Feb 28 2023, 10:53 PM

Change 893069 merged by Dzahn:

[operations/puppet@production] switch static-codereview.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/893069

Dzahn updated the task description. (Show Details)Feb 28 2023, 10:56 PM
gerritbot added a comment.Feb 28 2023, 11:06 PM

Change 893072 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] switch transparency-archive.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/893072

gerritbot added a comment.Feb 28 2023, 11:06 PM

Change 893072 merged by Dzahn:

[operations/puppet@production] switch transparency-archive.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/893072

Dzahn updated the task description. (Show Details)Feb 28 2023, 11:07 PM
Maintenance_bot removed a project: Patch-For-Review.Feb 28 2023, 11:11 PM
gerritbot added a comment.Feb 28 2023, 11:12 PM

Change 893073 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] switch transparency.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/893073

gerritbot added a project: Patch-For-Review.Feb 28 2023, 11:12 PM

Change 893073 merged by Dzahn:

[operations/puppet@production] switch transparency.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/893073

Dzahn updated the task description. (Show Details)Feb 28 2023, 11:13 PM
Stashbot added a comment.Feb 28 2023, 11:24 PM

Mentioned in SAL (#wikimedia-operations) [2023-02-28T23:24:16Z] <mutante> miscweb2002 rm -rf /srv/org/wikimedia/design/blog/ - this has moved to /srv/org/wikimedia/design-blog but was not deleted in codfw - bringing both to the same state before switching design.wikimedia.org over T330090

gerritbot added a comment.Feb 28 2023, 11:28 PM

Change 893078 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] switch design.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/893078

gerritbot added a comment.Feb 28 2023, 11:47 PM

Change 893078 merged by Dzahn:

[operations/puppet@production] switch design.wikimedia.org from eqiad to codfw

https://gerrit.wikimedia.org/r/893078

Dzahn updated the task description. (Show Details)Feb 28 2023, 11:49 PM
Dzahn mentioned this in T280247: Create WCQS UI microsite deployment.Mar 1 2023, 12:09 AM
Maintenance_bot removed a project: Patch-For-Review.Mar 1 2023, 12:10 AM
gerritbot added a comment.Mar 1 2023, 12:16 AM

Change 893086 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] remove commons-query virtual host from httpd on miscweb

https://gerrit.wikimedia.org/r/893086

gerritbot added a project: Patch-For-Review.Mar 1 2023, 12:16 AM
gerritbot added a comment.Mar 1 2023, 12:22 AM

Change 893087 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] httpbb/miscweb: add missing/new virtual hosts to tests

https://gerrit.wikimedia.org/r/893087

gerritbot added a comment.Mar 1 2023, 12:33 AM

Change 893087 merged by Dzahn:

[operations/puppet@production] httpbb/miscweb: add missing/new virtual hosts to tests

https://gerrit.wikimedia.org/r/893087

gerritbot added a comment.Mar 1 2023, 12:59 AM

Change 893090 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] switch (www).wikiworkshop.org from eqiad to codfw

https://gerrit.wikimedia.org/r/893090

gerritbot added a comment.Mar 1 2023, 12:59 AM

Change 893090 merged by Dzahn:

[operations/puppet@production] switch (www).wikiworkshop.org from eqiad to codfw

https://gerrit.wikimedia.org/r/893090

Dzahn added a comment.Mar 1 2023, 1:04 AM

switched today:

Dzahn updated the task description. (Show Details)Mar 1 2023, 1:05 AM
Dzahn closed this task as Resolved.Mar 1 2023, 2:11 AM

exceptions: iegreview, wdqs UI, everything else is switched.

gerritbot added a comment.Apr 3 2023, 7:06 PM

Change 905292 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] trafficserver/wdqs: switch query-preview.wikidata.org to new backend

https://gerrit.wikimedia.org/r/905292

gerritbot added a comment.Apr 3 2023, 9:32 PM

Change 905317 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] wdqs/wcqs: switch query.wikidata.org and wcqs to bullseye backends

https://gerrit.wikimedia.org/r/905317

gerritbot added a comment.Apr 3 2023, 9:46 PM

Change 905292 merged by Dzahn:

[operations/puppet@production] trafficserver/wdqs: switch query-preview.wikidata.org to new backend

https://gerrit.wikimedia.org/r/905292

Dzahn updated the task description. (Show Details)Apr 3 2023, 10:09 PM
gerritbot added a comment.Apr 4 2023, 5:21 PM

Change 893086 abandoned by Dzahn:

[operations/puppet@production] remove commons-query virtual host from httpd on miscweb

Reason:

what my intention was should be resolved by https://gerrit.wikimedia.org/r/c/operations/puppet/+/905317

https://gerrit.wikimedia.org/r/893086

gerritbot added a comment.Apr 4 2023, 7:52 PM

Change 905317 merged by Dzahn:

[operations/puppet@production] wdqs/wcqs: switch query.wikidata.org and wcqs to bullseye backends

https://gerrit.wikimedia.org/r/905317

Stashbot mentioned this in T331896: upgrade miscweb VMs to bullseye.Apr 4 2023, 7:55 PM

Mentioned in SAL (#wikimedia-operations) [2023-04-04T19:55:15Z] <mutante> https://query.wikidata.org and WCQS GUIs are switching to new backend VMs on bullseye in codfw T330090 T331896

Maintenance_bot removed a project: Patch-For-Review.Apr 4 2023, 8:11 PM
Dzahn updated the task description. (Show Details)Apr 4 2023, 8:37 PM

@LSobanski The following services have also switched to both codfw and bullseye today

https://query-preview.wikidata.org
https://query.wikidata.org
https://commons-query.wikimedia.org

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits