Page MenuHomePhabricator

Redesign and rebuild the wikireplicas service using a multi-instance architecture
Closed, ResolvedPublic

Description

In the interest of trying to keep or make the wikireplicas a performant and sustainable service, new backend architectures are needed. This task is to get to work designing and working on frontend and WMCS-supported scripting architectures to allow more backend flexibility with minimal loss of ease-of-use for end users of cloud services.

Since this task encompasses general access and orchestration, special access needs such as PAWS and Quarry, will need their own tasks, and there is probably room for a lot of other subtasks as well.

Details

ProjectBranchLines +/-Subject
operations/cookbooksmaster+0 -2
operations/puppetproduction+4 -36
operations/puppetproduction+13 -40
operations/puppetproduction+5 -0
operations/puppetproduction+16 -16
operations/puppetproduction+20 -8
operations/puppetproduction+6 -8
operations/puppetproduction+2 -2
operations/puppetproduction+920 -920
labs/toollabsmaster+1 -1
operations/puppetproduction+5 -1
operations/puppetproduction+61 -0
labs/privatemaster+30 -0
operations/puppetproduction+5 -2
operations/puppetproduction+34 -14
operations/puppetproduction+1 -1
operations/puppetproduction+51 -18
operations/puppetproduction+46 -18
operations/puppetproduction+254 -119
operations/puppetproduction+44 -1
operations/cookbooksmaster+1 -1
operations/cookbooksmaster+64 -0
operations/puppetproduction+4 -0
Show related patches Customize query in gerrit

Related Objects

StatusSubtypeAssignedTask
ResolvedMarostegui
ResolvedRobH
OpenNone
OpenNone
ResolvedBstorm
ResolvedBstorm
ResolvedMarostegui
ResolvedMarostegui
ResolvedMarostegui
ResolvedBstorm
ResolvedBstorm
ResolvedMoritzMuehlenhoff
ResolvedMarostegui
ResolvedMarostegui
ResolvedCmjohnson
Resolveddcaro
ResolvedMarostegui
ResolvedRequestwiki_willy
ResolvedRequestCmjohnson
ResolvedRequestCmjohnson
ResolvedRequestCmjohnson
ResolvedRequestCmjohnson
DeclinedNone
ResolvedKormat
ResolvedArielGlenn
ResolvedBstorm
DeclinedBstorm
ResolvedBstorm
ResolvedBstorm
ResolvedJhernandez
Resolvedrazzi
ResolvedMarostegui
ResolvedMilimetric
ResolvedBstorm
ResolvedBstorm
ResolvedBstorm
ResolvedBstorm
ResolvedBstorm
ResolvedAndrew
ResolvedBstorm
Resolvedayounsi
ResolvedJhernandez
ResolvedMarostegui
ResolvedRagesoss
ResolvedBstorm
ResolvedBstorm
ResolvedBstorm

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Now it actually works and might even be safe enough to do a PR with. It should work now since the DNS aliases already exist.
https://github.com/toolforge/paws/commit/b3a348a337af0f507bbcb3f87882671faf3c75d4

Doing the paws work on this ticket feels like it is burying things a bit. I'm going to open a separate ticket for the notes on my quarry work.

Bstorm renamed this task from Experiment with and design options for multi-instance or multi-section wikireplicas frontend architecture to Redesign and rebuild the wikireplicas service using a multi-instance architecture.Oct 29 2020, 7:14 PM

Ok, apparently mysqlproxy is smarter than I thought, and it can tell that I'm not pointing it at different IP addresses when I give it a list of different names that point at the same IP. As of now, the otherwise working code to connect in the new way is commented out. I may need to add another switch that generates the set of proxies when there are multiple proxy addresses to connect to. At very least, the code is all in place to do this now for PAWS.

Change 642503 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] wikireplicas: modify views scripts to work on any replica style

https://gerrit.wikimedia.org/r/642503

Change 642570 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] wikireplicas: extend maintain_dbusers to multiinstance replicas

https://gerrit.wikimedia.org/r/642570

Change 642503 merged by Bstorm:
[operations/puppet@production] wikireplicas: modify views scripts to work on any replica style

https://gerrit.wikimedia.org/r/642503

Change 642570 merged by Bstorm:
[operations/puppet@production] wikireplicas: extend maintain_dbusers to multiinstance replicas

https://gerrit.wikimedia.org/r/642570

Change 644949 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] wikireplicas: extend maintain_dbusers to multiinstance replicas

https://gerrit.wikimedia.org/r/644949

Change 644949 merged by Bstorm:
[operations/puppet@production] wikireplicas: extend maintain_dbusers to multiinstance replicas

https://gerrit.wikimedia.org/r/644949

Change 644950 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] wikireplicas: extend maintain_dbusers to multiinstance--test 2

https://gerrit.wikimedia.org/r/644950

Change 644950 merged by Bstorm:
[operations/puppet@production] wikireplicas: extend maintain_dbusers to multiinstance--test 2

https://gerrit.wikimedia.org/r/644950

Change 644952 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] wikireplicas: extend maintain_dbusers to multiinstance

https://gerrit.wikimedia.org/r/644952

Change 644952 merged by Bstorm:
[operations/puppet@production] wikireplicas: extend maintain_dbusers to multiinstance

https://gerrit.wikimedia.org/r/644952

Change 645173 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] wikireplicas: fix the harvest-replicas functionality

https://gerrit.wikimedia.org/r/645173

Change 645173 merged by Bstorm:
[operations/puppet@production] wikireplicas: fix the harvest-replicas functionality

https://gerrit.wikimedia.org/r/645173

Change 651857 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[labs/private@master] multiinstance proxies: workaround puppetdb not being in cloud

https://gerrit.wikimedia.org/r/651857

Change 651857 merged by Bstorm:
[labs/private@master] multiinstance proxies: workaround puppetdb not being in cloud

https://gerrit.wikimedia.org/r/651857

Change 627379 merged by Bstorm:
[operations/puppet@production] wikireplicas: Work toward a proxy setup on multi-instance replicas

https://gerrit.wikimedia.org/r/627379

Change 664860 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] wikireplicas: fix the centralauth management bit of the view scripts

https://gerrit.wikimedia.org/r/664860

Change 664860 merged by Bstorm:
[operations/puppet@production] wikireplicas: fix the centralauth management bit of the view scripts

https://gerrit.wikimedia.org/r/664860

Change 670907 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[labs/toollabs@master] wikireplicas: switch sql command to multiinstance replicas

https://gerrit.wikimedia.org/r/670907

Change 670907 merged by jenkins-bot:
[labs/toollabs@master] wikireplicas: switch sql command to multiinstance replicas

https://gerrit.wikimedia.org/r/670907

Change 683929 had a related patch set uploaded (by Bstorm; author: Bstorm):

[operations/puppet@production] wikireplicas: redirect all database CNAMEs to the new system

https://gerrit.wikimedia.org/r/683929

Change 683929 merged by Bstorm:

[operations/puppet@production] wikireplicas: redirect all database CNAMEs to the new system

https://gerrit.wikimedia.org/r/683929

Change 684999 had a related patch set uploaded (by Bstorm; author: Bstorm):

[operations/puppet@production] wikireplica-dns: fix typo

https://gerrit.wikimedia.org/r/684999

Change 684999 merged by Bstorm:

[operations/puppet@production] wikireplica-dns: fix typo

https://gerrit.wikimedia.org/r/684999

Change 685012 had a related patch set uploaded (by Bstorm; author: Bstorm):

[operations/puppet@production] wikireplica-dns: Add the outlier CNAMES and correct fqdn

https://gerrit.wikimedia.org/r/685012

Change 685012 merged by Bstorm:

[operations/puppet@production] wikireplica-dns: Add the outlier CNAMES and correct fqdn

https://gerrit.wikimedia.org/r/685012

Change 685109 had a related patch set uploaded (by Bstorm; author: Bstorm):

[operations/puppet@production] wikireplica-dns: Fix up the outlier dbs

https://gerrit.wikimedia.org/r/685109

Change 685109 merged by Bstorm:

[operations/puppet@production] wikireplica-dns: Fix up the outlier dbs

https://gerrit.wikimedia.org/r/685109

Change 685947 had a related patch set uploaded (by Bstorm; author: Bstorm):

[operations/puppet@production] wikireplicas: cut over the last IPs to the new cluster

https://gerrit.wikimedia.org/r/685947

Change 685947 merged by Bstorm:

[operations/puppet@production] wikireplicas: cut over the last IPs to the new cluster

https://gerrit.wikimedia.org/r/685947

Change 688368 had a related patch set uploaded (by Bstorm; author: Bstorm):

[operations/puppet@production] wikireplicas: remove the old wikireplicas role from the proxy

https://gerrit.wikimedia.org/r/688368

Change 688443 had a related patch set uploaded (by Bstorm; author: Bstorm):

[operations/puppet@production] wikireplicas: disable notifications on the old replica cluster

https://gerrit.wikimedia.org/r/688443

Change 688501 had a related patch set uploaded (by Bstorm; author: Bstorm):

[operations/puppet@production] wikireplicas-dns: condense repeated nodes for better failover

https://gerrit.wikimedia.org/r/688501

Change 688443 merged by Marostegui:

[operations/puppet@production] wikireplicas: disable notifications on the old replica cluster

https://gerrit.wikimedia.org/r/688443

Could the breakage of the Global User Contributions tool (GUC) be related to this? See T282557.

Change 688368 merged by Bstorm:

[operations/puppet@production] wikireplicas: remove the old wikireplicas profile from the proxy

https://gerrit.wikimedia.org/r/688368

Change 688501 merged by Bstorm:

[operations/puppet@production] wikireplicas-dns: condense repeated nodes for better failover

https://gerrit.wikimedia.org/r/688501

Change 704348 had a related patch set uploaded (by Nskaggs; author: Nskaggs):

[operations/cookbooks@master] Remove legacy wiki replicas

https://gerrit.wikimedia.org/r/704348

Change 704348 merged by jenkins-bot:

[operations/cookbooks@master] Remove legacy wiki replicas

https://gerrit.wikimedia.org/r/704348