Allocate service IPs for new wikireplicas setup
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• Bstorm
	Jan 22 2021, 4:53 PM

Description

In order to place the wikireplicas behind LVS, we need service IPs. Because cloud VMs must access them, they must be IPv4 and, I think, public.

We need two ips. One for the analytics service (which functionally will be at dbproxy1018) and one for the web service (dbproxy1019).

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	lvs101[46] - add cloud-support1-c-eqiad vlan	operations/puppet	production	+7 -0
	wikireplicas: set up LVS for multiinstance wikireplicas	operations/puppet	production	+337 -0

Customize query in gerrit

Related Objects
Search...

Status	Subtype	Assigned	Task
Resolved		Marostegui	T233766 labsdb1011 mariadb crashed
			Restricted Task
			Restricted Task
Open		None	T204950 Public Edit Data Lake: Mediawiki history snapshots available in SQL data store to cloud (labs) users
Open		None	T215858 Plan a replacement for wiki replicas that is better suited to typical OLAP use cases than the MediaWiki OLTP schema
Resolved		fnegri	T280152 Mitigate breaking changes from the new Wiki Replicas architecture
			Unknown Object (Task)
Resolved		RobH	T260441 (Need By: ASAP) rack/setup/install clouddb10[13-20]
Resolved		• Bstorm	T260389 Redesign and rebuild the wikireplicas service using a multi-instance architecture
Resolved		• Bstorm	T260843 Set up roles for new wiki replicas layout
Resolved		Marostegui	T265135 wikireplicas: Define MW sections per host
Resolved		Marostegui	T267090 Productionize clouddb10[13-20]
Resolved		Marostegui	T268312 Deploy labsdbuser and views to new clouddb hosts
Resolved		• Bstorm	T269200 Create end-user accounts on the new clouddb hosts
Resolved		• Bstorm	T269620 maintain-dbusers doesn't close connections right on harvest-replicas
Resolved		MoritzMuehlenhoff	T268725 Include mail on standard_packages.pp
Resolved		Marostegui	T268742 Test upgrading sanitarium hosts to Buster + 10.4
Resolved		Marostegui	T272008 Move wikireplicas under the new sanitarium hosts (db1154, db1155)
Resolved		• Cmjohnson	T272125 Memory errors on clouddb1019
Resolved		dcaro	T272127 2021-01-15: PROBLEM alert - labstore1004/Ensure mysql credential creation for tools users is running is CRITICAL
Resolved		Marostegui	T280492 Upgrade all sanitarium masters to 10.4 and Buster
Resolved	Request	wiki_willy	T281794 decommission db1082.eqiad.wmnet
Resolved	Request	• Cmjohnson	T281959 decommission db1074.eqiad.wmnet
Resolved	Request	• Cmjohnson	T282079 decommission db1079.eqiad.wmnet
Resolved	Request	• Cmjohnson	T282093 decommission db1087.eqiad.wmnet
Resolved	Request	• Cmjohnson	T282096 decommission db1085.eqiad.wmnet
Declined		None	T267376 Set up IP addresses for the new wiki replicas setup
Resolved		• Kormat	T268098 Make innodb_change_buffering configurable
Resolved		• Bstorm	T271476 Iron out issues in the proxy structure for multi-instance wikireplicas
Resolved		• Bstorm	T272720 Allocate service IPs for new wikireplicas setup

Event Timeline

• Bstorm created this task.Jan 22 2021, 4:53 PM

• Bstorm triaged this task as High priority.

• Bstorm added a parent task: T271476: Iron out issues in the proxy structure for multi-instance wikireplicas.

Change 655533 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] wikireplicas: set up LVS for multiinstance wikireplicas

https://gerrit.wikimedia.org/r/655533

gerritbot added a project: Patch-For-Review.Jan 22 2021, 4:57 PM

A quick look in phabricator didn't give me an example of a recent service IP allocation. Is that a netbox thing? Just a patch to ops/dns?

• Kormat unsubscribed.Jan 26 2021, 9:42 AM

Change 655533 merged by Bstorm:
[operations/puppet@production] wikireplicas: set up LVS for multiinstance wikireplicas

https://gerrit.wikimedia.org/r/655533

Maintenance_bot removed a project: Patch-For-Review.Jan 28 2021, 8:10 PM

Change 659439 had a related patch set uploaded (by BBlack; owner: BBlack):
[operations/puppet@production] lvs101[46] - add cloud-support1-c-eqiad vlan

https://gerrit.wikimedia.org/r/659439

gerritbot added a project: Patch-For-Review.Jan 28 2021, 10:09 PM

Change 659439 merged by BBlack:
[operations/puppet@production] lvs101[46] - add cloud-support1-c-eqiad vlan

https://gerrit.wikimedia.org/r/659439

FTR: Yes it was a netbox thing, and these are now created as:

https://netbox.wikimedia.org/ipam/ip-addresses/7652/
https://netbox.wikimedia.org/ipam/ip-addresses/7643/

We haven't dealt (yet) with setting up any matching IPv6!

Maintenance_bot removed a project: Patch-For-Review.Jan 28 2021, 11:10 PM

LSobanski subscribed.Feb 1 2021, 4:30 PM

I think this is done unless we want to add the ipv6 addresses now? The cloud is pretty far from supporting ipv6 at this time, unfortunately.

• Bstorm closed this task as Resolved.Feb 12 2021, 6:05 PM

• Bstorm claimed this task.