Update sqoop to work with multi-instance clouddb1021 mariadb host
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• razzi
	Feb 13 2021, 12:03 AM

Description

Sqoop currently uses multi-source labsdb1012 as its datasource. We are migrating to a multi-instance configuration and will need to update sqoop to access the different instances on their different ports.

Details

	Subject	Repo	Branch	Lines +/-
	Update mysql resolver to work with cloud replicas	analytics/refinery	master	+39 -29

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	Marostegui	T233766 labsdb1011 mariadb crashed
		Restricted Task
		Restricted Task
		Unknown Object (Task)
Resolved	RobH	T260441 (Need By: ASAP) rack/setup/install clouddb10[13-20]
Open	None	T215858 Plan a replacement for wiki replicas that is better suited to typical OLAP use cases than the MediaWiki OLTP schema
Open	None	T280152 Mitigate breaking changes from the new Wiki Replicas architecture
Resolved	Bstorm	T260389 Redesign and rebuild the wikireplicas service using a multi-instance architecture
Resolved	• razzi	T269211 Convert labsdb1012 from multi-source to multi-instance
Resolved	Milimetric	T274690 Update sqoop to work with multi-instance clouddb1021 mariadb host

Event Timeline

• razzi created this task.Feb 13 2021, 12:03 AM

Restricted Application removed a project: Patch-For-Review. · View Herald TranscriptFeb 13 2021, 12:03 AM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

• razzi mentioned this in T269211: Convert labsdb1012 from multi-source to multi-instance.Feb 13 2021, 12:11 AM

Milimetric claimed this task.Feb 22 2021, 7:49 PM

Milimetric triaged this task as High priority.

Milimetric added a project: Analytics-Kanban.

Milimetric moved this task from Next Up to In Progress on the Analytics-Kanban board.

Change 666209 had a related patch set uploaded (by Milimetric; owner: Milimetric):
[analytics/refinery@master] [WIP] Update mysql resolver to work with cloud db replicas

https://gerrit.wikimedia.org/r/666209

gerritbot added a project: Patch-For-Review.Feb 22 2021, 9:28 PM

RhinosF1 subscribed.Mar 4 2021, 6:21 PM

Milimetric moved this task from In Progress to In Code Review on the Analytics-Kanban board.Mar 8 2021, 5:22 PM

Ottomata removed a project: Analytics-Clusters.Mar 9 2021, 5:19 PM

Change 666209 merged by Mforns:

[analytics/refinery@master] Update mysql resolver to work with cloud replicas

https://gerrit.wikimedia.org/r/666209

Milimetric moved this task from In Code Review to Done on the Analytics-Kanban board.Apr 5 2021, 2:49 PM

• fdans closed this task as Resolved.Apr 8 2021, 4:24 PM