Page MenuHomePhabricator

Access to prod mysql from stat1004
Closed, ResolvedPublic

Description

Hi,

I'm working on a project (T265722: New Service Request: Sockpuppet Detection) that requires moving data from stat1004.eqiad.wmnet into a prod mysql host (m2-master.eqiad.wmnet).

The data we would like to ingest in mysql is generated by a spark job, and contains aggregated user edit counts. For the time being this data movement will be orchestrated manually.

I'm aware there's a firewall in between the two, and I was wondering if you could advise about the best way to move forward. Would it be possible to pierce the firewall to allow access?

Related phabricator tasks:

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Change 649706 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/homer/public@master] Allow connections to dbproxy101[3,5]:3306 in the analytics-in4 filter

https://gerrit.wikimedia.org/r/649706

@gmodena just to confirm what was agreed at T268505#6660388 about throttling writes is still happening, right?

Hey @Marostegui thanks for checking. We'll do batch inserts and throttle writes.

Excellent - thanks for confirming. Also if you can ping me here once you've done the first batch, that'd be helpful. I would like to check our graphs to see what was the impact.
Thanks!

Change 649706 merged by Elukey:
[operations/homer/public@master] Allow connections to dbproxy101[3,5]:3306 in the analytics-in4 filter

https://gerrit.wikimedia.org/r/649706

Change deployed!

elukey@stat1004:~$ telnet m2-master.eqiad.wmnet 3306
Trying 10.64.0.135...
Connected to dbproxy1013.eqiad.wmnet.
elukey claimed this task.