Page MenuHomePhabricator

Allow analytics VLAN to reach all eventgate instances in all DCs
Closed, ResolvedPublic

Description

In T251609 we are going to automate sending canary events into event streams. This will let us differentiate between cases where there are just no events in a stream, vs when the pipeline is broken. It will also help us understand when all events for an hour have been imported.

We are only planning to do this for analytics events for now, but would also like to eventually do so with production ones...although we're not quite sure how yet.

In order to do this, we need to be able to POST the canary events into all the EventGate instances. We'll likely run the job that posts the events in the Analytics VLAN, so we need to be able to access them.

We've done this for eventgate-analytics in T228882, we just need to expand to all the other EventGates.

Please allow:

Portsvc names
4392eventgate-logging-external.{eqiad,codfw}.svc.wmnet
4492eventgate-main.{eqiad,codfw}.svc.wmnet
4592eventgate-analytics.{eqiad,codfw}.svc.wmnet
4692eventgate-analytics-external.{eqiad,codfw}.svc.wmnet

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Change 622705 had a related patch set uploaded (by Elukey; owner: Elukey):
[operations/homer/public@master] Add terms for eventgate endpoints to the analyitcs-in4 filter

https://gerrit.wikimedia.org/r/622705

Change 622705 merged by Elukey:
[operations/homer/public@master] Add terms for eventgate endpoints to the analyitcs-in4 filter

https://gerrit.wikimedia.org/r/622705

Just deployed the changes, lemme know if everything works as expected!

Milimetric claimed this task.
Milimetric added a project: Analytics-Kanban.
Milimetric moved this task from Next Up to Done on the Analytics-Kanban board.