In Q2-Q4 FY2019-2020, Analytics Engineering will collaborate with Product Infrastructure to develop tooling to use Modern Event Platform components for instrumenting client side features. To do this, they will need a publicly POST-able EventGate endpoint.
The eventgate-analytics service is already handling internal 'analytics' events from Mediawiki server side: mediawiki/cirrussearch-request and mediawiki/api-request. These event streams are relatively high volume.
We will set up a new eventgate-analytics-external instance, exposed at intake-analytics.wikimedia.org, to serve events from external clients.
See also the [[ https://docs.google.com/document/d/1dpCo33RpZAbQG15nM_GcZ_zqA3sj0S4h_0CQ4Fsahkg/edit# | Event Platform - Produce Usage design document ]].
* Name - eventgate-analytics-external, routed externally from intake-analytics.wikimedia.org
* Description - Validates and produces events to Kafka
* Timeline - Q3 2019-2020
* Point person - Andrew Otto
* Technologies - [[ https://github.com/wikimedia/eventgate | EventGate ]]
Additionally, {T236386} is also a separate publicly POST-able instance of EventGate.
Helm & k8s:
[x] [[ https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/563211 | helmfile and chart change ]]
[x] k8s namespaces - @akosiaris
[x] [[ https://wikitech.wikimedia.org/wiki/User:Giuseppe_Lavagetto/Add_Tls_On_Kubernetes | Add ]] eventgate-analytics-external TLS certs
[x] Deploy eventgate-analytics-external
LVS, Discovery, frontend routing:
[x] [[ https://gerrit.wikimedia.org/r/c/operations/puppet/+/573366 | Discovery puppet config ]]
[x] [[ https://gerrit.wikimedia.org/r/c/operations/dns/+/573362 | eventgate-analytics-external.svc DNS entries ]]
[x] [[ https://gerrit.wikimedia.org/r/c/operations/puppet/+/573365 | LVS puppet config ]]
[x] [[ https://gerrit.wikimedia.org/r/c/operations/puppet/+/576431 | LVS monitor_services check ]]
[] [[ https://gerrit.wikimedia.org/r/c/operations/dns/+/573367 | Discovery DNS entries ]]
[x] [[ https://gerrit.wikimedia.org/r/c/operations/dns/+/556411 | intake.wikimedia.org DNS entry ]]
[] [[ https://gerrit.wikimedia.org/r/c/operations/puppet/+/573369 | Frontend routing ]] from intake-analytics.wikimedia.org -> eventgate-analytics-external.discovery.wmnet:4692