Porting the analytics EventLogging processes running on eventlog1001 from analytics Kafka to jumbo-eqiad Kafka should be relatively simple, so let's do it soon.
Steps
Preparation:
- Create eventlogging-client-side and eventlogging-valid-mixed topics in jumbo-eqiad Kafka.
- add ACLs for User:CN=varnishkafka to write to eventlogging-client-side via TLS, deny ANONYMOUS
- Configure 2nd EventLogging Camus job to consume from jumbo-eqiad Kafka: https://gerrit.wikimedia.org/r/#/c/417321/
- refactor role::cache::kafka::eventlogging into profile
Do it:
- Configure varnishkafka eventlogging to use jumbo-eqiad Kafka and restart varnishkafka eventlogging processes: https://gerrit.wikimedia.org/r/#/c/417319/
- Let EventLogging and webperf consume and process all remaining events in eventlogging-client-side topic in analytics Kafka.
- Configure EventLogging and webperf processes to use jumbo-eqiad Kafka: https://gerrit.wikimedia.org/r/#/c/404773/
- Edit burrow configs to monitor consumer groups in jumbo-eqiad: https://gerrit.wikimedia.org/r/#/c/419482/
Clean up:
- Clean up old eventlogging Camus job for Kafka analytics: https://gerrit.wikimedia.org/r/#/c/419498/
- Configure EventLogging analytics grafana dashboards to use jumbo-eqiad.