Page MenuHomePhabricator

The WDQS streaming updater should support connecting to kafka with SSL
Open, MediumPublic

Description

The way we configure the kafka consumer assume that we pass the PLAINTEXT port.
We should have a way to configure the security protocol to use when connecting to a kafka broker.

Multiple options:

  • infer this from the port, 9092->PLAINTEXT, 9093 -> SSL
  • accept URI like brokers: ssl://IP:PORT, plaintext://IP:PORT
  • separate config option, broker_security_protocol

AC:

  • the streaming updater is able to connect to kafka using the SSL protocol