Seems that since we control most kafka consumers we should not allow consumers to consume with " too old protocols " if possible. Seems that the translations among protocols is costly for kafka and part of the cause of the OOMs we were seeing.
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | elukey | T219842 [Post-mortem] Kafka Jumbo cluster cannot accept connections | |||
| Resolved | Ottomata | T219936 Investigate if kafka can decline requests to consume from consumers that support an older protocol |
Event Timeline
Comment Actions
Of interest: https://github.com/apache/kafka/blob/0.10.0/core/src/main/scala/kafka/server/KafkaApis.scala#L436
I think the magic byte is what triggers the conversion among api versions
Comment Actions
Until we get rid of Camus, we can't restrict old client versions. Camus uses a 0.8 client. :/