EventGate app configs currently use a single kafka.conf for both producer types. Since the hasty producer does not wait on a delivery report before finishing the HTTP response, it can use a much higher value of queue.buffering.max.ms. However a longer queue.buffering.max.ms will cause a the guaranteed producer to likely block for about that amount of time. We should set the hasty producer with a high value, and the guaranteed producer with a lower value.
Customize query in gerrit
|operations/deployment-charts||master||+16 -6||eventgate-analytics - use different batch settings for kafka producers|
|Resolved||odimitrijevic||T185233 Modern Event Platform|
|Resolved||Ottomata||T201068 Modern Event Platform: Stream Intake Service|
|Resolved||Ottomata||T206785 Modern Event Platform: Stream Intake Service (EventGate): Implementation|
|Resolved||Ottomata||T219032 EventGate should be able to configure hasty and guaranteed kafka producers individually|