Page MenuHomePhabricator

Backport? and install kafkacat (on stat1002?)
Closed, ResolvedPublic

Description

Some users use their own udp2log instances to consume the udp2log webrequest firehose. It would be nice if they had a better way to do this, using kafkacat.

Along the way, consider including some wrapper scripts in the kafkacat package to make consuming full and/or multiple topics with all partitions easy.

Details

Related Gerrit Patches:
operations/puppet : productionInstall kafkacat on analytics clients

Event Timeline

Ottomata created this task.May 1 2015, 2:27 PM
Ottomata claimed this task.
Ottomata raised the priority of this task from to Medium.
Ottomata updated the task description. (Show Details)
Ottomata added subscribers: gerritbot, Ottomata, Aklapper.
faidon added a subscriber: faidon.May 1 2015, 6:59 PM

kafkacat is already packaged in Debian unstable. It will probably go in to jessie-backports soon.

We'd just need to build it for the other distributions we support, if needed.

Oo! Didn't realize. Awesome!

Ottomata renamed this task from Package kafkacat to Backport? and install kafkacat (on stat1002?).May 1 2015, 7:04 PM
Ottomata set Security to None.

Change 214068 had a related patch set uploaded (by Ottomata):
Install kafkacat on analytics clients

https://gerrit.wikimedia.org/r/214068

Change 214068 merged by Ottomata:
Install kafkacat on analytics clients

https://gerrit.wikimedia.org/r/214068

Ottomata closed this task as Resolved.May 27 2015, 4:22 PM