We are currently deploying 1.3.1 on Buster, but we have 1.6.0 on Bullseye. From 1.5.0+ IIUC (https://github.com/edenhill/kafkacat/releases/tag/1.5.0) there is a new handy option:
kafkacat -C -b kafka-jumbo1001.eqiad.wmnet -t eqiad.resource-purge -o s@1601425805519
The offset is an epoch timestamp, and it can state the start (s) or end (s). Could it be possible to backport 1.6.0 to Buster-backports, and if not feasible, to buster-wikimedia?
This is definitely doable, but needs at least one change: The Bullseye version of the package depends on librdkafka1 >= 1.4.2, which Buster doesn't have. I've done a quick munge of the source package and it looks like building against the librdkafka available on Buster (0.11.5) works fine:
dpkg --info kafkacat_1.6.0-1_amd64.deb
new Debian package, version 2.0.
size 29164 bytes: control archive=924 bytes.
888 bytes, 21 lines control
402 bytes, 6 lines md5sums
Package: kafkacat
Version: 1.6.0-1
Architecture: amd64
Maintainer: Vincent Bernat <bernat@debian.org>
Installed-Size: 81
Depends: libavro23, libc6 (>= 2.14), librdkafka1 (>= 0.11.5), libyajl2 (>= 2.0.4)
Section: net
Priority: optional
Homepage: https://github.com/edenhill/kafkacat
Description: generic producer and consumer for Apache Kafka
kafkacat is a generic non-JVM producer and consumer for Apache Kafka
0.8, think of it as a netcat for Kafka.
.
In producer mode kafkacat reads messages from stdin, delimited with a
configurable delimiter and produces them to the provided Kafka
cluster, topic and partition. In consumer mode kafkacat reads messages
from a topic and partition and prints them to stdout using the
configured message delimiter.
.
kafkacat also features a Metadata list mode to display the current
state of the Kafka cluster and its topics and partitions.Package is backported and uploaded to reprepro/aptx00y and updated on all stats100x machines.