Change Propagation produces statsd metrics but non of them, afaics, are related to node-rdkafka. I would be interesting to have Kafka Consumer/Producer-level specific metrics to triage/debug performance problems when they happens.
It should be as simple as using https://github.com/wikimedia/node-rdkafka-statsd
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | akosiaris | T338357 Pushing jobs to jobqueue is slow again | |||
| Open | None | T341661 Add node-rdkafka metrics for changeprop |
As far as I can read from T145099#2738967 it should be sufficient to add the node-rdkafka-statsd package and the necessary kafkaConsumer configuration to start emitting some kafka metrics. It would be nice to know the latency between changeprop and kafka main's brokers for example.