Page MenuHomePhabricator

Export Druid metrics and build a grafana dashboard
Closed, DuplicatePublic

Description

As far as I can see we use jmxtrans on druid nodes only for Zookeeper metrics, not for any Druid ones.

JMX Ports are already opened (just updated https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Ports#JMX) but from druid.io/docs/latest/operations/metrics.html it seems that we'd have two options:

  1. build a prometheus druid metrics exporter (polling druid's http api periodically)
  2. export only jmx jvm metrics via jmxtrans or prometheus-jmx-exporter

I'd be in favor of having a complete dashboard with Druid metrics.

Event Timeline

elukey created this task.Sep 8 2017, 10:02 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 8 2017, 10:02 AM
fdans moved this task from Incoming to Backlog (Later) on the Analytics board.Sep 21 2017, 4:43 PM