Page MenuHomePhabricator

Consider donating our time to enhance the official OpenSearch Prometheus exporter
Open, LowPublic5 Estimated Story Points

Description

The official OpenSearch Prometheus exporter is implemented as an OpenSearch plugin, and as such it is written in Java. We've opted to use this exporter for the OpenSearch on K8s project (T362105) as it integrates well with the deployment.

However, it does lack features that are available in our custom Python exporter , specifically the ability to bucket requests by latency. The latency buckets are pretty important metrics and we use them to great effect on our production OpenSearch clusters.

Creating this ticket to:

  • List all metrics that exist in our custom exporter that do not exist in the official exporter.
  • Ask the Search Platform team if they would be willing to port some or all of these metrics to the official exporter.
  • Ask the OpenSearch developers if they would be willing to accept these enhancements.

We can create a separate ticket for the actual work if/when we have consent from the above stakeholders.

Event Timeline

The latency buckets might be a little harder to upstream, but still possible. The latency buckets require special data collection implemented in our opensearch-extra plugin. Totally possible, but means upstreaming to both the main opensearch project and then the exporters once the data is available. It might require a slight re-architecture of the latency collection depending on what upstream thinks of the current implementation. We did propose this to ElasticSearch back in the day and they gave advise for implementing the latency bucket collectoin, but weren't interested in upstreaming.

pfischer set the point value for this task to 5.Jan 26 2026, 4:38 PM