Page MenuHomePhabricator

Deploy and document a method to dump logs from logstash
Open, MediumPublic

Description

We want to have a simple way for users with read access to logs-api.svc to be able to dump logs for further processing/analyzing/etc.

Requirements:

  • We want to be able to dump results from a specific logstash.w.o dashboard, in other words extract the query from the dashboard and pass it to the script
  • We want to be able to also run against ad-hoc queries (e.g. selecting the time span, indices, and the query itself)
  • Output format should be at least NDJSON and CSV

Event Timeline

Opensearch reporting https://docs.opensearch.org/docs/latest/reporting/report-dashboard-index/ (already in place) checks each of these boxes with the exception of NDJSON.

Out of curiosity was there a case where reports didn't generate the export needed? If so what was missing?