Page MenuHomePhabricator

Prometheus exporter for ArcLamp
Open, Needs TriagePublic

Description

We need monitoring for the ArcLamp pipeline.

My current plan for this is to have the script output a static file in OpenMetrics (Prometheus) format, with runtime and item statistics, and then scrape it from the same place we serve the processed data (currently a static directory, soon Swift).

Event Timeline

dpifke created this task.Mon, Jun 22, 5:59 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMon, Jun 22, 5:59 PM
dpifke moved this task from Inbox to Doing on the Performance-Team board.Mon, Jun 22, 5:59 PM

For what is worth this LGTM. If I understand correctly ArcLamp frontend/proxy would serve /metrics (or equivalent) by reading said file ?

For completeness: another solution would be the Prometheus Push Gateway (T249311: Deploy Prometheus Push Gateway) although that's not deployed yet