Page MenuHomePhabricator
Create Task
Maniphest T222102

prometheus: usable dashboard for meta-metrics about Prometheus itself (query durations etc)
Closed, ResolvedPublic
Actions

Description

(part of https://wikitech.wikimedia.org/wiki/Incident_documentation/20190425-prometheus)

The dashboard that does exist seems to date from prometheus 1.x days -- most of the graphs are not populated. The ones that are there are not the most useful. (Part of this task is to figure out which graphs are useful to include.)

There's also no differentiation between each of the backing prometheus servers, which would be useful when debugging prometheus issues.

Event Timeline

CDanis created this task.Apr 29 2019, 7:45 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 29 2019, 7:45 PM
CDanis updated the task description. (Show Details)Apr 29 2019, 7:46 PM
CDanis moved this task from Active investigation to Follow-up prevention on the Wikimedia-Incident board.Apr 29 2019, 8:54 PM
Dzahn triaged this task as Medium priority.Apr 30 2019, 9:40 PM
fgiunchedi subscribed.Aug 19 2019, 1:03 PM

I've imported a Prometheus dashboard with 2.x stats and replaced the previous one: https://grafana.wikimedia.org/d/GWvEXWDZk/prometheus-server

There's no drill down per prometheus server instance yet, although metrics are there

Krinkle edited projects, added Sustainability (Incident Followup); removed Wikimedia-Incident.Apr 28 2020, 9:50 PM
fgiunchedi moved this task from Inbox to Backlog on the observability board.Jul 6 2020, 12:05 PM
lmata edited projects, added SRE Observability; removed observability.Jul 12 2021, 2:21 AM
lmata moved this task from Inbox to Backlog on the SRE Observability board.Jul 15 2021, 4:09 AM
lmata edited projects, added Observability-Metrics; removed SRE Observability.Aug 9 2021, 2:32 AM
fgiunchedi closed this task as Resolved.Feb 7 2022, 4:32 PM
fgiunchedi claimed this task.

The dashboard at https://grafana.wikimedia.org/d/GWvEXWDZk/prometheus-server now allows selecting each Prometheus server:port. Tentatively resolving but please reopen if sth is amiss!

lmata moved this task from Inbox to Done on the Observability-Metrics board.Jan 16 2023, 5:42 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL