Page MenuHomePhabricator

Upgrade grafana to 6.1
Open, Needs TriagePublic

Description

Grafana 6 adds a bunch of cool new stuff:

  • "Explore", a UI for playing around with monitoring data, and for exploring what metrics are in Prometheus. It looks ideal for either constructing queries for a new console, or for doing incident response across multiple systems (and then linking in your postmortem). https://grafana.com/docs/features/explore/
  • "ad hoc filtering for Prometheus", which looks like a big improvement on the template variable stuff we do on many consoles right now. https://grafana.com/docs/guides/whats-new-in-v6-1/
  • better panel editor UI

Things to watch out for per https://grafana.com/docs/installation/upgrading/#upgrading-to-v6-0

Plan is similar to last time:

  • create new Ganeti VM grafana1002.eqiad.wmnet -- will attempt using the new automation for such, and probably also try using buster
  • point grafana-beta.wikimedia.org to that host
  • copy a snapshot of the database and ask the same groups as in T210416 to test
  • pick a time to make -beta the new normal (should be just a few minutes of readonly)

Fundraising firewall should not be a concern this time as they have their own grafana now.

It's also worth looking at testing the upgrade on grafana-labs if they're interested

Related Objects

Event Timeline

CDanis created this task.Apr 12 2019, 4:55 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 12 2019, 4:55 PM
CDanis updated the task description. (Show Details)Apr 15 2019, 3:15 PM
CDanis moved this task from Backlog to Up next on the observability board.Apr 29 2019, 3:16 PM
Peter added a subscriber: Peter.Fri, Jun 14, 5:05 AM
Peter added a comment.Fri, Jun 14, 5:10 AM

If we could upgrade to 6.2.x that would be great. I've been using it for my projects for a while and the lazy loading of panels out of view really makes large dashboards working better (and faster). We have a couple of dashboards in the performance team that are really slow.