Change 618069 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] grafana: temp disable grafana db sync ahead of upgrade

https://gerrit.wikimedia.org/r/618069

I started looking into this. The upgrade itself seems to work fine, however we'll have to ship the https://github.com/grafana/grafana-image-renderer (GIR) if we want to be able to export/share static images. GIR installed via grafana-cli plugins install grafana-image-renderer means having an embedded copy of chromium (leaving aside the fact that we'll have to ship the plugin offline, packaged somehow) which I don't think we really want to do.

Other options as I see them:

1. Use GIR releases without chromium (but already built), e.g. at https://github.com/grafana/grafana-image-renderer/releases/download/v2.0.0/plugin-linux-x64-glibc-no-chromium.zip (and packaged)
2. Build GIR without chromium ourselves (haven't tried yet) (and packaged)

Soon we'll have Chromium embedded in bootloaders as well...

What is the difference of GIR releases without chromium compared to what grafana-cli would fetch/install? Does it lose some functionablity?

One option for deploying the Grafana plugin(s) (in case more are expected) is a similar approach to the Elastic plugins maybe?

AFAICT there's no difference in the plugin's functionality, GIR has support for using the system's chromium instead of the embedded one (assuming the chromium's version are compatible)

Yes we could ship the plugin offline similarly to what we do with Elastic; we have one more plugin ATM that we ship via scap (operations/software/grafana/simple-json-datasource) although I think switching to Debian packages and ship all plugins would be more convenient

Using the chromium package as packaged in Debian sounds good to me, the only risk is that new versions potentially break the headless setup (but in that case Grafana would also need to update their packages, so seems manageable).

I gave the Debian-shipped Chromium a try but to not avail, will be using the plugin-provided Chromium instead

Change 618953 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/debs/grafana-plugins@master] Debian packaging for Grafana plugins

https://gerrit.wikimedia.org/r/618953

Change 618069 merged by Filippo Giunchedi:
[operations/puppet@production] grafana: temp disable grafana db sync ahead of upgrade

https://gerrit.wikimedia.org/r/618069

Change 619451 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] profile: switch Grafana plugins to Debian package

https://gerrit.wikimedia.org/r/619451

Change 618953 merged by Filippo Giunchedi:
[operations/debs/grafana-plugins@master] Debian packaging for Grafana plugins

https://gerrit.wikimedia.org/r/618953

Change 620663 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] hieradata: switch grafana.w.o to Grafana 7

https://gerrit.wikimedia.org/r/620663

cc cloud-services-team, as heads up I'd like to upgrade https://grafana-labs.wikimedia.org/ (i.e. cloudmetrics) to Grafana 7 ASAP.

Unless there are objections? There's a production instance available at https://grafana-next.wikimedia.org which so far hasn't yield any complaints

Change 619451 merged by Filippo Giunchedi:
[operations/puppet@production] profile: switch Grafana plugins to Debian package

https://gerrit.wikimedia.org/r/619451

Mentioned in SAL (#wikimedia-operations) [2020-08-19T07:46:17Z] <godog> upgrade to grafana 7 on cloudmetrics hosts - T259143

Change 621197 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] hieradata: disable panel html sanitization for grafana-labs

https://gerrit.wikimedia.org/r/621197

Change 620663 merged by Filippo Giunchedi:
[operations/puppet@production] hieradata: switch grafana.w.o to Grafana 7

https://gerrit.wikimedia.org/r/620663

Mentioned in SAL (#wikimedia-operations) [2020-08-19T08:20:29Z] <godog> switch grafana.w.o to grafana 7 in codfw - T259143

Woho, the new 7 looks great. One thing: before the plugin grafana-piechart-panel was installed by default, that seems to be missing now. You can see that here (scroll down): https://grafana.wikimedia.org/d/cZgMg49Wz/performance-summary?orgId=1

In T259143#6395854, @Peter wrote:

Woho, the new 7 looks great. One thing: before the plugin grafana-piechart-panel was installed by default, that seems to be missing now. You can see that here (scroll down): https://grafana.wikimedia.org/d/cZgMg49Wz/performance-summary?orgId=1

Interesting, I'll add the plugin to our grafana-plugins package. I can't find traces of that plugin in puppet, I'm guessing it was installed manually

Change 621255 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/debs/grafana-plugins@master] Add grafana-piechart-panel

https://gerrit.wikimedia.org/r/621255

Change 621255 merged by Filippo Giunchedi:
[operations/debs/grafana-plugins@master] Add grafana-piechart-panel

https://gerrit.wikimedia.org/r/621255

In T259143#6396198, @fgiunchedi wrote:

In T259143#6395854, @Peter wrote:

Woho, the new 7 looks great. One thing: before the plugin grafana-piechart-panel was installed by default, that seems to be missing now. You can see that here (scroll down): https://grafana.wikimedia.org/d/cZgMg49Wz/performance-summary?orgId=1

Interesting, I'll add the plugin to our grafana-plugins package. I can't find traces of that plugin in puppet, I'm guessing it was installed manually

Package upgraded, I can see the piecharts now

Change 621472 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] grafana: remove deprecated settings

https://gerrit.wikimedia.org/r/621472

Change 621197 merged by Filippo Giunchedi:
[operations/puppet@production] hieradata: disable panel html sanitization for grafana-labs

https://gerrit.wikimedia.org/r/621197

Change 621472 merged by Filippo Giunchedi:
[operations/puppet@production] grafana: remove deprecated settings

https://gerrit.wikimedia.org/r/621472

Change 622610 had a related patch set uploaded (by Cwhite; owner: Cwhite):
[operations/puppet@production] profile: re-enable grafana rsync codfw->eqiad

https://gerrit.wikimedia.org/r/622610

Change 622610 merged by Filippo Giunchedi:
[operations/puppet@production] profile: re-enable grafana rsync codfw->eqiad

https://gerrit.wikimedia.org/r/622610

Change 627515 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] grafana: switch to eqiad

https://gerrit.wikimedia.org/r/627515

Change 627515 merged by Filippo Giunchedi:
[operations/puppet@production] grafana: switch to eqiad

https://gerrit.wikimedia.org/r/627515

Mentioned in SAL (#wikimedia-operations) [2020-09-15T14:53:41Z] <godog> switch grafana to eqiad - T259143