Change 310557 had a related patch set uploaded (by Filippo Giunchedi):
prometheus: add varnish_exporter

https://gerrit.wikimedia.org/r/310557

Change 310557 merged by Filippo Giunchedi:
prometheus: add varnish_exporter

https://gerrit.wikimedia.org/r/310557

I went over the ganglia rrds updated in the last 30d in P4571 and audited their origin and what to do, see task description.

There is no reason to duplicate elasticsearch metrics in both graphite and prometheus. Let's just not port those metrics.

@hashar re: the jenkins stats in ganglia in P4571 are they all/some in graphite already?

The Jenkins metrics from P4571 can all be dropped. They are irrelevant to our setup:

The number of jobs per status, we do not use a linear build history since jobs are used to test random patch having random parents. So those are unneeded:

jenkins_jobs_aborted.rrd
jenkins_jobs_blue.rrd
jenkins_jobs_disabled.rrd
jenkins_jobs_grey.rrd
jenkins_jobs_notbuilt.rrd
jenkins_jobs_red.rrd
jenkins_jobs_total.rrd
jenkins_jobs_yellow.rrd

Then there are stats related to the queue/business. That is replaced by metrics from the CI systems that drive Jenkins (Zuul/Nodepool) eg the pool business https://grafana.wikimedia.org/dashboard/db/nodepool?panelId=1&fullscreen and the Gearman queues on https://grafana.wikimedia.org/dashboard/db/releng-zuul

jenkins_overallload_busy_executors.rrd
jenkins_overallload_queue_length.rrd
jenkins_overallload_total_executors.rrd

So in short: we can drop all of those. What would be interested though is to get Prometheus to monitor some statsd metric and alarms when some threshold pass. Then Grafana 4 seems to have such support so maybe that is redundant with Prometheus.

Change 331097 had a related patch set uploaded (by Filippo Giunchedi):
ganglia: display deprecation banner

https://gerrit.wikimedia.org/r/331097

Change 331097 merged by Dzahn:
ganglia: display deprecation banner

https://gerrit.wikimedia.org/r/331097

Ganglia now shows a deprecation banner.

Mentioned in SAL (#wikimedia-operations) [2017-02-01T00:57:48Z] <mutante> Ganglia is now deprecated in favor of Grafana (https://phabricator.wikimedia.org/T145659#2925104)

Change 355741 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] stop using exim4::ganglia

https://gerrit.wikimedia.org/r/355741

I uploaded a patch to stop using exim4::ganglia plugin when i saw it play a role in the spam-from-labs issue in T166322. Then i saw this ticket has the open check box for exim after that. So it seems we don't have a replacement for these yet, right? (the exim stats are hard to see in ganglia web ui because you have to click "no_group metrics" first.

@Dzahn correct there's no replacement yet, the easiest ATM is likely to use extendedeximcollector for diamond we already use in toollabs

Change 355741 abandoned by Dzahn:
stop using exim4::ganglia

https://gerrit.wikimedia.org/r/355741

Resolving as the work will be completed in T177196 by porting the missing Diamond collectors.

@fgiunchedi I was wondering if there is something here that replaces the PacketLossLogtailer from udp2log (https://gerrit.wikimedia.org/r/#/c/382913/) .. udp2log is on the way out too, right, Ottomata said +1 to remove it i see

@Dzahn not afaik, though as you said udp2log is on its way out so we can live without packetlosslogtailer IMO