Port varnish metrics from ganglia to prometheus
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	fgiunchedi
	Oct 5 2016, 2:01 PM

Description

Deploy varnish_exporter for frontend/backend varnish, plus related prometheus configuration changes.

Details

Subject	Repo	Branch	Lines +/-
prometheus: add aggregation rules for varnish_exporter	operations/puppet	production	+13 -0
prometheus: add varnish_exporter to all varnishes	operations/puppet	production	+9 -8
prometheus: extend Varnish targets generation to text/upload	operations/puppet	production	+10 -0
site: add varnish_exporter to esams/eqiad maps/misc	operations/puppet	production	+4 -4
prometheus: generate Varnish targets	operations/puppet	production	+37 -0
prometheus: generate varnish targets from get_clusters()	operations/puppet	production	+86 -1

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		fgiunchedi	T145659 Port application-specific metrics from ganglia to prometheus
		Resolved		fgiunchedi	T147424 Port varnish metrics from ganglia to prometheus

Event Timeline

fgiunchedi created this task.Oct 5 2016, 2:01 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 5 2016, 2:01 PM

Change 310819 had a related patch set uploaded (by Filippo Giunchedi):
prometheus: generate varnish targets from conftool

https://gerrit.wikimedia.org/r/310819

gerritbot added a project: Patch-For-Review.Oct 5 2016, 2:02 PM

fgiunchedi added a project: Traffic.Oct 5 2016, 2:21 PM

• ema moved this task from Backlog to Caching on the Traffic board.Oct 6 2016, 8:25 AM

Change 315098 had a related patch set uploaded (by Filippo Giunchedi):
[WIP] prometheus: generate Varnish targets

https://gerrit.wikimedia.org/r/315098

Change 310819 merged by Filippo Giunchedi:
prometheus: generate varnish targets from get_clusters()

https://gerrit.wikimedia.org/r/310819

Change 315098 merged by Filippo Giunchedi:
prometheus: generate Varnish targets

https://gerrit.wikimedia.org/r/315098

Change 319291 had a related patch set uploaded (by Ema):
site: add varnish_exporter to esams/eqiad maps/misc

https://gerrit.wikimedia.org/r/319291

Change 319293 had a related patch set uploaded (by Ema):
prometheus: extend Varnish targets generation to text/upload

https://gerrit.wikimedia.org/r/319293

Change 319295 had a related patch set uploaded (by Ema):
site: add varnish_exporter to text/upload

https://gerrit.wikimedia.org/r/319295

Change 319291 merged by Ema:
site: add varnish_exporter to esams/eqiad maps/misc

https://gerrit.wikimedia.org/r/319291

Change 319293 merged by Ema:
prometheus: extend Varnish targets generation to text/upload

https://gerrit.wikimedia.org/r/319293

Change 319295 merged by BBlack:
prometheus: add varnish_exporter to all varnishes

https://gerrit.wikimedia.org/r/319295

fgiunchedi moved this task from Backlog to In progress on the Prometheus-metrics-monitoring board.Nov 8 2016, 7:24 PM

This is completed for all statistics provided by varnishstat, there are more that we custom-collect from varnishlog that end up in graphite/statsd, not ganglia.

Change 327873 had a related patch set uploaded (by Filippo Giunchedi):
prometheus: add aggregation rules for varnish_exporter

https://gerrit.wikimedia.org/r/327873

Change 327873 merged by Filippo Giunchedi:
prometheus: add aggregation rules for varnish_exporter