Page MenuHomePhabricator

Self-service deployment for alerting rules
Closed, ResolvedPublic

Description

This task tracks the implementation of self-service deployment for Prometheus alerting rules, including:

  • A repository of alerting rules
  • Validation / unit testing of alerting rules
  • Deployment to production Prometheus

Event Timeline

Change 670230 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/alerts@master] Sketch of Performance team alerts

https://gerrit.wikimedia.org/r/670230

Change 670231 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/alerts@master] Run tests for alerts

https://gerrit.wikimedia.org/r/670231

Change 670782 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[integration/config@master] Add operations/alerts tox

https://gerrit.wikimedia.org/r/670782

Change 670782 merged by jenkins-bot:
[integration/config@master] Add operations/alerts tox

https://gerrit.wikimedia.org/r/670782

Change 672340 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[integration/config@master] Add tox-alerts Docker image to have 'promtool' available

https://gerrit.wikimedia.org/r/672340

Change 672340 abandoned by Filippo Giunchedi:
[integration/config@master] Add tox-alerts Docker image to have 'promtool' available

Reason:
Trying the Pipeline instead

https://gerrit.wikimedia.org/r/672340

Change 672359 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[integration/config@master] Add pipeline-based config for operations/alerts

https://gerrit.wikimedia.org/r/672359

Change 672359 merged by jenkins-bot:
[integration/config@master] Add pipeline-based config for operations/alerts

https://gerrit.wikimedia.org/r/672359

Change 672365 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/alerts@master] Add Blubber and Pipeline

https://gerrit.wikimedia.org/r/672365

Change 670231 merged by Filippo Giunchedi:
[operations/alerts@master] Run tests for alerts

https://gerrit.wikimedia.org/r/670231

Change 672365 merged by Filippo Giunchedi:
[operations/alerts@master] Add Blubber and Pipeline

https://gerrit.wikimedia.org/r/672365

Change 674025 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] alerts: deploy to Prometheus hosts

https://gerrit.wikimedia.org/r/674025

Change 674025 merged by Filippo Giunchedi:
[operations/puppet@production] alerts: deploy to Prometheus hosts

https://gerrit.wikimedia.org/r/674025

Change 674321 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] prometheus: read alerts from /srv/alerts

https://gerrit.wikimedia.org/r/674321

Change 674321 merged by Filippo Giunchedi:
[operations/puppet@production] prometheus: read alerts from /srv/alerts

https://gerrit.wikimedia.org/r/674321

fgiunchedi claimed this task.

This is complete! Alerts will get deployed from operations/alerts to Prometheus instances