This should be easy thanks to production puppet manifests, only issue is coming up with a name for the bot.
Description
Description
Details
Details
Related Changes in Gerrit:
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| metricsinfra: Add IRC bot for alerting | operations/puppet | production | +28 -0 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | fgiunchedi | T205862 Expand modern metrics infrastructure coverage (2018-19 Q2 goal) | |||
| Resolved | colewhite | T183454 Deprovision Diamond collectors no longer in use | |||
| Resolved | MoritzMuehlenhoff | T210993 Deprecate Diamond collectors in Cloud VPS | |||
| Resolved | taavi | T336774 Current status of cloudmetrics and its components | |||
| Resolved | taavi | T326266 Remove the WMCS statsd/Graphite service | |||
| Resolved | dcaro | T313444 Streamline WMCS Alerting and Paging | |||
| Resolved | taavi | T317032 Remove Diamond? | |||
| Resolved | taavi | T264920 Grafana "cloud-vps-project-board" needs to be migrated from Graphite to Prometheus | |||
| Open | None | T194333 [Epic] Provide logging/metrics/monitoring SaaS for Cloud VPS tenants | |||
| Resolved | taavi | T266050 Build Prometheus service for use by all Cloud VPS projects and their instances | |||
| Resolved | taavi | T287148 Set up IRC relay for metricsinfra alerts |
Event Timeline
Comment Actions
I didn't come up with any creative names so just decided to pick wmcs-alerts as the bot name. Saved details to root's home on metricsinfra-puppetmaster-1 and sent in a cloak request.
Comment Actions
14:45:44 <+wmcs-alerts> (PuppetAgentFailures) firing: <no value> - https://prometheus-alerts.wmcloud.org
It sends the alerts now, but looks like I need to tweak the template so that it's at least a little bit more useful.
Comment Actions
Change 709514 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] metricsinfra: Add IRC bot for alerting
Comment Actions
Change 709514 merged by Bstorm:
[operations/puppet@production] metricsinfra: Add IRC bot for alerting