Configure performance alerts to reach the performance teams email list.
Description
Details
Subject | Repo | Branch | Lines +/- | |
---|---|---|---|---|
Configure SMTP for Grafana | operations/puppet | production | +7 -0 |
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Resolved | akosiaris | T140942 Tracking: Monitoring and alerts for "business" metrics | |||
Resolved | • Gilles | T153166 Set up Grafana alerts for Web Performance metrics | |||
Declined | • Gilles | T153167 Configure Grafana for sending e-mail |
Event Timeline
Change 328673 had a related patch set uploaded (by Gilles):
Configure SMTP for Grafana
So far Ops is stating that they don't want to set up email for Grafana alerts because Icinga already does that, with support for user groups, IRC bots, etc.
I'm checking to see if the kind of alerts we need can work on Icinga. This would mean that after defining an alert in Grafana, we would need to duplicate the graphite formula into puppet to set up actual alerting.
What about just using IRC first so we can get started? When I tried on my own instance for synthetics testing, it seems to a be some edge cases where we can get false alerts (I replicate the setup we wanna run for WPT) so I think the earlier we can start, the better. It will be a long ride to fine tune and make sure it works as we want.