I think all the failmailing hosts are now reporting: https://grafana.wikimedia.org/dashboard/db/fundraising-overview?orgId=1&panelId=23&fullscreen&refresh=1m&from=now-1h&to=now

I notice that civi1001 is going to double report, as the sender is also fr-tech@

@Ejegg @Jgreen do you think it would make sense to set that address to root@ like the others?

In T202419#4520516, @cwdent wrote:

I notice that civi1001 is going to double report, as the sender is also fr-tech@

@Ejegg @Jgreen do you think it would make sense to set that address to root@ like the others?

I'm not sure what the others are, but we should avoid using root@ where possible, in favor of a fundraising-specific address to prevent bouncing messages outside of our team.

@Jgreen very good point, maybe something like frack@ ?

is it possible to do this from grafana

Reopening, now that we have our own prometheus/grafana instance, would it make sense to alert from it?

Thinking about this, I wonder if we would be better served by alerting on log spikes. We already have monitoring tools that will count log lines matching regexes and alert accordingly.