Change Details

Not wishing to duplicate {T53497}, we should implement some very basic alerting for Beta Cluster availability. I've run https://uptime.theresnotime.io/status/wmf-beta for a few months now, and have it configured to "page" me via [[ https://pushover.net/ | pushover ]] (as does [[ https://github.com/theresnotime/jenkins-watch | jenkins-watch ]] for Beta deployment jobs going overdue) — I'm happy to continue running this, and could potentially have Beta alerts feed into AlertManager etc via a webhook? Actionable from https://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#Actionables

Not wishing to duplicate {T53497}, we should implement some very basic alerting for Beta Cluster availability. I've run https://uptime.theresnotime.io/status/beta-cluster for a few months now, and have it configured to "page" me via [[ https://pushover.net/ | pushover ]] (as does [[ https://github.com/theresnotime/jenkins-watch | jenkins-watch ]] for Beta deployment jobs going overdue) — I'm happy to continue running this, and could potentially have Beta alerts feed into AlertManager etc via a webhook? Actionable from https://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#Actionables

Not wishing to duplicate {T53497}, we should implement some very basic alerting for Beta Cluster availability. I've run https://uptime.theresnotime.io/status/wmf-betabeta-cluster for a few months now, and have it configured to "page" me via [[ https://pushover.net/ | pushover ]] (as does [[ https://github.com/theresnotime/jenkins-watch | jenkins-watch ]] for Beta deployment jobs going overdue) — I'm happy to continue running this, and could potentially have Beta alerts feed into AlertManager etc via a webhook? Actionable from https://wikitech.wikimedia.org/wiki/Incidents/2022-08-16_Beta_Cluster_502#Actionables