Remove or move to Alertmanager:
These will be covered by T357977: [toolforge.infra] run and monitor our own sample tools:
To be removed:
T358333: Remove toolschecker grid engine checks
| Title | Reference | Author | Source Branch | Dest Branch | |
|---|---|---|---|---|---|
| kubernetes: Add node ready alerts | repos/cloud/toolforge/alerts!5 | taavi | node-ready | main |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | tappof | T395441 Port all Icinga checks to Prometheus/Alertmanager: preparation | |||
| Open | tappof | T321808 Port all Icinga checks to Prometheus/Alertmanager | |||
| Open | Goal | None | T328502 Move WMCS off of Icinga and introduce alertmanager | ||
| Resolved | • fgiunchedi | T345983 Remove Icinga checks for Cloud VPS projects (not: infrastructure) | |||
| Resolved | • fgiunchedi | T313030 [toolforge.infra] Replace Toolschecker alerts with Prometheus based ones | |||
| Resolved | taavi | T311911 Upgrade Toolforge Prometheus servers to Debian Bullseye or later | |||
| Resolved | • nskaggs | T312692 Request increased quota for tools Cloud VPS project | |||
| Resolved | taavi | T284860 Prometheus alerting support on Toolforge | |||
| Resolved | taavi | T304716 Cloud services enhancement proposal: Prometheus metrics for Toolforge/Toolsbeta/Paws Kubernetes clusters | |||
| Resolved | dcaro | T313031 Paging for alerts from the cloud realm | |||
| Resolved | taavi | T358333 Remove toolschecker grid engine checks |
Change 956071 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] P:toolforge::checker: remove ToolsDB R/W check
Change 956071 merged by Majavah:
[operations/puppet@production] P:toolforge::checker: remove ToolsDB R/W check
taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/5
kubernetes: Add node ready alerts
taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/5
kubernetes: Add node ready alerts
Change 982786 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] P:toolforge::checker: remove kubernetes node readiness check
Change 982786 merged by Majavah:
[operations/puppet@production] P:toolforge::checker: remove kubernetes node readiness check
Change 991289 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] P:toolforge::checker: remove webservice checks
Change 991289 merged by Majavah:
[operations/puppet@production] P:toolforge::checker: remove webservice checks
Following up from team meeting, only the k8s etcd checks are relevant nowadays to port to AM, the rest can be ditched
filippo opened https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/63
kubernetes: add k8s etcd alerts from toolschecker
Change #1298742 had a related patch set uploaded (by Filippo Giunchedi; author: Filippo Giunchedi):
[operations/puppet@production] icinga: remove toolschecker-based checks
filippo merged https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/63
kubernetes: add k8s etcd alerts from toolschecker
Change #1299545 had a related patch set uploaded (by Filippo Giunchedi; author: Filippo Giunchedi):
[operations/puppet@production] etcd: make etcdctl work out of the box
Change #1299546 had a related patch set uploaded (by Filippo Giunchedi; author: Filippo Giunchedi):
[operations/puppet@production] toolforge: remove checker access from k8s::etcd
Change #1299547 had a related patch set uploaded (by Filippo Giunchedi; author: Filippo Giunchedi):
[operations/puppet@production] Remove toolschecker role/profile
Change #1299545 merged by Filippo Giunchedi:
[operations/puppet@production] etcd: make etcdctl work out of the box
Change #1300738 had a related patch set uploaded (by Filippo Giunchedi; author: Filippo Giunchedi):
[operations/puppet@production] etcd: switch etcdctl auth based on 'use_client_certs'
Change #1300738 merged by Filippo Giunchedi:
[operations/puppet@production] etcd: switch etcdctl auth based on 'use_client_certs'
Change #1298742 merged by Filippo Giunchedi:
[operations/puppet@production] icinga: remove toolschecker-based checks
Change #1299546 merged by Filippo Giunchedi:
[operations/puppet@production] toolforge: remove checker access from k8s::etcd
Change #1299547 merged by Filippo Giunchedi:
[operations/puppet@production] Remove toolschecker role/profile
filippo opened https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/105
Remove checker dns and floating IP
filippo merged https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/105
Remove checker dns and floating IP
Mentioned in SAL (#wikimedia-cloud) [2026-06-15T09:52:17Z] <godog> delete tools-checker-5 - T313030
Mentioned in SAL (#wikimedia-cloud) [2026-06-15T09:53:54Z] <godog> delete tools-checker puppet prefix - T313030
Change #1302110 had a related patch set uploaded (by Filippo Giunchedi; author: Filippo Giunchedi):
[operations/puppet@production] toolforge: remove toolschecker from legacy redirector
Change #1302110 merged by Filippo Giunchedi:
[operations/puppet@production] toolforge: remove toolschecker from legacy redirector
This is done -- toolschecker has been deprecated in favor of other alerts or moving some of its alerts to prometheus/alertmanager ones