Slightly related to T347490: [wmcs-cookbooks] Downtime alerts from cloudcumins but I think this is a different issue. Spicerack currently has the wikiprod alertmanager hosts hardcoded, which does not work as we want the cloudcumin hosts to be able to downtime alerts both there but also in the metricsinfra alertmanager instance.
Description
Details
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | taavi | T360932 Support downtiming metricsinfra alerts in wmcs-cookbooks | |||
| Resolved | taavi | T362061 Allow authenticated write access from the wikiprod network to metricsinfra alertmanager API |
Event Timeline
Change #1014099 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/software/spicerack@master] alertmanager: Add support for multiple alertmanager instances
Change #1015000 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] P:spicerack: add alertmanager instance config
Change #1014099 merged by jenkins-bot:
[operations/software/spicerack@master] alertmanager: Add support for multiple alertmanager instances
Change #1015000 merged by Majavah:
[operations/puppet@production] P:spicerack: add alertmanager instance config
Change #1015002 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] hieradata: spicerack: use plaintext HTTP for alertmanager
Change #1015002 merged by Majavah:
[operations/puppet@production] hieradata: spicerack: use plaintext HTTP for alertmanager
Change #1018230 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/software/spicerack@master] alertmanager: Add support for per-instance HTTP proxy configuration
Change #1018230 merged by jenkins-bot:
[operations/software/spicerack@master] alertmanager: Add support for per-instance HTTP proxy configuration
Change #1018233 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/software/spicerack@master] alertmanager: Add support for per-instance HTTP basic authentication
Change #1018236 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] hieradata: cloudcumin: Configure metricsinfra alertmanager instance
Change #1018233 merged by jenkins-bot:
[operations/software/spicerack@master] alertmanager: Add support for per-instance HTTP basic authentication
Change #1018257 had a related patch set uploaded (by Majavah; author: Majavah):
[labs/private@master] hieradata: cloudcumin: Add fake metricsinfra password
Change #1018236 merged by Majavah:
[operations/puppet@production] hieradata: cloudcumin: Configure metricsinfra alertmanager instance
Change #1018257 merged by Majavah:
[labs/private@master] hieradata: cloudcumin: Add fake metricsinfra password
Change #1018272 had a related patch set uploaded (by Majavah; author: Majavah):
[cloud/wmcs-cookbooks@main] vps: remove_instance: Metricsinfra silencing demo
Change #1018272 merged by jenkins-bot:
[cloud/wmcs-cookbooks@main] vps: remove_instance: Silence metricsinfra alerts before deleting
I created T364733: Add a nicer interface in Spicerack/wmcs-cookbooks to downtime Cloud VPS instances to improve the API somewhat, but silencing things works now so closing this one.