Page MenuHomePhabricator

Update Icinga drive health alerts to notify WMCS instead of "admins"
Closed, ResolvedPublic

Description

The Icinga contact group for SMART drive alerts is currently notifying the "admin" contacts instead of "wmcs-team"

Example service configuration:
https://icinga.wikimedia.org/cgi-bin/icinga/config.cgi?type=services&item_name=cloudvirt1008^Device+not+healthy+-SMART-

Event Timeline

Change 574822 had a related patch set uploaded (by Jhedden; owner: Jhedden):
[operations/puppet@production] icinga: add contact group to base host prometheus checks

https://gerrit.wikimedia.org/r/574822

Change 574822 merged by Dzahn:
[operations/puppet@production] icinga: add contact group to base host prometheus checks

https://gerrit.wikimedia.org/r/574822

Ran puppet several times on icinga1001 after merging the above.

I confirm a whole lot of cloud* and lab* servers changed contact group from "admin" to "wmcs-team" as intended. (So admins was removed)

As a side effect also "team-services" got added to restbase* and wdqs-admin got added to wdqs*. (In addition to admins).