Page MenuHomePhabricator

Move WMCS off of Icinga and introduce alertmanager
Open, In Progress, MediumPublic

Description

Below is a list of icinga checks with contact group wmcs that will need to be migrated to AM/prometheus (or deprecated) for wmcs to be off icinga (modulo base checks, out of scope for this)

titleprofilecontactsstatus
ensure_nova_compute_runningprofile::openstack::eqiad1::nova::compute::servicewmcs-team,adminspending
ensure_running_kvm_instancesprofile::openstack::eqiad1::nova::compute::servicewmcs-team,adminspending
ensure_single_nova_compute_procprofile::openstack::eqiad1::nova::compute::servicewmcs-team,adminspending
check-cinder-snapshot-leaksprofile::openstack::base::cinderwmcs-team-email,adminspending
check-cloudinfra-spreadprofile::openstack::eqiad1::keystone::servicewmcs-team-email,wmcs-botsremoved
check-deployment-prep-spreadprofile::openstack::eqiad1::keystone::servicewmcs-team-email,wmcs-botsremoved
check-flavor_aggregatesprofile::openstack::eqiad1::nova::fullstack::servicewmcs-team-email,wmcs-botspending
check-tools-spreadprofile::openstack::eqiad1::keystone::servicewmcs-team-email,wmcs-botsremoved
high_iowait_stallingprofile::dumps::distribution::monitoringwmcs-team,adminspending
network_in_saturatedprofile::dumps::distribution::monitoringwmcs-team,adminspending
network_out_saturatedprofile::dumps::distribution::monitoringwmcs-team,adminspending
https_wikitech-staticprofile::icingawmcs-bots,adminspending
tools-checker-dumpsprofile::icingawmcs-team-emailpending
tools-checker-etcd-k8sprofile::icingawmcs-team-email,wmcs-botspending
tools-checker-grid-continuous-busterprofile::icingawmcs-bots,wmcs-team-emailpending
tools-checker-grid-start-busterprofile::icingawmcs-bots,wmcs-team-emailpending
tools-checker-k8s-node-readyprofile::icingawmcs-team-email,wmcs-botspending
tools-checker-labs-dns-privateprofile::icingawmcs-teampending
tools-checker-ldapprofile::icingawmcs-team-email,wmcs-botspending
tools-checker-nfs-homeprofile::icingawmcs-teampending
tools-checker-redisprofile::icingawmcs-teampending
tools-checker-selfprofile::icingawmcs-teampending
tools-checker-toolscronprofile::icingawmcs-team-emailpending
wikitech-static-main-pageprofile::icingawmcs-bots,adminspending
check-flavor_aggregatesprofile::openstack::codfw1dev::nova::fullstack::servicewmcs-team-email,wmcs-botspending
check-neutron-conntrackprofile::openstack::base::neutron::l3_agentwmcs-team-email,adminspending
Auth DNS TCP <name>profile::openstack::eqiad1::pdns::auth::serviceadminspending
Auth DNS UDP <name>profile::openstack::eqiad1::pdns::auth::serviceadminspending
DNS resolution <name>profile::openstack::eqiad1::pdns::auth::serviceadminspending

Event Timeline

taavi renamed this task from Move off from icinga and introduce alertmanager to Move WMCS off of Icinga and introduce alertmanager.Dec 1 2023, 12:54 PM
taavi claimed this task.
taavi removed a project: wmcs-retrospective.
taavi updated the task description. (Show Details)
taavi updated the task description. (Show Details)
dcaro updated the task description. (Show Details)
taavi changed the task status from Open to In Progress.Jan 17 2024, 4:00 PM

In case it is useful, as part of the icinga migration I've been collecting checks and their type/status here: https://docs.google.com/spreadsheets/d/19nxCXldb804TJCXGy4Z2BHG_1wRksRnKcPC6sXfjQuM/edit#gid=1831147731