Page MenuHomePhabricator

fix swift_new container/object availability alarms
Closed, ResolvedPublic

Description

for each swift cluster there are two alarms to monitor container and object availability, in swift_new for codfw-prod those alarms get expanded in icinga without the cluster name and thus result in UNKNOWN.

triaging as normal but once swift gets merged into swift_new this needs to be fixed

define service {
# --PUPPET_NAME-- graphite1002 swift__dispersion_object
        active_checks_enabled          1
        check_command                  check_graphite_threshold!http://graphite.wikimedia.org!10!swift..dispersion.object.pct_found.value!95!90!1hours!1!--under
        check_freshness                0
        check_period                   24x7
        contact_groups                 admins
        host_name                      graphite1002
        is_volatile                    0
        max_check_attempts             3
        normal_check_interval          1
        notification_interval          0
        notification_options           c,r,f
        notification_period            24x7
        passive_checks_enabled         1
        retry_check_interval           1
        servicegroups                  misc_eqiad
        service_description            swift  object availability

}

Event Timeline

fgiunchedi claimed this task.
fgiunchedi raised the priority of this task from to Medium.
fgiunchedi updated the task description. (Show Details)
fgiunchedi added a project: SRE-swift-storage.
fgiunchedi subscribed.

Change 209217 had a related patch set uploaded (by Filippo Giunchedi):
icinga: unify swift alerts

https://gerrit.wikimedia.org/r/209217

Change 236751 had a related patch set uploaded (by Filippo Giunchedi):
swift: refactor graphite/icinga checks

https://gerrit.wikimedia.org/r/236751

Change 236751 merged by Filippo Giunchedi:
swift: refactor graphite/icinga checks

https://gerrit.wikimedia.org/r/236751

Change 209217 abandoned by Filippo Giunchedi:
icinga: unify swift alerts

Reason:
not needed since swift swift_new merge

https://gerrit.wikimedia.org/r/209217