Page MenuHomePhabricator

icinga reports frbast2001.frack.eqiad.wmnet as host down
Closed, ResolvedPublic

Description

Icinga is receiving and correctly reporting nsca reports for frbast2001, so we know frbast2001->icinga-server is working. However the host-up check is failing, which I believe is icinga-server->frbast2001.

I found and fixed the IP for frbast2001 in the icinga config, and also adjusted the subnet definitions in data.yaml to reflect the changes in T204271, and by now I think if this were the issue it would have resolved. Still no luck.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Mentioned in SAL (#wikimedia-operations) [2018-10-10T17:49:49Z] <XioNoX> replace 10.195.0.0/25 with 10.195.0.0/24 in prefix-list fundraising-codfw4 on cr1/2-codfw - T206637

Jgreen claimed this task.

This is fixed.

  • fix nagios_nsca.conf in prod puppet for frbast2001's new IP
  • fix modules/network/data/data.yaml to correct codfw subnets
  • adjust routing config on cr1/2-codfw