While working thru T321605 , Search Platform SREs accidentally depooled all eqiad hosts for WCQS*.
This set off a Pybal alert, but we did not see it because the hostname was not in the alerts.

Luckily for us, @RhinosF1 dug up the IP address from our public-facing Puppet repo and contacted us.

Creating this ticket to request that we use DNS hostnames for Pybal VIP alerts instead of, or in addition to, IPs. For example, the current alert reads:

[15:55:54] <+icinga-wm> PROBLEM - PyBal IPVS diff check on lvs1019 is CRITICAL: CRITICAL: Services known to PyBal but not to IPVS: set([10.2.2.67:443]) https://wikitech.wikimedia.org/wiki/PyBal

An rDNS query of that IP reveals the VIP DNS name as wcqs.svc.eqiad.wmnet , so we'd like to see that in the alert instead of the IP.

Thanks and please let us know if you have any questions.

*WCQS has no official SLO yet, and codfw was not affected, so we don't consider this an official "incident"