The issue is due to the /usr/local/bin/master_id.py file that is checking s*-master.codfw.wmnet DNS entry to get the master ID. This DNS does not exists.

I'm ack-ing the alarms on Icinga, the slaves have all checks running and will alarm in case of lag, while those masters will be failovered in the next 48h and reimaged. Not worth to fix it.