As part of our ongoing effort to import DNS data into Netbox for automation, we have done a procedure to identify hosts with missing IPv6 DNS entries, with the suspicion that these are potentially sources of problems.
The procedure to produce this data was to look at the PuppetDB `networking` key for the host and select the "primary" IP address for the host, and do a DNS lookup for the FQDN for the host to check for a AAAA record, and report on any missing ones.
To Do:
* Decide if we will pursue fixing these clusters for IPv6 and/or if it is safe to generate IPv6 DNS for them
* File tickets for each major group or cluster we decide to pursue, for them to be to fixed and or ask about how we should proceed.
Below is a list of the machines (not VMs) without IPv6 DNS grouped by responsible team:
Analytics:
[] an-druid[1001-1002].eqiad.wmnet
[] druid[1007-1008].eqiad.wmnet - it looks like there was a commit in 2018 related to this https://phabricator.wikimedia.org/rOPUPc1f3f2bb32ec07166183263a67b85c21934ee752
[] notebook[1003-1004].eqiad.wmnet
cc Foundations:
[] kafka-main[2001-2005].codfw.wmnet
Machine learning:
[] ores[2001-2009].codfw.wmnet
[] ores[1001-1009].eqiad.wmnet
[] oresrdb2002.codfw.wmnet
[] oresrdb[1001-1002].eqiad.wmnet
Foundations:
[] auth2001.codfw.wmnet
[] auth1002.eqiad.wmnet
[] ganeti[2001-2024].codfw.wmnet
[] ganeti[1001-1022].eqiad.wmnet
[] ganeti[4001-4003].ulsfo.wmnet
[] ping1001
[] ping2001
[] ping3001
Observability:
[] centrallog2001.codfw.wmnet
[] centrallog1001.eqiad.wmnet
[] graphite2003.codfw.wmnet
[] graphite1004.eqiad.wmnet
[] logstash[2001-2003,2026-2029].codfw.wmnet
[] logstash[1010-1012,1026-1029].eqiad.wmnet
[] thanos-fe[2001-2003].codfw.wmnet
WMCS:
[] cloudbackup[2001-2002].codfw.wmnet
[] cloudnet2003-dev.codfw.wmnet
[] cloudvirt[2001-2003]-dev.codfw.wmnet
[] cloudvirt[1001-1009,1012-1018,1023-1030].eqiad.wmnet
[] cloudvirt-wdqs[1001-1003].eqiad.wmnet
[] labsdb[1009-1012].eqiad.wmnet
[] labtestvirt2003.codfw.wmnet
Data Persistence:
[] db[2071-2140].codfw.wmnet
[] db[1074-1139,1141-1149].eqiad.wmnet
[] dbprov[2001-2002].codfw.wmnet
[] dbprov[1001-1002].eqiad.wmnet
[] dbproxy[2001-2004].codfw.wmnet
[] dbproxy[1003,1008,1012-1021].eqiad.wmnet
[] dbstore[1003-1005].eqiad.wmnet
[] ms-be[2016-2056].codfw.wmnet
[] ms-be[1016-1026,1028-1059].eqiad.wmnet
[] ms-fe[2005-2008].codfw.wmnet
[] ms-fe[1005-1008].eqiad.wmnet
[] pc[2007-2010].codfw.wmnet
[] pc[1007-1010].eqiad.wmnet
Serviceops:
[] dumpsdata[1001-1003].eqiad.wmnet
[] kubernetes[1007-1014].eqiad.wmnet
[] mc[2019-2036].codfw.wmnet
[] mc[1019-1036].eqiad.wmnet
[] mc-gp[2001-2003].codfw.wmnet
[] mc-gp[1001-1003].eqiad.wmnet
[] mw[2215-2334,2350-2254,2257-2376].codfw.wmnet
[] mw[1261-1279,1281-1290,1293-1413].eqiad.wmnet
[] mwlog2001.codfw.wmnet
[] mwlog1001.eqiad.wmnet
[] parse[2001-2020].codfw.wmnet
[] rdb[2003-2006].codfw.wmnet
[] rdb[1005-1006,1009-1010].eqiad.wmnet
[] restbase[2009-2023].codfw.wmnet
[] restbase[1016-1030].eqiad.wmnet
[] restbase-dev[1004-1006].eqiad.wmnet
[] scb[2001-2006].codfw.wmnet
[] scb[1001-1004].eqiad.wmnet
[] sessionstore[2001-2003].codfw.wmnet
[] sessionstore[1001-1003].eqiad.wmnet
[] snapshot[1005-1010].eqiad.wmnet
[] thumbor[2001-2004].codfw.wmnet
[] thumbor[1001-1004].eqiad.wmnet
[] wtp[2001-2020].codfw.wmnet
[] wtp[1025-1048].eqiad.wmnet
Search:
[] elastic[2025-2060].codfw.wmnet
[] elastic[1032-1067].eqiad.wmnet
[] es[2011-2025].codfw.wmnet
[] es[1015-1025].eqiad.wmnet
[] relforge[1001-1002].eqiad.wmnet
[] wdqs[2001-2008].codfw.wmnet
[] wdqs[1004-1013].eqiad.wmnet
Traffic:
[] lvs[2007-2010].codfw.wmnet
[] lvs[1013-1016].eqiad.wmnet
[] lvs[4005-4007].ulsfo.wmnet
???:
[] heze.codfw.wmnet
[] maps[2001-2004].codfw.wmnet
[] maps[1001-1004].eqiad.wmnet
[] scandium.eqiad.wmnet
Fixed or removed:
[x] flerovium.eqiad.wmnet
[x] francium.eqiad.wmnet
[x] furud.codfw.wmnet
[x] kafka-jumbo[1007-1009].eqiad.wmnet - ipv6 names these are done https://phabricator.wikimedia.org/T185262 verified in netbox
[x] labstore[1004-1005].eqiad.wmnet - ipv6 names verified in netbox
[x] mw[2135-2147,2150-2212,2214,2256] - machines offline
[x] puppetmaster2003.codfw.wmnet
[x] sretest[1001-1002].eqiad.wmnet
[x] stat1008.eqiad.wmnet
[x] thanos-be[2001-2004].codfw.wmnet - ipv6 names verified in netbox
[x] theemin.codfw.wmnet
[x] tungsten.eqiad.wmnet
Will not IPv6 for forseeable future:
...