Page MenuHomePhabricator

DNS name resolution failure with www.spacecom.mil from Cloud VPS
Closed, ResolvedPublicBUG REPORT

Description

Steps to replicate the issue (include links if applicable):

  • Get a Cloud VPS VM (mine is worker-1.spacemedia.eqiad1.wikimedia.cloud)
  • Check that /etc/resolv.conf is correctly set (as per T345240 / T342621 / T346033):
$ cat /etc/resolv.conf
#####################################################################
#### THIS FILE IS MANAGED BY PUPPET
####  as template('resolvconf/resolv.conf.erb')
#####################################################################
search spacemedia.eqiad1.wikimedia.cloud spacemedia.eqiad.wmflabs eqiad.wmflabs
options timeout:1 attempts:3 ndots:1
nameserver 172.20.255.1
  • lookup for www.spacecom.mil

What happens?:

$ ping www.spacecom.mil
ping: www.spacecom.mil: Temporary failure in name resolution
$ nslookup www.spacecom.mil
Server:         172.20.255.1
Address:        172.20.255.1#53

** server can't find www.spacecom.mil: SERVFAIL
$ dig www.spacecom.mil

; <<>> DiG 9.16.42-Debian <<>> www.spacecom.mil
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 54651
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 512
;; QUESTION SECTION:
;www.spacecom.mil.              IN      A

;; Query time: 3008 msec
;; SERVER: 172.20.255.1#53(172.20.255.1)
;; WHEN: Sat Sep 16 12:03:38 UTC 2023
;; MSG SIZE  rcvd: 45

What should have happened instead?:

Name resolution should succeed.

Software version (skip for WMF-hosted wikis like Wikipedia):

Other information (browser name/version, screenshots, etc.):

Event Timeline

The Cloud-Services project tag is not intended to have any tasks. Please check the list on https://phabricator.wikimedia.org/project/profile/832/ and replace it with a more specific project tag to this task. Thanks!

Can confirm this is still the case.

From a random different cloud VPS instance:

dig www.spacecom.mil @172.20.255.1

fails. (and 172.20.255.1 is in resolv.conf)

dig www.spacecom.mil @1.1.1.1

works (that is the cloudflare public DNS)

It's not ALL of .mil either. For example "dig cybercoe.army.mil @172.20.255.1" works and also points to an Akamai edge.

Yes, my tool scans for free media at following .mil domains without problem:

  • www.afspc.af.mil
  • www.buckley.spaceforce.mil
  • www.jtf-spacedefense.mil
  • www.losangeles.spaceforce.mil
  • www.patrick.spaceforce.mil
  • www.ssc.spaceforce.mil
  • www.spaceforce.mil
  • www.spoc.spaceforce.mil
  • www.starcom.spaceforce.mil
  • www.vandenberg.spaceforce.mil

These two are failing:

  1. www.schriever.spaceforce.mil
  2. www.spacecom.mil

www.spacecom.mil seems to work now:

taavi@tools-bastion-12:~ $ dig www.spacecom.mil

; <<>> DiG 9.18.24-1-Debian <<>> www.spacecom.mil
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 55764
;; flags: qr rd ra; QUERY: 1, ANSWER: 4, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 512
;; QUESTION SECTION:
;www.spacecom.mil.		IN	A

;; ANSWER SECTION:
www.spacecom.mil.	57	IN	CNAME	www.spacecom.mil.edgekey.net.
www.spacecom.mil.edgekey.net. 297 IN	CNAME	e80948.dscb.akamaiedge.net.
e80948.dscb.akamaiedge.net. 17	IN	A	23.48.104.107
e80948.dscb.akamaiedge.net. 17	IN	A	23.48.104.109

;; Query time: 4 msec
;; SERVER: 172.20.255.1#53(172.20.255.1) (UDP)
;; WHEN: Mon Apr 08 08:54:51 UTC 2024
;; MSG SIZE  rcvd: 156

taavi@tools-bastion-12:~ $ ping www.spacecom.mil
PING e80948.dscb.akamaiedge.net (23.48.104.109) 56(84) bytes of data.
64 bytes from a23-48-104-109.deploy.static.akamaitechnologies.com (23.48.104.109): icmp_seq=1 ttl=55 time=0.568 ms
64 bytes from a23-48-104-109.deploy.static.akamaitechnologies.com (23.48.104.109): icmp_seq=2 ttl=55 time=0.610 ms
64 bytes from a23-48-104-109.deploy.static.akamaitechnologies.com (23.48.104.109): icmp_seq=3 ttl=55 time=0.537 ms
^C
--- e80948.dscb.akamaiedge.net ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2006ms
rtt min/avg/max/mdev = 0.537/0.571/0.610/0.029 ms

www.schriever.spaceforce.mil returns an NXDOMAIN, but that also seems to happen outside Cloud VPS.

taavi claimed this task.