Event Timeline
All queries from dns2001
from ns0 -> ns-0 we get eaid
dig -b 208.80.154.238 api-ro.discovery.wmnet. @208.80.154.238 [11:46:11] ; <<>> DiG 9.16.37-Debian <<>> -b 208.80.154.238 api-ro.discovery.wmnet. @208.80.154.238 ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 8894 ;; flags: qr aa rd; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 1 ;; WARNING: recursion requested but not available ;; OPT PSEUDOSECTION: ; EDNS: version: 0, flags:; udp: 1024 ; COOKIE: 888287481c241c2064bf7f2535245121 (good) ;; QUESTION SECTION: ;api-ro.discovery.wmnet. IN A ;; ANSWER SECTION: api-ro.discovery.wmnet. 10 IN A 10.2.2.22 ;; Query time: 0 msec ;; SERVER: 208.80.154.238#53(208.80.154.238) ;; WHEN: Tue Mar 14 11:47:04 UTC 2023 ;; MSG SIZE rcvd: 87
dig -b 208.80.153.231 api-ro.discovery.wmnet. @208.80.153.231 [11:47:04]
; <<>> DiG 9.16.37-Debian <<>> -b 208.80.153.231 api-ro.discovery.wmnet. @208.80.153.231
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 58863
;; flags: qr aa rd; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 1
;; WARNING: recursion requested but not available
from ns1 to ns1 we get the correct address eqiad
;; OPT PSEUDOSECTION: ; EDNS: version: 0, flags:; udp: 1024 ; COOKIE: 461662489d5be8646193c2bd5200e208 (good) ;; QUESTION SECTION: ;api-ro.discovery.wmnet. IN A ;; ANSWER SECTION: api-ro.discovery.wmnet. 10 IN A 10.2.1.22 ;; Query time: 0 msec ;; SERVER: 208.80.153.231#53(208.80.153.231) ;; WHEN: Tue Mar 14 11:47:46 UTC 2023 ;; MSG SIZE rcvd: 87
from ns2 we get eqiad
dig -b 91.198.174.239 api-ro.discovery.wmnet. @91.198.174.239 [11:47:46] ; <<>> DiG 9.16.37-Debian <<>> -b 91.198.174.239 api-ro.discovery.wmnet. @91.198.174.239 ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 34194 ;; flags: qr aa rd; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 1 ;; WARNING: recursion requested but not available ;; OPT PSEUDOSECTION: ; EDNS: version: 0, flags:; udp: 1024 ; COOKIE: e064982436475dad0abf54a20b64f607 (good) ;; QUESTION SECTION: ;api-ro.discovery.wmnet. IN A ;; ANSWER SECTION: api-ro.discovery.wmnet. 10 IN A 10.2.2.22 ;; Query time: 0 msec ;; SERVER: 91.198.174.239#53(91.198.174.239) ;; WHEN: Tue Mar 14 11:48:16 UTC 2023 ;; MSG SIZE rcvd: 87
when the cache expires we see the source and destination is picked at randome
11:43:14.425923 IP 208.80.153.231.21221 > 208.80.153.231.53: 64128 [1au] A? api-ro.discovery.wmnet. (63) 11:43:24.350967 IP 91.198.174.239.54359 > 91.198.174.239.53: 36641 [1au] A? api-ro.discovery.wmnet. (63) 11:43:34.514016 IP 208.80.154.238.8073 > 208.80.154.238.53: 41690 [1au] A? api-ro.discovery.wmnet. (63) 11:43:44.203997 IP 91.198.174.239.46301 > 91.198.174.239.53: 30860 [1au] A? api-ro.discovery.wmnet. (63) 11:43:54.574202 IP 208.80.154.238.19630 > 208.80.154.238.53: 35742 [1au] A? api-ro.discovery.wmnet. (63) 11:44:04.620761 IP 91.198.174.239.23397 > 91.198.174.239.53: 13356 [1au] A? api-ro.discovery.wmnet. (63) 11:44:14.276367 IP 208.80.153.231.26490 > 208.80.153.231.53: 45151 [1au] A? api-ro.discovery.wmnet. (63) 11:44:24.514149 IP 208.80.153.231.5885 > 208.80.153.231.53: 28404 [1au] A? api-ro.discovery.wmnet. (63) 11:44:34.591664 IP 208.80.153.231.49459 > 208.80.153.231.53: 61597 [1au] A? api-ro.discovery.wmnet. (63) 11:44:44.343902 IP 208.80.153.231.54517 > 208.80.153.231.53: 46271 [1au] A? api-ro.discovery.wmnet. (63) 11:44:54.583805 IP 91.198.174.239.44218 > 91.198.174.239.53: 19696 [1au] A? api-ro.discovery.wmnet. (63)
So in theory the theory the correct address should get picked at some point
I noticed that the edns subnet sent is always 127.0.0.1/32
daasdasdasdasdsd.wikimedia.org. 0/1/1 ns: wikimedia.org. [10m] SOA ns0.wikimedia.org. hostmaster.wikimedia.org. 2023031314 43200 7200 1209600 600 ar: . OPT UDPsize=1024 [ECS 127.0.0.1/32/0] (135)
Likely because it hits the default discovery map is datacenters => [eqiad, ...]
Was unable to test with the client subnet of dns2001 before things switched back