Noticed at https://guc.toolforge.org (https://guc.toolforge.org/?by=date&user=TNTBot)
Trying to directly contact the replicas returns (e.g.) Can't connect to MySQL server on 's7.analytics.db.svc.wikimedia.cloud' ([Errno -2] Name or service not known)
#wikimedia-cloud was made aware and @taavi noted this occured after a recent DNS change
Logging this for the record :-)
This was caused by https://gerrit.wikimedia.org/r/c/operations/puppet/+/919341
Fixed with https://gerrit.wikimedia.org/r/c/operations/dns/+/919346
Before the fix:
aborrero@tools-sgebastion-11:~$ host meta.web.db.svc.eqiad.wmflabs Host meta.web.db.svc.eqiad.wmflabs not found: 3(NXDOMAIN)
After the fix:
aborrero@tools-sgebastion-11:~$ host meta.web.db.svc.eqiad.wmflabs meta.web.db.svc.eqiad.wmflabs is an alias for s7.web.db.svc.wikimedia.cloud. s7.web.db.svc.wikimedia.cloud has address 172.16.2.51