Page MenuHomePhabricator
Create Task
Maniphest T99521

No DNS entry for deployment-logstash1.eqiad.wmflabs ?
Closed, ResolvedPublic
Actions

Description

deployment-logstash1.eqiad.wmflabs (from deployment-prep) seems to be missing its DNS entry:

root@deployment-restbase01:/# ping deployment-logstash1.eqiad.wmflabs
ping: unknown host deployment-logstash1.eqiad.wmflabs

However, using its IP address shows the host is actually ping-able:

root@deployment-restbase01:/# ping 10.68.16.134
PING 10.68.16.134 (10.68.16.134) 56(84) bytes of data.
64 bytes from 10.68.16.134: icmp_seq=1 ttl=64 time=0.691 ms
64 bytes from 10.68.16.134: icmp_seq=2 ttl=64 time=2.12 ms
^C
--- 10.68.16.134 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.691/1.406/2.122/0.716 ms

Related Objects
Search...

Event Timeline

• mobrovac created this task.May 18 2015, 1:01 PM
• mobrovac raised the priority of this task from to Needs Triage.
• mobrovac updated the task description. (Show Details)
• mobrovac added projects: Beta-Cluster-Infrastructure, Cloud-Services.
• mobrovac subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 18 2015, 1:01 PM
• mobrovac mentioned this in T99506: RESTBase service exists on Parsoid ECONNREFUSED.May 18 2015, 1:04 PM
• mobrovac added a parent task: T99506: RESTBase service exists on Parsoid ECONNREFUSED.May 18 2015, 1:08 PM
• mobrovac added a parent task: T99505: Parsoid not binding to any port in Beta Cluster.
Aklapper added a project: Release-Engineering-Team.May 18 2015, 1:22 PM
Joe added subscribers: coren, Joe.May 18 2015, 1:35 PM

We narrowed down the problem to be local to the ldap-backed dns, @coren is looking into it at the moment.

coren added a comment.May 18 2015, 2:06 PM

The issue may actually lie within dnsmasq after all; the instance is properly listed in the list it should be serving the name of, yet gives a SRVFAIL rather than the A record on query. Digging to see if we reached some limit in dnsmasq.

Andrew closed this task as Resolved.May 18 2015, 3:26 PM
Andrew claimed this task.
Andrew subscribed.

No idea why this broke, but a reboot fixed it.

coren added a comment.May 18 2015, 4:44 PM

As a further note (so that we can recognize the bug if it recurs), dnsmasq /did/ have a valid lease for that IP and had the correct name associated with it, and the reboot required a "hard reboot" (per nova)

greg moved this task from INBOX to Done on the Release-Engineering-Team board.May 23 2015, 2:13 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL