<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style>
<!--
@font-face
{font-family:"Cambria Math"}
@font-face
{font-family:Calibri}
@font-face
{font-family:Georgia}
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif"}
a:link, span.MsoHyperlink
{color:#0563C1;
text-decoration:underline}
a:visited, span.MsoHyperlinkFollowed
{color:#954F72;
text-decoration:underline}
span.EmailStyle17
{font-family:"Georgia","serif";
color:windowtext}
span.EmailStyle18
{font-family:"Georgia","serif";
color:#1F497D}
span.EmailStyle19
{font-family:"Calibri","sans-serif";
color:#1F497D}
.MsoChpDefault
{font-size:10.0pt}
@page WordSection1
{margin:1.0in 1.0in 1.0in 1.0in}
div.WordSection1
{}
-->
</style>
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="color:#1F497D">I’d say it’s on Toyota’s end:</span></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="font-size:8.0pt; font-family:"Courier New"; color:#1F497D">$ dig toyotasupplier.com +short @gslb-ns1.toyota-na.com</span></p>
<p class="MsoNormal"><span style="font-size:8.0pt; font-family:"Courier New"; color:#1F497D"><<>> DiG 9.7.3 <<>> toyotasupplier.com +short @gslb-ns1.toyota-na.com</span></p>
<p class="MsoNormal"><span style="font-size:8.0pt; font-family:"Courier New"; color:#1F497D"> ;; global options: +cmd</span></p>
<p class="MsoNormal"><span style="font-size:8.0pt; font-family:"Courier New"; color:#1F497D">connection timed out; no servers could be reached</span></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="color:#1F497D">Their other DNS server works fine… several attempts to reach the first one however fails (haven’t gotten a success yet).</span></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="color:#1F497D">I’d say it’s their problem.</span></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<div>
<p class="MsoNormal"><span style="color:#1F497D">- Brian Menges</span></p>
<p class="MsoNormal"><span style="color:#1F497D">Principal Engineer, DevOps @ GoGrid, LLC.</span></p>
</div>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> pdns-users-bounces@mailman.powerdns.com [mailto:pdns-users-bounces@mailman.powerdns.com]
<b>On Behalf Of </b>Todd Smith<br>
<b>Sent:</b> Tuesday, September 09, 2014 9:24 AM<br>
<b>To:</b> 'pdns-users@mailman.powerdns.com'<br>
<b>Subject:</b> [Pdns-users] Recursion issue--SERVFAIL then NOERROR totally at random</p>
</div>
</div>
<p class="MsoNormal"> </p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Georgia","serif"">Hey guys,<br>
<br>
I’ve been having a problem with recursion. For some reason, certain domains seem to throw SERVFAIL errors when dug most of the time, but then NOERROR with a correct response at other random times. For example:<br>
<br>
</span><span style="font-size:10.0pt; font-family:"Courier New"">root@yoshi:/# dig toyotasupplier.com</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">; <<>> DiG 9.8.4-rpz2+rl005.12-P1 <<>> toyotasupplier.com</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; global options: +cmd</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; Got answer:</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 2636</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; QUESTION SECTION:</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;toyotasupplier.com. IN A</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; Query time: 0 msec</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; SERVER: 208.88.248.25#53(208.88.248.25)</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; WHEN: Wed Sep 3 13:36:33 2014</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; MSG SIZE rcvd: 36</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Georgia","serif"">And then, a few hours later:</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">root@yoshi:/# dig toyotasupplier.com</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">; <<>> DiG 9.8.4-rpz2+rl005.12-P1 <<>> toyotasupplier.com</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; global options: +cmd</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; Got answer:</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 56751</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 0</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; QUESTION SECTION:</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;toyotasupplier.com. IN A</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; ANSWER SECTION:</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">toyotasupplier.com. 18296 IN A 12.169.52.71</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; Query time: 1 msec</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; SERVER: 208.88.248.25#53(208.88.248.25)</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; WHEN: Thu Sep 4 10:39:38 2014</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; MSG SIZE rcvd: 52</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Georgia","serif"">And then, a few hours later still:</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">root@yoshi:/# dig toyotasupplier.com</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">; <<>> DiG 9.8.4-rpz2+rl005.12-P1 <<>> toyotasupplier.com</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; global options: +cmd</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; Got answer:</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 5171</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; QUESTION SECTION:</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;toyotasupplier.com. IN A</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; Query time: 3017 msec</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; SERVER: 208.88.248.25#53(208.88.248.25)</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; WHEN: Fri Sep 5 07:50:25 2014</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; MSG SIZE rcvd: 36</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Georgia","serif"">All without making a single change.</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Georgia","serif""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Georgia","serif"">I have been working on debugging this for two days now and absolutely cannot pinpoint a source for the issue. I’ve increased the max query lengths, the recursor’s network and
client TCP timeouts, restarted the service several times on several of our DNS servers, and nothing I do seems to fix it. It of course doesn’t help that the bug is a bit of a gremlin and keeps mischievously disappearing at random (and in fact never, to my
knowledge, happened before until about a week ago, when it started to occur for no apparent reason). Any idea on what could be causing this? FWIW, when I run
</span><span style="font-size:10.0pt; font-family:"Courier New"">dig toyotasupplier.com ns</span><span style="font-size:10.0pt; font-family:"Georgia","serif""> it consistently works fine:</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Georgia","serif""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">root@yoshi:/# dig toyotasupplier.com ns</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">; <<>> DiG 9.8.4-rpz2+rl005.12-P1 <<>> toyotasupplier.com ns</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; global options: +cmd</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; Got answer:</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 39522</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 0</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; QUESTION SECTION:</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;toyotasupplier.com. IN NS</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; ANSWER SECTION:</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">toyotasupplier.com. 50741 IN NS gslb-ns2.toyota-na.com.</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">toyotasupplier.com. 50741 IN NS gslb-ns1.toyota-na.com.</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; Query time: 1 msec</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; SERVER: 208.88.248.25#53(208.88.248.25)</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; WHEN: Fri Sep 5 07:49:29 2014</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Courier New"">;; MSG SIZE rcvd: 92</span><span style="font-size:10.0pt; font-family:"Georgia","serif""><br>
<br>
Many thanks in advance,</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Georgia","serif""> </span></p>
<p class="MsoNormal"><span style="font-family:"Georgia","serif"">Todd W. Smith<br>
IP Services Technician</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Georgia","serif"">2331 East 600 North</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Georgia","serif"">Greenfield, IN 46140</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Georgia","serif"">(317) 323-2021</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Georgia","serif""><a href="mailto:tsmith@ninestarconnect.com">tsmith@ninestarconnect.com</a></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Georgia","serif""><a href="http://www.ninestarconnect.com/">www.ninestarconnect.com</a><span style="color:#1F497D"></span></span></p>
</div>
<br>
<hr>
<font face="Courier New" color="Gray" size="1"><br>
The information contained in this message, and any attachments, may contain confidential and legally privileged material. It is solely for the use of the person or entity to which it is addressed. Any review, retransmission, dissemination, or action taken in
reliance upon this information by persons or entities other than the intended recipient is prohibited. If you receive this in error, please contact the sender and delete the material from any computer.<br>
</font>
</body>
</html>