[Pdns-users] Recursion issue--SERVFAIL then NOERROR totally at random

Todd Smith TSmith at ninestarconnect.com
Tue Sep 9 17:16:24 UTC 2014


Rather long output here; however, it certainly looks like these results pretty much confirm that the issue is Toyota's, not ours:

Sep  9 12:47:07 yoshi pdns_recursor[31821]: 1 [10690756] question for 'toyotasupplier.com.|A' from 208.88.248.27
Sep  9 12:47:12 yoshi pdns_recursor[31821]: 0 [3961638] question for 'toyotasupplier.com.|A' from 208.88.248.27
Sep  9 12:47:17 yoshi pdns_recursor[31821]: 1 [10691043] question for 'toyotasupplier.com.|A' from 208.88.248.27
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: Looking for CNAME cache hit of 'toyotasupplier.com.|CNAME'
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: No CNAME cache hit of 'toyotasupplier.com.|CNAME' found
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: No cache hit for 'toyotasupplier.com.|A', trying to find an appropriate NS record
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: Checking if we have NS in cache for 'toyotasupplier.com.'
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: NS (with ip, or non-glue) in cache for 'toyotasupplier.com.' -> 'gslb-ns1.toyota-na.com.'
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: within bailiwick: 0, not in cache / did not look at cache
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: NS (with ip, or non-glue) in cache for 'toyotasupplier.com.' -> 'gslb-ns2.toyota-na.com.'
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: within bailiwick: 0, not in cache / did not look at cache
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: We have NS in cache for 'toyotasupplier.com.' (flawedNSSet=0)
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: Cache consultations done, have 2 NS to contact
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: Nameservers: gslb-ns1.toyota-na.com.(0.00ms), gslb-ns2.toyota-na.com.(0.00ms)
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: Trying to resolve NS 'gslb-ns1.toyota-na.com.' (1/2)
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756]    gslb-ns1.toyota-na.com.: Looking for CNAME cache hit of 'gslb-ns1.toyota-na.com.|CNAME'
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756]    gslb-ns1.toyota-na.com.: No CNAME cache hit of 'gslb-ns1.toyota-na.com.|CNAME' found
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756]    gslb-ns1.toyota-na.com.: Found cache hit for A: 63.238.139.235[ttl=80545] 
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: Resolved 'toyotasupplier.com.' NS gslb-ns1.toyota-na.com. to: 63.238.139.235
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: Trying IP 63.238.139.235:53, asking 'toyotasupplier.com.|A'
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: timeout resolving 
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: Trying to resolve NS 'gslb-ns2.toyota-na.com.' (2/2)
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756]    gslb-ns2.toyota-na.com.: Looking for CNAME cache hit of 'gslb-ns2.toyota-na.com.|CNAME'
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756]    gslb-ns2.toyota-na.com.: No CNAME cache hit of 'gslb-ns2.toyota-na.com.|CNAME' found
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756]    gslb-ns2.toyota-na.com.: Found cache hit for A: 12.169.52.62[ttl=80540] 
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: Resolved 'toyotasupplier.com.' NS gslb-ns2.toyota-na.com. to: 12.169.52.62
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: Trying IP 12.169.52.62:53, asking 'toyotasupplier.com.|A'
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: timeout resolving 
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: Failed to resolve via any of the 2 offered NS at level 'toyotasupplier.com.'
Sep  9 12:47:17 yoshi pdns_recursor[31821]: [10690756] toyotasupplier.com.: failed (res=-1)
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: Looking for CNAME cache hit of 'toyotasupplier.com.|CNAME'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: No CNAME cache hit of 'toyotasupplier.com.|CNAME' found
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: No cache hit for 'toyotasupplier.com.|A', trying to find an appropriate NS record
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: Checking if we have NS in cache for 'toyotasupplier.com.'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: NS (with ip, or non-glue) in cache for 'toyotasupplier.com.' -> 'gslb-ns1.toyota-na.com.'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: within bailiwick: 0, not in cache / did not look at cache
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: NS (with ip, or non-glue) in cache for 'toyotasupplier.com.' -> 'gslb-ns2.toyota-na.com.'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: within bailiwick: 0, not in cache / did not look at cache
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: We have NS in cache for 'toyotasupplier.com.' (flawedNSSet=0)
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: Cache consultations done, have 2 NS to contact
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: Nameservers: gslb-ns2.toyota-na.com.(0.00ms), gslb-ns1.toyota-na.com.(0.00ms)
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: Trying to resolve NS 'gslb-ns2.toyota-na.com.' (1/2)
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638]    gslb-ns2.toyota-na.com.: Looking for CNAME cache hit of 'gslb-ns2.toyota-na.com.|CNAME'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638]    gslb-ns2.toyota-na.com.: No CNAME cache hit of 'gslb-ns2.toyota-na.com.|CNAME' found
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638]    gslb-ns2.toyota-na.com.: Found cache hit for A: 12.169.52.62[ttl=73883] 
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: Resolved 'toyotasupplier.com.' NS gslb-ns2.toyota-na.com. to: 12.169.52.62
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: Trying IP 12.169.52.62:53, asking 'toyotasupplier.com.|A'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: timeout resolving 
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: Trying to resolve NS 'gslb-ns1.toyota-na.com.' (2/2)
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638]    gslb-ns1.toyota-na.com.: Looking for CNAME cache hit of 'gslb-ns1.toyota-na.com.|CNAME'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638]    gslb-ns1.toyota-na.com.: No CNAME cache hit of 'gslb-ns1.toyota-na.com.|CNAME' found
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638]    gslb-ns1.toyota-na.com.: Found cache hit for A: 63.238.139.235[ttl=73878] 
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: Resolved 'toyotasupplier.com.' NS gslb-ns1.toyota-na.com. to: 63.238.139.235
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: Trying IP 63.238.139.235:53, asking 'toyotasupplier.com.|A'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: timeout resolving 
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: Failed to resolve via any of the 2 offered NS at level 'toyotasupplier.com.'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [3961638] toyotasupplier.com.: failed (res=-1)
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: Looking for CNAME cache hit of 'toyotasupplier.com.|CNAME'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: No CNAME cache hit of 'toyotasupplier.com.|CNAME' found
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: No cache hit for 'toyotasupplier.com.|A', trying to find an appropriate NS record
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: Checking if we have NS in cache for 'toyotasupplier.com.'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: NS (with ip, or non-glue) in cache for 'toyotasupplier.com.' -> 'gslb-ns1.toyota-na.com.'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: within bailiwick: 0, not in cache / did not look at cache
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: NS (with ip, or non-glue) in cache for 'toyotasupplier.com.' -> 'gslb-ns2.toyota-na.com.'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: within bailiwick: 0, not in cache / did not look at cache
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: We have NS in cache for 'toyotasupplier.com.' (flawedNSSet=0)
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: Cache consultations done, have 2 NS to contact
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: Nameservers: gslb-ns2.toyota-na.com.(0.00ms), gslb-ns1.toyota-na.com.(920.19ms)
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: Trying to resolve NS 'gslb-ns2.toyota-na.com.' (1/2)
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043]    gslb-ns2.toyota-na.com.: Looking for CNAME cache hit of 'gslb-ns2.toyota-na.com.|CNAME'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043]    gslb-ns2.toyota-na.com.: No CNAME cache hit of 'gslb-ns2.toyota-na.com.|CNAME' found
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043]    gslb-ns2.toyota-na.com.: Found cache hit for A: 12.169.52.62[ttl=80535] 
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: Resolved 'toyotasupplier.com.' NS gslb-ns2.toyota-na.com. to: 12.169.52.62
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: Trying IP 12.169.52.62:53, asking 'toyotasupplier.com.|A'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: timeout resolving 
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: Trying to resolve NS 'gslb-ns1.toyota-na.com.' (2/2)
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043]    gslb-ns1.toyota-na.com.: Looking for CNAME cache hit of 'gslb-ns1.toyota-na.com.|CNAME'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043]    gslb-ns1.toyota-na.com.: No CNAME cache hit of 'gslb-ns1.toyota-na.com.|CNAME' found
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043]    gslb-ns1.toyota-na.com.: Found cache hit for A: 63.238.139.235[ttl=80530] 
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: Resolved 'toyotasupplier.com.' NS gslb-ns1.toyota-na.com. to: 63.238.139.235
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: Trying IP 63.238.139.235:53, asking 'toyotasupplier.com.|A'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: query throttled 
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: Failed to resolve via any of the 2 offered NS at level 'toyotasupplier.com.'
Sep  9 12:47:22 yoshi pdns_recursor[31821]: [10691043] toyotasupplier.com.: failed (res=-1)

-----Original Message-----
From: pdns-users-bounces at mailman.powerdns.com [mailto:pdns-users-bounces at mailman.powerdns.com] On Behalf Of bert hubert
Sent: Tuesday, September 09, 2014 1:11 PM
To: Michael Loftis
Cc: pdns-users at mailman.powerdns.com
Subject: Re: [Pdns-users] Recursion issue--SERVFAIL then NOERROR totally at random

Well, as long as one server works you should get an answer.

Try setting a trace-regex on toyota and see what your powerdns reports!

http://doc.powerdns.com/html/rec-control.html - trace-regex

	Bert

On Tue, Sep 09, 2014 at 10:06:03AM -0700, Michael Loftis wrote:
> On Tue, Sep 9, 2014 at 9:55 AM, Brian Menges <bmenges at gogrid.com> wrote:
> > I’d say it’s on Toyota’s end:
> >
> >
> 
> Same here gslb-ns1.toyota-na.com not responding (Comcast, Seattle, WA)
> 
> _______________________________________________
> Pdns-users mailing list
> Pdns-users at mailman.powerdns.com
> http://mailman.powerdns.com/mailman/listinfo/pdns-users

_______________________________________________
Pdns-users mailing list
Pdns-users at mailman.powerdns.com
http://mailman.powerdns.com/mailman/listinfo/pdns-users


More information about the Pdns-users mailing list