[Pdns-users] SIGSEGV after some AXFR queries
Marek Kroemeke
marek at positive-internet.com
Mon Jun 29 13:36:05 UTC 2009
Hi there,
Thanks for suggestions. I was trying to find the particular domain that
could have some odd data in MySQL - but the problem is that this DNS
server seems to send around ~40 AXFR requests in a row - I was not able
to find one particular domain in log that would be there before each
crash :-/
We've also tried to upgrade it last Friday to the newer version (2.9.21
and then 2.9.22) - but then all replies to AXFR requests ware empty
(no error message, no serv fail - just SOA record and nothing else - so
I had to fall back. Any suggestions about this one ?
Thanks again,
Marek
bert hubert wrote:
> Marek,
>
> Indeed - both 2.9.21 and 2.9.22 contain important updates to the TCP
> component of PowerDNS. So please consider upgrading, or follow
> Kenneth's excellent suggestion.
>
> Kind regards,
>
> Bert Hubert
>
> On Mon, Jun 29, 2009 at 3:17 PM, Kenneth Marshall<ktm at rice.edu> wrote:
>
>> Marek,
>>
>> Version 2.9.20 is pretty old, so maybe this problem is fixed in
>> a later release. I know that I have seen this sort of problem when
>> bad data was in the database. Maybe you could try validating the
>> data for the zone that is being requested by the AXFR? Just a
>> thought.
>>
>> Regards,
>> Ken
>>
>> On Mon, Jun 29, 2009 at 02:12:34PM +0100, Marek Kroemeke wrote:
>>
>>> Hi there,
>>>
>>> We are having some very odd crashes (SIGSEGV) on one of our servers - we
>>> found in logs that each crash always happens 1-2 seconds after there are
>>> AXFR requests from one particular DNS server (I doubt that it's a
>>> coincidence).
>>>
>>> --
>>> OS: Linux, Debian Etch
>>> Kernel: 2.6.18-6-686
>>> Powerdns-server: 2.9.20-8+etch1
>>> --
>>>
>>> Did anyone notice similar crashes ?
>>>
>>> Thanks,
>>>
>>> Marek Kroemeke
>>>
>>> ----- cut -----
>>> Jun 28 07:07:14 pdns[3078]: Got a signal 11, attempting to print trace:
>>> Jun 28 07:07:14 pdns[3078]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 28 07:07:14 pdns[3078]: [0xb7f74420]
>>> Jun 28 07:07:14 pdns[3078]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 28 07:07:14 pdns[3078]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 28 07:07:14 pdns[3078]: /lib/tls/i686/cmov/libpthread.so.0 [0xb7e2f240]
>>> Jun 28 07:07:14 pdns[3078]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7dc449e]
>>> Jun 28 07:07:15 pdns[31421]: Our pdns instance (3078) exited after signal 6
>>> Jun 28 07:07:15 pdns[31421]: Respawning
>>> Jun 28 07:07:16 pdns[10651]: Guardian is launching an instance
>>> --
>>> Jun 28 13:42:48 pdns[10651]: Got a signal 11, attempting to print trace:
>>> Jun 28 13:42:48 pdns[10651]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 28 13:42:48 pdns[10651]: [0xb7f77420]
>>> Jun 28 13:42:48 pdns[10651]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 28 13:42:48 pdns[10651]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 28 13:42:48 pdns[10651]: /lib/tls/i686/cmov/libpthread.so.0
>>> [0xb7e32240]
>>> Jun 28 13:42:48 pdns[10651]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7dc749e]
>>> Jun 28 13:42:49 pdns[31421]: Our pdns instance (10651) exited after
>>> signal 6
>>> Jun 28 13:42:49 pdns[31421]: Respawning
>>> Jun 28 13:42:50 pdns[20919]: Guardian is launching an instance
>>> --
>>> Jun 28 14:24:05 pdns[20919]: Got a signal 11, attempting to print trace:
>>> Jun 28 14:24:05 pdns[20919]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 28 14:24:05 pdns[20919]: [0xb7f2d420]
>>> Jun 28 14:24:05 pdns[20919]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 28 14:24:05 pdns[20919]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 28 14:24:05 pdns[20919]: /lib/tls/i686/cmov/libpthread.so.0
>>> [0xb7de8240]
>>> Jun 28 14:24:05 pdns[20919]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7d7d49e]
>>> Jun 28 14:24:05 pdns[31421]: Our pdns instance (20919) exited after
>>> signal 6
>>> Jun 28 14:24:05 pdns[31421]: Respawning
>>> Jun 28 14:24:06 pdns[25298]: Guardian is launching an instance
>>> --
>>> Jun 28 16:26:10 pdns[25298]: Got a signal 11, attempting to print trace:
>>> Jun 28 16:26:10 pdns[25298]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 28 16:26:10 pdns[25298]: [0xb7f81420]
>>> Jun 28 16:26:11 pdns[25298]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 28 16:26:11 pdns[25298]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 28 16:26:11 pdns[25298]: /lib/tls/i686/cmov/libpthread.so.0
>>> [0xb7e3c240]
>>> Jun 28 16:26:11 pdns[25298]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7dd149e]
>>> Jun 28 16:26:11 pdns[31421]: Our pdns instance (25298) exited after
>>> signal 6
>>> Jun 28 16:26:11 pdns[31421]: Respawning
>>> Jun 28 16:26:12 pdns[6046]: Guardian is launching an instance
>>> --
>>> Jun 28 16:41:10 pdns[6046]: Got a signal 11, attempting to print trace:
>>> Jun 28 16:41:10 pdns[6046]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 28 16:41:10 pdns[6046]: [0xb7f3f420]
>>> Jun 28 16:41:10 pdns[6046]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 28 16:41:10 pdns[6046]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 28 16:41:10 pdns[6046]: AXFR of domain 'thedisabilitychallenge.com'
>>> initiated by 69.41.170.223
>>> Jun 28 16:41:10 pdns[6046]: /lib/tls/i686/cmov/libpthread.so.0 [0xb7dfa240]
>>> Jun 28 16:41:10 pdns[6046]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7d8f49e]
>>> Jun 28 16:41:10 pdns[31421]: Our pdns instance (6046) exited after signal 6
>>> Jun 28 16:41:10 pdns[31421]: Respawning
>>> --
>>> Jun 28 16:45:09 pdns[7682]: Got a signal 11, attempting to print trace:
>>> Jun 28 16:45:09 pdns[7682]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 28 16:45:09 pdns[7682]: [0xb7f6b420]
>>> Jun 28 16:45:10 pdns[7682]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 28 16:45:10 pdns[7682]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 28 16:45:10 pdns[7682]: /lib/tls/i686/cmov/libpthread.so.0 [0xb7e26240]
>>> Jun 28 16:45:10 pdns[7682]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7dbb49e]
>>> Jun 28 16:45:10 pdns[31421]: Our pdns instance (7682) exited after signal 6
>>> Jun 28 16:45:10 pdns[31421]: Respawning
>>> Jun 28 16:45:10 pdns[8301]: Guardian is launching an instance
>>> --
>>> Jun 28 22:33:00 pdns[8301]: Got a signal 11, attempting to print trace:
>>> Jun 28 22:33:00 pdns[8301]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 28 22:33:00 pdns[8301]: [0xb7fde420]
>>> Jun 28 22:33:00 pdns[8301]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 28 22:33:00 pdns[8301]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 28 22:33:00 pdns[8301]: /lib/tls/i686/cmov/libpthread.so.0 [0xb7e99240]
>>> Jun 28 22:33:00 pdns[8301]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7e2e49e]
>>> Jun 28 22:33:00 pdns[31421]: Our pdns instance (8301) exited after signal 6
>>> Jun 28 22:33:00 pdns[31421]: Respawning
>>> Jun 28 22:33:01 pdns[15035]: Guardian is launching an instance
>>> --
>>> Jun 28 22:55:49 pdns[15035]: Got a signal 11, attempting to print trace:
>>> Jun 28 22:55:49 pdns[15035]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 28 22:55:49 pdns[15035]: [0xb7f6b420]
>>> Jun 28 22:55:49 pdns[15035]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 28 22:55:49 pdns[15035]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 28 22:55:49 pdns[15035]: /lib/tls/i686/cmov/libpthread.so.0
>>> [0xb7e26240]
>>> Jun 28 22:55:49 pdns[15035]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7dbb49e]
>>> Jun 28 22:55:49 pdns[31421]: Our pdns instance (15035) exited after
>>> signal 6
>>> Jun 28 22:55:49 pdns[31421]: Respawning
>>> Jun 28 22:55:50 pdns[17623]: Guardian is launching an instance
>>> --
>>> Jun 29 00:01:52 pdns[17623]: Got a signal 11, attempting to print trace:
>>> Jun 29 00:01:52 pdns[17623]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 29 00:01:52 pdns[17623]: [0xb7f88420]
>>> Jun 29 00:01:52 pdns[17623]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 29 00:01:52 pdns[17623]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 29 00:01:52 pdns[17623]: /lib/tls/i686/cmov/libpthread.so.0
>>> [0xb7e43240]
>>> Jun 29 00:01:53 pdns[17623]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7dd849e]
>>> Jun 29 00:01:53 pdns[31421]: Our pdns instance (17623) exited after
>>> signal 6
>>> Jun 29 00:01:53 pdns[31421]: Respawning
>>> Jun 29 00:01:53 pdns[25601]: Guardian is launching an instance
>>> --
>>> Jun 29 00:44:03 pdns[25601]: Got a signal 11, attempting to print trace:
>>> Jun 29 00:44:03 pdns[25601]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 29 00:44:03 pdns[25601]: [0xb7f52420]
>>> Jun 29 00:44:03 pdns[25601]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 29 00:44:03 pdns[25601]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 29 00:44:03 pdns[25601]: /lib/tls/i686/cmov/libpthread.so.0
>>> [0xb7e0d240]
>>> Jun 29 00:44:03 pdns[25601]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7da249e]
>>> Jun 29 00:44:03 pdns[31421]: Our pdns instance (25601) exited after
>>> signal 6
>>> Jun 29 00:44:03 pdns[31421]: Respawning
>>> Jun 29 00:44:04 pdns[29822]: Guardian is launching an instance
>>> --
>>> Jun 29 00:45:08 pdns[29822]: Got a signal 11, attempting to print trace:
>>> Jun 29 00:45:08 pdns[29822]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 29 00:45:08 pdns[29822]: [0xb7f31420]
>>> Jun 29 00:45:08 pdns[29822]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 29 00:45:08 pdns[29822]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 29 00:45:08 pdns[29822]: /lib/tls/i686/cmov/libpthread.so.0
>>> [0xb7dec240]
>>> Jun 29 00:45:08 pdns[29822]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7d8149e]
>>> Jun 29 02:32:45 pdns[6566]: Guardian is launching an instance
>>> --
>>> Jun 29 04:53:34 pdns[6566]: Got a signal 11, attempting to print trace:
>>> Jun 29 04:53:34 pdns[6566]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 29 04:53:34 pdns[6566]: [0xb7f6f420]
>>> Jun 29 04:53:34 pdns[6566]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 29 04:53:35 pdns[6566]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 29 04:53:35 pdns[6566]: /lib/tls/i686/cmov/libpthread.so.0 [0xb7e2a240]
>>> Jun 29 04:53:35 pdns[6566]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7dbf49e]
>>> --
>>> Jun 29 05:37:34 pdns[20512]: Got a signal 11, attempting to print trace:
>>> Jun 29 05:37:35 pdns[20512]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 29 05:37:35 pdns[20512]: [0xb7f77420]
>>> Jun 29 05:37:35 pdns[20512]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 29 05:37:35 pdns[20512]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 29 05:37:35 pdns[20512]: /lib/tls/i686/cmov/libpthread.so.0
>>> [0xb7e32240]
>>> Jun 29 05:37:35 pdns[20512]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7dc749e]
>>> Jun 29 05:37:35 pdns[6564]: Our pdns instance (20512) exited after signal 6
>>> Jun 29 05:37:35 pdns[6564]: Respawning
>>> Jun 29 05:37:36 pdns[24881]: Guardian is launching an instance
>>>
>>> Jun 29 07:33:00 pdns[24881]: Got a signal 11, attempting to print trace:
>>> Jun 29 07:33:00 pdns[24881]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 29 07:33:00 pdns[24881]: [0xb7f0a420]
>>> Jun 29 07:33:00 pdns[24881]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 29 07:33:00 pdns[24881]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 29 07:33:00 pdns[24881]: /lib/tls/i686/cmov/libpthread.so.0
>>> [0xb7dc5240]
>>> Jun 29 07:33:00 pdns[24881]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7d5a49e]
>>> Jun 29 07:33:00 pdns[6564]: Our pdns instance (24881) exited after signal 6
>>> Jun 29 07:33:00 pdns[6564]: Respawning
>>> Jun 29 07:33:01 pdns[5184]: Guardian is launching an instance
>>> --
>>> Jun 29 11:23:19 pdns[5184]: Got a signal 11, attempting to print trace:
>>> Jun 29 11:23:19 pdns[5184]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 29 11:23:19 pdns[5184]: [0xb7f28420]
>>> Jun 29 11:23:19 pdns[5184]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 29 11:23:19 pdns[5184]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 29 11:23:19 pdns[5184]: /lib/tls/i686/cmov/libpthread.so.0 [0xb7de3240]
>>> Jun 29 11:23:19 pdns[5184]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7d7849e]
>>> Jun 29 11:23:20 pdns[6564]: Our pdns instance (5184) exited after signal 6
>>> Jun 29 11:23:20 pdns[6564]: Respawning
>>> Jun 29 11:23:21 pdns[28770]: Guardian is launching an instance
>>> --
>>> Jun 29 13:39:12 pdns[28770]: Got a signal 11, attempting to print trace:
>>> Jun 29 13:39:12 pdns[28770]: /usr/sbin/pdns_server-instance [0x80b76ba]
>>> Jun 29 13:39:12 pdns[28770]: [0xb7fc8420]
>>> Jun 29 13:39:12 pdns[28770]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver6doAXFRERKSsP9DNSPacketi+0x3ef)
>>> [0x80923cf]
>>> Jun 29 13:39:12 pdns[28770]:
>>> /usr/sbin/pdns_server-instance(_ZN13TCPNameserver12doConnectionEPv+0xede)
>>> [0x8094c9e]
>>> Jun 29 13:39:12 pdns[28770]: /lib/tls/i686/cmov/libpthread.so.0
>>> [0xb7e83240]
>>> Jun 29 13:39:12 pdns[28770]: /lib/tls/i686/cmov/libc.so.6(__clone+0x5e)
>>> [0xb7e1849e]
>>> Jun 29 13:39:13 pdns[6564]: Our pdns instance (28770) exited after signal 6
>>> Jun 29 13:39:13 pdns[6564]: Respawning
>>> Jun 29 13:39:14 pdns[11116]: Guardian is launching an instance
>>> ----- cut -----
>>>
>>> --
>>> All postal correspondence to: Positive House, 24 Broadway, London. W13 0SU
>>>
>>> The Positive Internet Company Limited is registered in England and Wales.
>>> Registered company number: 3673639. VAT no: 726 7072 28.
>>> Registered office: Northside House, Mount Pleasant, Barnet, Herts, EN4 9EE.
>>> _______________________________________________
>>> Pdns-users mailing list
>>> Pdns-users at mailman.powerdns.com
>>> http://mailman.powerdns.com/mailman/listinfo/pdns-users
>>>
>>>
>> _______________________________________________
>> Pdns-users mailing list
>> Pdns-users at mailman.powerdns.com
>> http://mailman.powerdns.com/mailman/listinfo/pdns-users
>>
>>
>> !DSPAM:4a48beff252652035518197!
>>
>>
>>
>
>
--
All postal correspondence to: Positive House, 24 Broadway, London. W13 0SU
The Positive Internet Company Limited is registered in England and Wales.
Registered company number: 3673639. VAT no: 726 7072 28.
Registered office: Northside House, Mount Pleasant, Barnet, Herts, EN4 9EE.
More information about the Pdns-users
mailing list