[Pdns-users] Slaves aren't fetching zones fast enough.

[Tyler Hall]

[This is my second attempt to email this, sorry if it gets double posted]


Hi all -

My master nameserver runs bind, and all of my slaves are running pdns.

mysql> select * from domains where name='test7.com'\G
*************************** 1. row ***************************
             id: 57952
           name: test7.com
         master: 69.46.16.x
     last_check: 1222612625
           type: SLAVE
notified_serial: NULL
        account: NULL
1 row in set (0.00 sec)

Here is my pdns.conf;

launch=gmysql
gmysql-host=127.0.0.1
gmysql-user=root
gmysql-dbname=pdns
webserver=yes
webserver-address=0.0.0.0
webserver-password=xxxxx
slave=yes
slave-cycle-interval=300
daemon=yes

My problem is that pdns doesn't seem to process the slaves fast enough.

$ cat /var/log/messages | grep 'need checking'
Sep 28 04:04:30 dyndns pdns[3466]: 8217 slave domains need checking
Sep 28 04:34:22 dyndns pdns[3466]: 12940 slave domains need checking
Sep 28 05:04:20 dyndns pdns[3466]: 9156 slave domains need checking
Sep 28 05:31:17 dyndns pdns[3466]: 15371 slave domains need checking
Sep 28 06:03:33 dyndns pdns[3466]: 8504 slave domains need checking
Sep 28 06:29:32 dyndns pdns[3466]: 5542 slave domains need checking
Sep 28 06:53:20 dyndns pdns[3466]: 5270 slave domains need checking
Sep 28 07:16:28 dyndns pdns[3466]: 6298 slave domains need checking

I have a little over 50,000 domains in the system and it some of our
customers are waiting days to get their changes being added to the system
(especially when we add new domains) For example, when I added test7.com, it
wasn't added into the master nameserver at first.   Therefore the first few
times it tried to grab the zone and then failed.     After it failed a few
times, it sat there for a few days before actually getting it.   It knew it
was stale, however didn't do an axfr.

--

messages.1:Sep 26 15:15:52 dyndns pdns[3466]: Error trying to
retrieve/refresh 'test7.com': Query to '69.46.16.x' for SOA of 'test7.com'
produced a NS record
messages.1:Sep 26 15:41:38 dyndns pdns[3466]: Error trying to
retrieve/refresh 'test7.com': Query to '69.46.16.x' for SOA of 'test7.com'
produced a NS record
messages.1:Sep 26 16:07:29 dyndns pdns[3466]: Error trying to
retrieve/refresh 'test7.com': Query to '69.46.16.x' for SOA of 'test7.com'
produced a NS record
messages.1:Sep 26 16:32:52 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 16:57:28 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 17:22:25 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 17:49:04 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 18:26:34 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 19:03:32 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 19:39:09 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 20:03:44 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 20:26:45 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 20:50:32 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 21:14:12 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 21:37:22 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 22:00:08 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 22:22:51 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 22:46:40 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 23:10:36 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 23:34:20 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 26 23:57:00 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 00:19:49 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 00:43:00 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 01:05:14 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 01:27:49 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 01:53:16 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 02:18:22 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 02:48:04 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 03:17:55 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 03:44:45 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 04:17:19 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 04:40:03 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 05:04:17 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 05:27:49 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 05:50:38 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 06:13:24 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 06:37:42 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 07:02:00 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 07:25:30 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0
messages.1:Sep 27 07:49:21 dyndns pdns[3466]: Domain test7.com is stale,
master serial 1, our serial 0

--

>From what I gather, it just seems that there's a limited number of "checks"
it will do at a given time, and it can't keep up.   Is there anyway to
increase that limit, or make sure it's able to check all these domains in
short amounts of time (less then 60m?)

Thanks.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.powerdns.com/pipermail/pdns-users/attachments/20080928/28084ada/attachment-0001.html>