<div dir="ltr">Hi Remi,<div><br></div><div>yes all servers are on VMware, 8 cpu, 8G Ram. OS is Centos ( Linux release 7.6.1810 (Core) 3.10.0-957.27.2.el7.x86_64)</div><div><br></div><div>have disabled selinux and all firewall/iptables,</div><div><br></div><div>performance on Bind (BIND 9.14.4 (Stable Release)) directly is 50-60K QPS sorry for the typo,</div><div><br></div><div>i have tried setMaxUDPOutstanding(65535) as well</div><div><br></div><div>as well as i added 8 Local server using reusePort=true ( and also confirmed with netstat -ln there were 8 running threads)</div><div><br></div><div>i also added 8 new servers with combination of both BIND servers or only 1 server. tried different Server policies, leastoutstanding/roundrobin etc.</div><div><br></div><div>For the dnsdist version these are 3 versions i have tried ( i have them all on same machine, playing with systemd service file on which one to activate)</div><div><br></div><div>Compiled concur version:</div><div> /usr/local/dnsdist/bin/dnsdist -V<br>dnsdist 0.0.dnsdistconcur.g (Lua 5.1.4)<br>Enabled features: systemd<br></div><div><br></div><div>Repo version from centos/epel:</div><div>/usr/bin/dnsdist -V<br>dnsdist 1.3.3 (Lua 5.1.4 [LuaJIT 2.0.4])<br>Enabled features: dns-over-tls(openssl) dnscrypt libsodium protobuf recvmmsg/sendmmsg systemd<br></div><div><br></div><div>Compiled main master version:</div><div>/usr/local/bin/dnsdist -V<br>dnsdist 0.0.17315.0.master.g32ffe8cde3 (Lua 5.1.4)<br>Enabled features: ipcipher recvmmsg/sendmmsg snmp <br></div><div><br></div><div><br></div><div>I also tried having BIND and DNSDIST on same machine ( listening different interfaces) and also on separate machines, </div><div>but no much effect. in all cases Dnsdist has very low QPS compared to directly testing Bind.</div><div><br></div><div>some tweaks, besides removing any security/firewall:</div><div><br></div><div> sysctl -w net.ipv4.conf.all.forwarding=1<br> sysctl -w net.core.rmem_max=33554432<br> sysctl -w net.core.wmem_max=33554432<br> sysctl -w net.core.rmem_default=16777216<br>sysctl -w net.core.wmem_default=16777216<br></div><div>ulimit -n 16000</div><div>fs.file-max = 70000<br></div><div><br></div><div>more /etc/security/limits.conf | grep dnsdist<br>dnsdist soft nofile 65535<br>dnsdist soft nofile 65535<br></div><div><br></div><div><br></div><div><br></div><div>thanks</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, 8 Aug 2019 at 10:52, Remi Gacogne <<a href="mailto:remi.gacogne@powerdns.com">remi.gacogne@powerdns.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi Gentian,<br>
<br>
On 8/8/19 10:20 AM, Gentian Bajraktari wrote:<br>
> but when we test with resperf (from dnsperf tool), the results are very<br>
> bad for DNSDIST, around 5-15K QPS , while when we test directly to one<br>
> of BIND ip addresses the QPS goes up to 50-60Qps.<br>
<br>
Those are very low numbers, for dnsdist but also for Bind (assuming you<br>
mean 50-60k qps), on what hardware are you testing this? Is this a VM?<br>
<br>
> we have tried both rpm install of dnsdist, compiling from source and<br>
> even comiling the concur version but all with similar results, ie when<br>
> resperf tests go through dnsdist the results are much lower in terms of qps.<br>
<br>
Knowing the exact version of dnsdist would help a lot.<br>
<br>
Did you read the tuning guide [1]? At the very least you should set<br>
setMaxUDPOutstanding(65535). You are also using a single thread for<br>
receiving UDP queries which might not be what you want, although you<br>
should get much more than 15k qps even with a single thread.<br>
<br>
> OS is Centos7 in all servers, tweaked all settings for file limits, udp<br>
> connections etc.<br>
<br>
Did you disable any firewall? Remove any connection tracking modules? It<br>
would be very useful to know exactly what you tweaked.<br>
<br>
[1]: <a href="https://dnsdist.org/advanced/tuning.html" rel="noreferrer" target="_blank">https://dnsdist.org/advanced/tuning.html</a><br>
<br>
Best regards,<br>
-- <br>
Remi Gacogne<br>
PowerDNS.COM BV - <a href="https://www.powerdns.com/" rel="noreferrer" target="_blank">https://www.powerdns.com/</a><br>
<br>
_______________________________________________<br>
dnsdist mailing list<br>
<a href="mailto:dnsdist@mailman.powerdns.com" target="_blank">dnsdist@mailman.powerdns.com</a><br>
<a href="https://mailman.powerdns.com/mailman/listinfo/dnsdist" rel="noreferrer" target="_blank">https://mailman.powerdns.com/mailman/listinfo/dnsdist</a><br>
</blockquote></div>