How do you scale a recursive DNS resolver, and what are your issues with this?
-
How do you scale a recursive DNS to support clients doing lots and lots of DNS requests? Clients could be DNS-heavy beasts like a web crawler, doing requests for lots of different host names: cache misses are higher than cache hits, and given the average low TTLs, the cache expires multiple times a day. So pretty much all requests go to the upstream server, and issues happen here: many hostnames have the same DNS servers (GoDaddy's, Wordpress's, etc) or are on the same network. You get rate-limited by upstream servers (lots of DNS requests coming from the same host - is it a DNS-reflection attack?), by your hosting service (are you running a DNS-reflection attack?), and by everything in the middle.
-
Answer:
Just set up multiple servers you claimed to have when you register the domain.... DNS will automatically load balance between them.... if you need something more then use traditional load balancing
Aryeh Friedman at Quora Visit the source
Other answers
To scale resolvers should not be needed under normal circumstances. DNS servers do have a quite good cache management. But if you are experiencing problems here are some ideas: - clients support several resolvers. Set up three or more resolvers and give a list of resolvers to your clients - give every client a local resolver (forwarding only). If a client crawls one website at a time it will ask for the same information a lot of times and get it faster from a local cache. This will lower pressure on your resolvers. - Depending on the use patterns more memory (more cache) for your resolvers could be a good idea.
Ulrich Wisser
Related Q & A:
- How to Scale a Mobile App?Best solution by Stack Overflow
- How does one create a recursive lexer?Best solution by stackoverflow.com
- How do you become a marine mammal vet and what exactly do they do?Best solution by Yahoo! Answers
- How do I fix a DNS error on a PSP?Best solution by wikihow.com
- How do you scale up a HO Gauge train to a 7.5 Gauge Live Steam?Best solution by Yahoo! Answers
Just Added Q & A:
- How many active mobile subscribers are there in China?Best solution by Quora
- How to find the right vacation?Best solution by bookit.com
- How To Make Your Own Primer?Best solution by thekrazycouponlady.com
- How do you get the domain & range?Best solution by ChaCha
- How do you open pop up blockers?Best solution by Yahoo! Answers
For every problem there is a solution! Proved by Solucija.
-
Got an issue and looking for advice?
-
Ask Solucija to search every corner of the Web for help.
-
Get workable solutions and helpful tips in a moment.
Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.