How can I bulk download whois data from a database of URL's?
-
I know that there are existing APIs for getting this data, but what I would like to know is HOW these services can gather it. Since there is a limit on the number of WHOIS requests a single IP can do, and InterNIC (as I recall) has prohibited bulk access to the WHOIS data, how is it legally possible? Also, is there a way to get bulk access to only the creation date?
-
Answer:
Technically this is against the terms and conditions of ANY WHOIS server. So I would advise against it ....
Sam Barnes at Quora Visit the source
Other answers
Hi! I will start by saying yes, there is a way to get only the creation date from doing a Whois look up. If it exists in the information returned by the query (which it does) you can easily grab it. If you are using the API, there is no restriction on the number of look ups you can do from a single IP. You have to pay to be able to use the specific API you choose and it usually has a fee associated with the number of "look ups" you want to perform. I believe the https://www.arin.net/ is the governing body over the publicity of information associated with domain purchases. There is also a European and Asian equavalent. I find it rather confusing, but encourage you to read up on it yourself. As for the legality behind it, it is public information and unless someone pays for domain privacy you can grab it. This is a grey area on the web. If you want to check out a bulk whois tool you can check out http://emailextractoronline.com Hope this helps!
Michael George Keating
Newly Registered Domains as daily downloads. Whois data are also provided as an option. Supported TLDs are â.com, .net, .org, .us, .biz, .mobi, .info, .pro, .coop, .asia, .name, .tel, .aeroâ plus hundreds of new gTLDs! . http://www.spiralbig.com/
Host Bili
You can get whois database daily updates from http://getwhoisdata.com/ Get many domains database in full detail. Every day almost 200K domains gets registered and many gets dropped. All detailed database is available. I see its the cheapest and best data so far.
Bhavik Hingrajia
You can use a service like EasyWhoisPro to monitor for new domains that are registered and they provide you with their whois details. Youâll also have the option just download the domains that arenât using privacy protection.They charge $49.95/month and offer a 30-day free trial so you can make sure you like the service.Hereâs their website: http://www.easywhoispro.com
James Sanz
Related Q & A:
- How can I echo characters before and after a string?Best solution by stackoverflow.com
- How can I send an http request at a specific time?Best solution by Stack Overflow
- How can I teach in University with just a Masters?Best solution by Yahoo! Answers
- How can I correct sent emails from showing a wrong return address?Best solution by Yahoo! Answers
- How can I find out the names of my great great grandfather's parents?Best solution by Yahoo! Answers
Just Added Q & A:
- How many active mobile subscribers are there in China?Best solution by Quora
- How to find the right vacation?Best solution by bookit.com
- How To Make Your Own Primer?Best solution by thekrazycouponlady.com
- How do you get the domain & range?Best solution by ChaCha
- How do you open pop up blockers?Best solution by Yahoo! Answers
For every problem there is a solution! Proved by Solucija.
-
Got an issue and looking for advice?
-
Ask Solucija to search every corner of the Web for help.
-
Get workable solutions and helpful tips in a moment.
Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.