How to add bulk virtual data in database?

How can I bulk download whois data from a database of URL's?

  • I know that there are existing APIs for getting this data, but what I would like to know is HOW these services can gather it. Since there is a limit on the number of WHOIS requests a single IP can do, and InterNIC (as I recall) has prohibited bulk access to the WHOIS data, how is it legally possible? Also, is there a way to get bulk access to only the creation date?

  • Answer:

    Technically this is against the terms and conditions of ANY WHOIS server. So I would advise against it ....

Sam Barnes at Quora Visit the source

Was this solution helpful to you?

Other answers

Hi!  I will start by saying yes, there is a way to get only the creation date from doing a Whois look up.  If it exists in the information returned by the query (which it does) you can easily grab it. If you are using the API, there is no restriction on the number of look ups you can do from a single IP.  You have to pay to be able to use the specific API you choose and it usually has a fee associated with the number of "look ups" you want to perform. I believe the https://www.arin.net/ is the governing body over the publicity of information associated with domain purchases.  There is also a European and Asian equavalent.  I find it rather confusing, but encourage you to read up on it yourself. As for the legality behind it, it is public information and unless someone pays for domain privacy you can grab it.  This is a grey area on the web. If you want to check out a bulk whois tool you can check out http://emailextractoronline.com Hope this helps!

Michael George Keating

Newly Registered Domains as daily downloads. Whois data are also provided as an option. Supported TLDs are “.com, .net, .org, .us, .biz, .mobi, .info, .pro, .coop, .asia, .name, .tel, .aero” plus hundreds of new gTLDs! . http://www.spiralbig.com/

Host Bili

You can get whois database daily updates from http://getwhoisdata.com/ Get many domains database in full detail. Every day almost 200K domains gets registered and many gets dropped. All detailed database is available. I see its the cheapest and best data so far.

Bhavik Hingrajia

You can use a service like EasyWhoisPro to monitor for new domains that are registered and they provide you with their whois details. You’ll also have the option just download the domains that aren’t using privacy protection.They charge $49.95/month and offer a 30-day free trial so you can make sure you like the service.Here’s their website: http://www.easywhoispro.com

James Sanz

Just Added Q & A:

Find solution

For every problem there is a solution! Proved by Solucija.

  • Got an issue and looking for advice?

  • Ask Solucija to search every corner of the Web for help.

  • Get workable solutions and helpful tips in a moment.

Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.