What are the easiest and best web scraping tool for non-technical people?
-
I want to collect data from a few sites and have it dumped into Excel in a semi-organized way. What tools exists for me to do this easily?
-
Answer:
Unfortunately, there isn't really a "point and click" web scraping tool. If the data you want to get your hands on is already in HTML <table>s though check out Google Spreadsheet's "import table" feature - http://eagereyes.org/data/scrape-tables-using-google-docs
Ashish Datta at Quora Visit the source
Other answers
Check out Visual Web Ripper. There are a number of products that work similarly. If you want to scrape a few sites, they are more than adequate. If you want to scrape many sites, off the shelf tools arent going to work (b/c sites change too frequently). You are going to have to code something up to deal with the constant changes.
Neil Aggarwal
i happened to wrote a python package (https://github.com/tpeng/pydepta) to scrape the content from HTML page by leveraging on tree matches. It can output the content into the HTML tables, change to spreadsheet won't be difficult though.
Terry Peng
Easy Data Feed is one of the easiest and best web scraping tool for non-technical people. Built by this http://www.ecommercetech.info, Easy Data Feed is a data extraction software that is designed to quickly and easily download inventory, pricing and product information. This data can be downloaded into a usable spreadsheet from your drop ship supplierâs online portal without relying on the drop shipper. Easy Data Feed has been specially built for online retailers who are dissatisfied with their drop ship supplier's digital data for inventory, pricing, and even universal product information. Through this software, you can extract inventory data from any website, password protected website, API, email or FTP and plug it right into your store.
Jesus Vassa
Adrian, going to have to disagree with you: There is a point and click web scraping tool, and it's freaking amazing. Check out http://kimonolabs.com! As you'll see, Kimono let's you turn websites into structured data sources with almost minimal effort. (full disclosure: I work for Kimono, but we are awesome). Drop us a line and we'll be happy to help you set up some non-technical web scraping goodness!
Ben Goldstein
When you say easiest, i guess you mean just point and click to extract any data from website.Try http://www.datascraping.coIt's point and click interface to create scraping agent with few click of mouse and with instant extracted data preview. Once you are done with creating scraping agent, you can execute them with desktop app with more advanced feature like batch URL crawling, scheduling, multiple website scraping simultaneously, posting data to server using web hook and http://www.datascraping.co/features.aspxMost interesting is, it's completely free! for any number of website/web pages scraping
Prince Rathee
Diffbot (http://www.diffbot.com) offers a number of Automatic APIs that allow you to extract data from web sites without any rules or setup. Currently these APIs are available for articles/blog posts, product pages, images, discussion threads, and videos. While the above APIs are geared toward developers, our crawling product (Crawlbot) and our Bulk URL service can be used fully within our web dashboard by non-developers. Crawlbot will automatically crawl and process entire sites -- say, to extract all of the product data from sampleshoppingsite.com or all of the discussion threads from sampleforumsite.org -- and return the data in a CSV. The Bulk service will do the same for any number of submitted pages (from tens to millions) from which a user needs to extract data, for example a list of product URLs or news articles.
John Davi
The use of a crawler to extract data from a website may be done legally in relevant business relations. In some circumstances and in some specific jurisdictions, crawling may be in conflict with applicable regulation or in violation of the particular terms of service of the crawled site. Therefore, prior to engaging in crawling activities of any sort, you should consult with a lawyer authorized to provide legal advice in the territory and read carefully the applicable terms of service.Luminati recently introduced: Luminati HTTP/HTTPS Proxy manager >> https://github.com/luminati-io/luminati-proxyYou can also get some more info here: http://j.mp/Hola-Luminati-p2p*Disclaimer ( I work for Luminati Network)
Yair Ida
There are several easiest way for scraping available in the marketplace "NETUCON" is one of the best company for web data scraping.âNETUCONâ company located at Ahmedabad (India) provides the ultimate solution to its customers and software development services with innovation and creativity. Founded by a highly experienced team of IT, and management professionals, Netucon understands the various requirements of client for technology and business, thus, provides the solutions to our valued clients, both in India as well as in abroad. They are expert in providing services like:1. .net development projects(Microsoft .NET Framework 1.1/2.0/3.0/3.5/4.0/4.5)2. Ecommerce Integration(Amazon Integration ,Ebay Integration, Shopify Integration, Volusion Integration)3. Web Data Scraping(Yelp, Just dial, LinkedIn, Government websites, Social networking sites scraping and so onâ¦)4. Quick Book Integration5. Accounting Software Integration 6. Custom Website Development7. ERP Development8. Data entry 9. Data mining10. Lead Generation on âLinkedIn, Twitter and Face bookâ.11. BPO:- Data Processing12. Digital Marketing and so on⦠You can read more about Netucon here: Home (http://www.netucon.com) They also have developers you can hire to do the job for you; their Skype is ânetrocks7â
Ati Jain
There are hundreds of Web Scraping tools available today for both commercial and personal use. The easiest and best web scarpers I prefer for my business data scraping are ScraperWorld. It brings various information quickly and save it into your database in a easy to access and organized way. You will find various useful features that make this scraping quite easy and useful for your business. http://www.scraperworld.com/
Jennifer J. Frey
Related Q & A:
- What is the best language for HTML parsing and web scraping?Best solution by Quora
- What is the best web scraping software for building contact information databases from online directories?Best solution by Quora
- What are some good tools for interactive web scraping and automation?Best solution by Quora
- What are the non-technical things a civil engineer can do?Best solution by Quora
- What are non-technical skills?Best solution by abdn.ac.uk
Just Added Q & A:
- How many active mobile subscribers are there in China?Best solution by Quora
- How to find the right vacation?Best solution by bookit.com
- How To Make Your Own Primer?Best solution by thekrazycouponlady.com
- How do you get the domain & range?Best solution by ChaCha
- How do you open pop up blockers?Best solution by Yahoo! Answers
For every problem there is a solution! Proved by Solucija.
-
Got an issue and looking for advice?
-
Ask Solucija to search every corner of the Web for help.
-
Get workable solutions and helpful tips in a moment.
Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.