I want to start a price comparison website, but how to get products' data with their price to add my site from other sites like Flipkart, Amazon, or Ebay?
-
-
Answer:
1. you can use a data aggregator like dataweave http://dataweave.in/apis/usage/3/ECommerce-Price-Intelligence-API 2. or best is to write a scraper, I have found scrapy (python) to be the best for task. Am too working on a similar website :)
Keshav Gupta at Quora Visit the source
Other answers
How to get product data with price from different website: 1) Decide your target e-commerce websites and products. 2) Depending upon your expertise, you may choose any scripting language you like to parse the product pages from those websites. I wrote a PHP script long time ago to extract the price for particular product from various websites. 3) Going into technical details: Parsing the DOM Document via PHP will help you to read out the whole source code of the web page. Then depending upon the website, you can decide upon the classes and IDs which you need to pull depending upon your requirements. Go ahead and make it! All the best for your venture. Need any assistance? Feel free to contact me.
Sahil Dua
Get the data from the supplier: Ask the supplier - person who is selling you the product, to provide the data Get the data from Manufacturerâs website: Nokia phone details you can get from http://www.nokia.com/in-en/phones/phone/lumia525/specifications/. Similarly Nikon camera details you can get from http://www.nikon.co.in/en_IN/product/digital-compact-cameras/style/coolpix-s9500#techspecs Crawl another website: Only if they permit: Usually after certain calls the big websites block your IP. Please do check robots.txt file before doing that. Take help of other B2B services. See http://www.diffbot.com/, http://promptcloud.com/index.phpand http://www.grepsr.com/ For price you have to crawl their website. I guess Flipkart provides their API.One well known scrapping Ruby library:Recently, Flipkart, Amazon and Snapdeal released their APIs to pull the product details and price.Read more at http://www.lean-ecommerce.com/2014/01/product-page.htmlDisclaimer: I am the author of the blog
Amjed Shareef
You have two options: 1) If the website has an existing API you can connect to their API and save prices for products directly in your database. You can alternatively, ask the website owners if they will provide this information in CSV format. 2) You can use a tool like http://www.parsehub.com to get all of the prices from different websites, without learning how to code. After running the browser extension, you can download data in CSV format and import it directly on to your website. You can also connect to the ParseHub API, whcih creates APIs for any websites that don't have them.
Angelina Fomina
Get the free shopping comparison API for 5m+ product from PriceTree to make anything you want, or use per-built blog widget(just copy paste code) and append your affiliate IDs for all ecom stores(100% revenue share). API : http://www.pricetree.com/price-comparison-api.aspx Blog Widget : http://www.pricetree.com/blog/10/how-to-increase-flipkart-snapdeal-affiliates-revenue-by-800-
Vicky Rathee
To start a successful price comparison website. I think most important is to find your target market. So 1st point is, find your target market. Identify your competitors and learn about them. Then to answer your question, get xml api from major websites (flipkart, amazon, ebay) and also XML / CSV files from other online shops. Import them into your website if you know programming or purchase Kaon Softwares http://kaonsoftwares.com/eng/price-comparison-script.html which works perfect with meshup results from xml apis and xml / csv datafeeds. Hire a designer or design yourself or ask same company to have an attractive design for your website matching your target market. Start marketing your website. Hope it helps.
Salman
First of all I will praise your motive. You have made a good decision and take it forward. PCWs have good future looking at the growing number of e-commerce websites.Regarding your question- You need to signup with Flipkart, Amazon, or Ebay as affiliate upon which you will be given a unique affiliate ID . Then create a blog or website and pull the products from these websites from the API they provide. Check the API documentation sections of these websites for more details. Join, Filter , sort, scrap the results you get and display it to your users. Now here lies your actual skills to pull specific data from proper categories from all these websites since the category , sub-category structure for all these websites is different. Its a lot of work. Better team up with like minded people and share code with each other. 4. The other option is to signup with affiliate networks (which are usually paid) like http://pricecheckindia.com which I implemented on my website http://LowestPriceIndia.com but the data from them is not reliable. Its old data pulled every 24 hours and not LIVE prices
Balaji B
Getting Merchant feeds and Web scraping are the most commonly used method to get data for comparison. Cost is one of the main concerns when selecting the way to get data. As you are a statup web scraping will be the best way to get data for your use. To get merchant feeds, you need to establish a business relation with them . But web scraping can help you get started quickly. I recently wrote a blog post on this topic - http://blog.datahut.co/technique-used-by-popular-price-comparison-websites-to-grab-data/ Disclosure : I work at http://datahut.co/ .
Adam Smith
Think amazon and ebay have robust APIs with sample scripts for different languages http://fonolive.com
Fonolive Fono
You have to scrape the data of the e-commerce sites at regular interval to get the details of the products. I myself have tried scraping flipkart reviews of products from a search query . I have done it in python using Requests and Beautifulsoup modules. It can be done much efficiently using Scrapy but I haven't tried my hand on it. Selenium is also a popular library to emulate a browser and it can be useful if the data is generated by javascript rather than being embed directly in html but keep in mind that since it emulates a real browser it downloads all the images and other resources as well which would require a good internet bandwith and might take time.Hence depending upon the scale and usability you can choose a framework and start scraping the data. Here is the link of the process I have followed to scrape data https://codeexperiments.quora.com/Extracting-Flipkart-reviews-through-web-scraping . You can follow my bolg for similar coding experiments here https://codeexperiments.quora.com .
Achin Sagar
Related Q & A:
- I want to find a friend who moved address..... how can i do it.Best solution by Yahoo! Answers
- I want to start a BPO.Best solution by Yahoo! Answers
- I want to start a non profit.Best solution by Yahoo! Answers
- I want to start a website.Best solution by Yahoo! Answers
- I want to start a catering business.Best solution by Yahoo! Answers
Just Added Q & A:
- How many active mobile subscribers are there in China?Best solution by Quora
- How to find the right vacation?Best solution by bookit.com
- How To Make Your Own Primer?Best solution by thekrazycouponlady.com
- How do you get the domain & range?Best solution by ChaCha
- How do you open pop up blockers?Best solution by Yahoo! Answers
For every problem there is a solution! Proved by Solucija.
-
Got an issue and looking for advice?
-
Ask Solucija to search every corner of the Web for help.
-
Get workable solutions and helpful tips in a moment.
Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.