Is there a meta search engine or aggregator that crawlers or searches a site to display results without storing the data in a database?
-
I heard about data protection laws and am thinking of it is possible to have a meta search engine crawl search sites to present results without saving the data on a database and then search it from there. I know that sites like http://Indeed.com, http://simplyhired.com, http://careerjet.com are aggregators, do they save data on the database or not?
-
Answer:
These sites (like my site http://Adzuna.co.uk) save listings data in their databases or search indices, this is a necessary condition for making the data searchable. Google, Bing etc do the same. Data protection laws are not relevant as I understand it here, they apply to personal data which these sites don't generally deal with.
Doug Monro at Quora Visit the source
Other answers
I'm with Doug on this one in so far as data protection laws are prob not the issue. However, the site's terms and conditions may trip you up. RyanAir went to a lot of trouble in Europe preventing price comparison sites aggregating its data. I'd do my homework on the T&Cs.
John Dennehy
You can't build a sustainable search engine without storing data "locally". Performance wise, it will be a very bad idea. Local caches are a very important method to provide a fast and user-friendly service.
Elie Messo
Related Q & A:
- Is HTML meta element effective to increase a site's search ranking?Best solution by Webmasters
- What's a good search engine for a large corporate intranet?Best solution by Software Recommendations
- How do you add a yahoo search engine to your own website?Best solution by Yahoo! Answers
- How do I go about creating a custom search engine for my website?Best solution by Stack Overflow
- What would be a good name for a new search engine?Best solution by ChaCha
Just Added Q & A:
- How many active mobile subscribers are there in China?Best solution by Quora
- How to find the right vacation?Best solution by bookit.com
- How To Make Your Own Primer?Best solution by thekrazycouponlady.com
- How do you get the domain & range?Best solution by ChaCha
- How do you open pop up blockers?Best solution by Yahoo! Answers
For every problem there is a solution! Proved by Solucija.
-
Got an issue and looking for advice?
-
Ask Solucija to search every corner of the Web for help.
-
Get workable solutions and helpful tips in a moment.
Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.