How to make a web crawler?

Help me in web crawler.?

  • Dear frnds, I want to make a web crawler but i do not know how to make it.Can someone help me in making a web crawler and can someone know where i learn it.I know html,css,javascript,php and ajax. if some one want to contact with me my email is [email protected] . Please help me if u know any site or any other thing to where i learn it.

  • Answer:

    A webcrawler needs to make two things: - Fetching pages - Parse the page for url's to crawl If it does not need to be massively parallel you can use your knowledge of php and maybe the PHPCrawl library. The Webpage has documentation and examples. http://phpcrawl.cuab.de/

Arafn Haider at Yahoo! Answers Visit the source

Was this solution helpful to you?

Just Added Q & A:

Find solution

For every problem there is a solution! Proved by Solucija.

  • Got an issue and looking for advice?

  • Ask Solucija to search every corner of the Web for help.

  • Get workable solutions and helpful tips in a moment.

Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.