What exactly is URL scraping?

If I have a URL of a news article, how can I grab its RSS Feed Entry?

  • My application needs to fetch the exact contents of the RSS Feed entry corresponding to that news article URL. Scraping/Parsing the page is not an option.

  • Answer:

    Without knowing your specific application development environment, it's hard to be precise. The key technology to do what you want is "auto-discovery". This is when a site embeds the location of its RSS feeds in the meta data of the web page. So you don't need to scrape or parse. Many tools support auto-discovery. So if you have an RSS package that supports auto-discovery, one typically creates an object using the web page URL rather than the RSS feed URL. Then the tool will look for the embedded <link> tags and automatically discover the RSS feed location. Here's a link to more on this: http://www.rssboard.org/rss-autodiscovery

Brad Balfour at Quora Visit the source

Was this solution helpful to you?

Other answers

Are you trying to fetch the category of the article or are you fine if you generate an rss feed for that article? A kind of 1 item feed for that specif article

Charly Omer

Related Q & A:

Just Added Q & A:

Find solution

For every problem there is a solution! Proved by Solucija.

  • Got an issue and looking for advice?

  • Ask Solucija to search every corner of the Web for help.

  • Get workable solutions and helpful tips in a moment.

Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.