Reputation: 186662
Let's say I want to parse Sherdog news feeds. Is the only way to retrieve them by parsing the public xml files? Is there not some service that sites have that "pushes" the content onto your server?
I'm under the impression the common way to do this is to setup a cron job that say, every 10 minutes hits a page such as this, and inserts items into a database if they are not already in there.
Is this the case? If not, can someone educate me?
Upvotes: 2
Views: 289
Reputation: 262734
Yes, polling RSS feeds is the de-facto standard. RSS readers and servers should support caching mechanisms (most importantly HTTP conditional GETs) to make this efficient.
An emerging approach to get rid of polling is PubSubHubub, which does indeed push notifications to subscribers.
Upvotes: 2