meder omuraliev
meder omuraliev

Reputation: 186662

How do sites go about retrieving "new" items from rss feeds?

Let's say I want to parse Sherdog news feeds. Is the only way to retrieve them by parsing the public xml files? Is there not some service that sites have that "pushes" the content onto your server?

I'm under the impression the common way to do this is to setup a cron job that say, every 10 minutes hits a page such as this, and inserts items into a database if they are not already in there.

Is this the case? If not, can someone educate me?

Upvotes: 2

Views: 289

Answers (1)

Thilo
Thilo

Reputation: 262734

Yes, polling RSS feeds is the de-facto standard. RSS readers and servers should support caching mechanisms (most importantly HTTP conditional GETs) to make this efficient.

An emerging approach to get rid of polling is PubSubHubub, which does indeed push notifications to subscribers.

Upvotes: 2

Related Questions