CODEWITHSUNDEEP
djangoherokucelerybackground-process
Alexis
Alexis

Reputation: 25233

Getting the Twitter stream on Heroku with Django App

I need to constantly monitor a Twitter stream using Heroku. Basically what I want to do is start the monitoring process up and never have it stop. I was looking into celery, but from my understanding of it, it looks like a user initiated or short term process adds tasks to a queue that are then processed by another queue. This is different model than having a background process constantly monitoring a Twitter stream. What would be the best way to monitor a Twitter stream for a Django app on Heroku?

Upvotes: 2

Views: 640

Answers (1)

Jake O
Jake O

Reputation: 159

I'm not aware of anything in Django that can run in the background like that. It's certainly one of the limitations of living in the web-app sandbox.

If you have access to your server in Heroku (?) you could write your own script/application along the lines of this tutorial and daemonize using Supervisord.

if not: Celery has a nice periodic scheduler. If you're okay with polling instead of streaming (API), I might just use the twitter REST API and the scheduler in Celery to periodically poll and update. It's helpful to match the scheduling with the rate limits as well.

Upvotes: 4

Related Questions