Reputation: 782
I've built a crawler using Scrapy to crawl into a site and extract links. I want the crawler to run everyday at a certain time. I found out the python's sched to perform scheduling but i could not find out where to start from. Any help would be highly useful.
Upvotes: 0
Views: 124
Reputation: 5931
This is where you should look into the operating systems scheduler. On linux and alike you would typically use cronjobs:
http://www.cyberciti.biz/faq/how-do-i-add-jobs-to-cron-under-linux-or-unix-oses/
On MS Windows you would typically use Windows Task Scheduler:
http://windows.microsoft.com/en-au/windows/schedule-task#1TC=windows-7
Upvotes: 2