CODEWITHSUNDEEP
pythonlinuxscrapy
Mats
Mats

Reputation: 71

Resetting paused scrape, Scrapy

I know that with the command:

scrapy crawl somespider -s JOBDIR=crawls/somespider-1

I can pause/resume scrapes with CTRL+C.

What I want to know is how I can reset the scrapy and start back at the beginning. Is there a file I need to delete/empty?

M.

Upvotes: 7

Views: 255

Answers (1)

Danil
Danil

Reputation: 5171

Yes, you should remove your JOBDIR

scrapy crawl somespider -s JOBDIR=crawls/somespider-1
<ctr+C>
rm -rf crawls/somespider-1

Upvotes: 6

Related Questions