Jenish
Jenish

Reputation: 3083

Scrapy + Unicode class is using a lot of memory in scrapy crawl

I tried finding memory leaking solution Guppy and following results came up. As you can see Unicode class is using lot of resources here..

Also,this only happens when I run this on my cloud instance it does not happen when I run this on my local machine..

enter image description here

Here, is picture of prefs() if it is any help.. enter image description here

Here as you can see Selector class is using much resources which it should not be. Moreover I can't seem to find any solution regarding this on internet. I am afraid I might be asking wrong question here..

Any help would be appreciated.. Thanks in advance..

Upvotes: 0

Views: 50

Answers (0)

Related Questions