CODEWITHSUNDEEP
pythonpython-2.7xpathscrapycp1251
John Doe
John Doe

Reputation: 149

scrapy misses xpaths where xpath contains cp1251

Values response:

{
 'articul': [u'testetete'],
 'diametr': ['Empty'],
 'image': [u'/foto/11.20.jpg'],
 'name': [u'Трололололо'],
 'url': ['http://test.ru/goods/detali.html?product_id=20']
}

where other fields?

Upvotes: 0

Views: 128

Answers (1)

Vladimir Chub
Vladimir Chub

Reputation: 471

It's because add_xpath method gets XPath as argument only. If you need to add another one (such as "Масса" or "Состав") to value that spider takes from xpath, you can add it to pipelines.py , or to your another module, that takes results from Spider.

Upvotes: 0

Related Questions