pakachu
pakachu

Reputation: 77

can spider get item after all pipelines pass?

My Process is.

  1. spider item go to pipelines ( multiple pipelines )

  2. item must be changed because of pipelines (maybe translation, Imagepipelines)..

  3. spider get the changed item and Based on item, request another.

enter image description here

My Problem is.

  1. return item(in spider) is not make sense and function is done.
  2. yield item pass item after first pipeline done.

I want to get item ALL Passed pipelines..

Upvotes: 0

Views: 57

Answers (1)

VMRuiz
VMRuiz

Reputation: 1981

You can use the item_scraped signal to let a spider know when an item has passed all the item pipelines.

https://doc.scrapy.org/en/latest/topics/signals.html#item-scraped

Upvotes: 1

Related Questions