CODEWITHSUNDEEP
python-3.xairflow
amina
amina

Reputation: 19

Airflow Branch Operator and S3KeySensor doesnot respect trigger_rule='none_failed'

I have 3 S3KeySensors on different files in different folders. 2 of them have to be successful and the third one can be skipped.I am trying to trigger the downstream task with the trigger_rule='none_failed' but S3KeySensor doesnot seem to respect that. This is how my DAG looks like.

This is how it behaves

This is how i want it to behave:

Upvotes: 1

Views: 309

Answers (1)

arunvelsriram
arunvelsriram

Reputation: 1096

You have to set trigger_rule="none_failed_or_skipped" to test_step task as explained in this documentation.

From the documentation:
none_failed_or_skipped: all parents have not failed (failed or upstream_failed) and at least one parent has succeeded.

Upvotes: 1

Related Questions