CODEWITHSUNDEEP
airflowairflow-scheduler
ThatBoyCap
ThatBoyCap

Reputation: 23

Airflow Executor

I'm still fairly new to using airflow. I have a few dags scheduled to run but they run sequentially. I want them to start running in parallel to each other. So let's say I have a task scheduled to run at 1 pm and another task to run at 2pm. If the first tasks isn't done, by 2pm, I still want the 2pm task to start running and allow the 1pm task to keep going as well.

Upvotes: 0

Views: 326

Answers (1)

kaxil
kaxil

Reputation: 18914

As explained in https://www.astronomer.io/guides/airflow-executors-explained/, you should use LocalExecutor if you want to run more than a single task at any point-in-time.

Upvotes: 1

Related Questions