CODEWITHSUNDEEP
concurrencyazure-data-factorydatabricksorchestration
Emna Jaoua
Emna Jaoua

Reputation: 381

Concurrency in Azure DataFactory

I have an Azure Data Factory Pipeline where it has 24 parallel jobs : databricks notebooks. In the Pipeline configuration I set concurrency to 4 but when I run the Pipeline the 24 jobs start to run in parallel although I want just 4 of them to start running in the first place. According to the documentation here , I can run 4 parallel jobs and the others will be in queued status. am I missing another paramater to configure ? enter image description here

Thank you in advance :)

Upvotes: 0

Views: 889

Answers (1)

Himanshu Kumar Sinha
Himanshu Kumar Sinha

Reputation: 1776

The link which you are following is for ADF v1 , it clearly mention's that on top of the doc . The feature which you are trying to use is for adf v2 .

"[!NOTE] This article applies to version 1 of Data Factory. If you are using the current version of the Data Factory service, see pipeline execution and triggers article."

Upvotes: 1

Related Questions