Linked Service with self-hosted integration runtime is not supported in data flow in Azure Data Factory

Question

Step to reproduce:

1. I created a Copy Data first in the pipeline to simple transfer CSV files frol Azure VM to Azure Blob storage. I always use IRPOC1 as a connection via integration runtime and connect using SAS URI and SAS Token to my Blob Storage

2. After validate and run my first Copy Data, I successfully have CSV file transfer from my VM to Blob storage

3. I tried to add a new Data Flow after the Copy Data activity

4. In my Data Flow, my source is the Blob storage containing the CSV files transferred from VM, my Sink is my Azure SQL Database with successful connection

5. However, when I ran validation, I got the error message on my Data Flow Source:

   Linked Service with self-hosted integration runtime is not supported in data flow.

I saw someone replied on Microsoft Azure Document issue Github that I need to use Copy Data to transfer data to Blob first. Then use the source from this blob with data. This is what I did but I still have the same error. Could you please let me know how I can fix this?

Answer 1

solution:

go to linked service -> (azure SQL Database) -> go to edit then

select version as legacy.

Answer 2

Self-hosted IR does not support the execution of data flows (SHIR is not supported in data flows).

https://techcommunity.microsoft.com/t5/azure-data-factory-blog/new-data-flow-connector-sql-server-as-source-and-sink/ba-p/2406213

Answer 3

The Data Flow source dataset must use a Linked Service that uses an Azure IR, not a self-hosted IR.

Go to the dataset in your data flow Source, click "Open". In the dataset page, click "Edit" next to Linked Service.

In the Linked Service dialog, make sure you are using an Azure Integration Runtime, not a Self-hosted IR.