CODEWITHSUNDEEP
azure-blob-storageazure-data-factory
Grégory Vial
Grégory Vial

Reputation: 13

Azure Data Factory copy activity creates empty files

Whenever I use ADF copy activity with Blob as source/sink, ADF creates an empty file named after the directory of the sink Blob. For instance, if I want to copy from input/file.csv to process/file.csv, the copy happens but I also have a blob called "process" with size 0 byte created each time.

Any idea why?

Source Sink

Upvotes: 0

Views: 3165

Answers (2)

user16607687
user16607687

Reputation: 11

This happens if you have a storage ADLS gen2 but you have not enabled the Hierarchical namespace and you select the ADLS gen2 while defining your Linked Service and Dataset. A quick fix for this is use Azure Blob Storage when defining LS and DS.

Upvotes: 1

Leon Yue
Leon Yue

Reputation: 16431

Firstly, I would suggest you optimize you pipeline copy active settings.

Since you are copying one file from one container/folder to another, you can directly set the source file with parameter. Wildcard path expression *.csv is usually used for folder the same type of files.

You can test again and check if the empty file exist again.

HTH.

Upvotes: 0

Related Questions