CODEWITHSUNDEEP
azureazure-data-factoryazure-data-lake-gen2
noobCoder50
noobCoder50

Reputation: 25

How can I iterate over folders and Merge all files in them using data Factory?

I have Folders in a Year , Month , Day fashion stored in Datalake as given below. I want to merge all files from a particular Month using ADF.

Is it possible to achieve this in ADF ?

Edit 1 - I need to merge all the files in Month to one single Output file. In above case File 1,File 2,File 3 and File 4 will be merged as One single file

Upvotes: 0

Views: 982

Answers (1)

Steve Johnson
Steve Johnson

Reputation: 8660

Yes, you can achieve this by Copy activity.

  1. create Source and use Wildcard paths to specify the files you want to copy. enter image description here

2.choose Merge files option in Sink. enter image description here

3.you can define your output file name here. enter image description here

Update: enter image description here

Upvotes: 2

Related Questions