CODEWITHSUNDEEP
azureazure-data-factory
Milestones
Milestones

Reputation: 1

Is there a way to pick up the latest file to process using Azure Data Factory?

Is there a way to pick up the latest file to process using Azure Data Factory? The files are landing in a folder structure by year/month/day/[file1]...

In the day folder the files will land every hour and my job will also be scheduled to pick it up every hour.

Thanks in advance.

Upvotes: 0

Views: 988

Answers (1)

Jayendran
Jayendran

Reputation: 10960

Currently you could use the Custom-Activity,with the help of C# code you can do this.

Also you can schedule our pipeline to run for every hours basics.Since you are receiving the files in an hourly basics

Hope this Helps!

Upvotes: 0

Related Questions