CODEWITHSUNDEEP
azureazure-blob-storageazure-data-factory
JARVIS
JARVIS

Reputation: 855

Load the latest folder from azure blob storage to azure data factory

I have a scenario where I have to fetch the latest folder from the blob storage container and then process all files under that folder through Azure data factory, currently, all folder name based on timestamp and as we know CloudBlobDirectory don't hold LastModified Date so there is no way to extract metadata from Azure data factory activity like last modified time so that I can iterate with the timestamp and process the content.

enter image description here

Is there any other way to perform something like sort on the folder name and then pick it based on string sort (on folder name )?

Upvotes: 0

Views: 314

Answers (1)

All About BI
All About BI

Reputation: 533

I tried something similar using Azure functions.

Please have a look and tell if its of use.

https://www.youtube.com/watch?v=eUMjghIEsjw

Upvotes: 1

Related Questions