CODEWITHSUNDEEP
azure-functionsazure-data-lake
dotnetavalanche
dotnetavalanche

Reputation: 890

Process Azure Datalake store file using Azure function

I am getting files in a particular folder on my Azure Datalake store at regular interval. As soon as file come, I want to process it further using an Azure function. Is that possible?

Upvotes: 2

Views: 4924

Answers (1)

PramodValavala
PramodValavala

Reputation: 6647

UPDATE: With Multi-Protocol Access for Azure Data Lake Storage, the storage extension should indeed work and some basic tests do confirm that.

There are open issues [1, 2] for official confirmation of support.

Though Azure Data Lake Storage (ADLS) Gen2 is built upon Azure Blob Storage, there are a couple of known issues and differences which are documented.

Because of these differences, I believe we can't use the existing bindings available for Blob storage or Event Grid.

But you could still have a Function, triggered by Timer, for example and use the ADLS v2 REST API to read/update files.

Also, depending on your use case of course, you might really want to look into the other integrations that ADLS v2 supports, namely - HDInsight, Databricks, SQL Data Warehouse.

Upvotes: 2

Related Questions