CODEWITHSUNDEEP
azureazure-data-lakeazure-diagnosticsazure-monitoring
Martin Izquierdo
Martin Izquierdo

Reputation: 21

How to get the information of Diagnostic logs from Azure

If anyone is working with Azure and could help me, I would appreciate it. I am trying to trigger an action every time the creation of a file is logged in an azure data lake path and I need the following to be true:

I have tried to do it with the ADL diagnostic logs by routing them to an eventhub but the events arrive normally after 3 minutes, I have also tried to do it with Log Analytics and it takes longer for the information to arrive

Upvotes: 2

Views: 285

Answers (1)

Gaurav Mantri
Gaurav Mantri

Reputation: 136126

For your scenario, you can make use of Azure Event Grids where an event will be fired as soon as a file is created. You can invoke an Azure Function to consume that event and do further processing.

You can find more information about it in the following links:

https://azure.microsoft.com/en-us/blog/event-driven-analytics-with-azure-data-lake-storage-gen2/

https://learn.microsoft.com/en-us/azure/event-grid/event-schema-blob-storage?toc=%2fazure%2fstorage%2fblobs%2ftoc.json

Upvotes: 1

Related Questions