Reputation: 1
I have set up an ADF pipeline to trigger whenenver a new file lands in the ADLS Gen2(source). The pipeline should copy the json file from ADlS(Gen2) and sink in Azure SQL db.
In ADF, I am using event based trigger: Type: BlobEventTrigger , Event : Blob Created
Here is the problem, I am facing
The ADF pipeline works file, when I manually upload the file to ADLS, to test/debug my ADF pipeline. The trigger get activated, the pipeline copies the data from ADLS to SQL db
However, when a file programmatically gets dropped in ADLS(as append blob), the trigger is not activated and thus ADF pipeline is not activated
I need to know:
Tried both event types:
Upvotes: 0
Views: 158
Reputation: 8301
How to create an event based trigger in ADF, when a append blob event occurs in ADLS
you are appending the blob means you are updating/modifying the blob.
In ADF storage event triggers It will trigger the pipeline in two scenarios whenever the new blob is getting created and when the existing blob is getting updated.
I created a trigger to run pipeline when blob is created or updated in specific container. settings as below:
check the blob updated time and pipeline triggered time.
Upvotes: 0