CODEWITHSUNDEEP
azureazure-data-factory
marknorkin
marknorkin

Reputation: 4074

Azure Data Factory, BlobEventsTrigger: configure blob path with scheduledTime value which is dynamic content

I have an Azure Data Factory pipeline with two triggers:

I would like for blob event trigger to wait for a marker file in storage account under dynamic path e.g.:

landing/some_data_source/some_dataset/@{formatDateTime(@trigger().scheduledTime, 'yyyyMMdd')}/_SUCCESS

Refering to @trigger().scheduledTime doesn't work.

How to pass scheduleTime parameter value from schedule trigger to blob event trigger ?

Upvotes: 0

Views: 1545

Answers (1)

KarthikBhyresh-MT
KarthikBhyresh-MT

Reputation: 5034

If I understand correctly, you are trying to edit blob event trigger fields Blob path begins with or Blob path ends with - using the scheduleTime from the scheduleTrigger!

Unfortunately, as we can confirm from the official MS doc Create a trigger that runs a pipeline in response to a storage event

Blob path begins with and ends with are the only pattern matching allowed in Storage Event Trigger. Other types of wildcard matching aren't supported for the trigger type.

It takes the literal values.

This does not work: enter image description here

enter image description here

Only if you have a file names as same ! Unlikely

enter image description here enter image description here

Also, this dosen't

enter image description here

But, this would

enter image description here

Workaround:

As discussed with @marknorkin earlier, since this is not available out-of-the-box in BlobEventTrigger, we can try use Until activity composed from GetMetadata+Wait activities, where in GetMetadata will check for dynamic path existence.

Upvotes: 1

Related Questions