CODEWITHSUNDEEP
azure-data-factory
Anoop M
Anoop M

Reputation: 23

Compare Get metadata activity with lookup output

I was trying to do a delta load using ADF. I have a get meta data activity on my blob location to read all the files using getchildItem and lookup activity which reads loaded file names from a sql table. Following this I have a filter activity which should filter out the new files from the blob location. ADF pipeline

expression on items

@activity('GetRawFilenames').output.childItems

expression on Condition

@not(contains(activity('GetLoadedFilesList').output.value,item().name))

But still its not filtering out the file list in the filter output. Could the experts please help? Thanks in advance..

Upvotes: 1

Views: 3735

Answers (1)

vondravl
vondravl

Reputation: 140

Have a look at this. They describe same problem. Expression on condition should be:

@not(contains(join(activity('GetLoadedFilesList').output.value,','),item().name))

so after joining of GetLoadedFilesList activity your code should be working

Upvotes: 1

Related Questions