Kate
Kate

Reputation: 53

Compare two tables to find missing rows dynamically in Azure Data Factory

I have a Mapping table that stores Source and destination table name. I want to compare source table data with destination table data and find out the missing rows. Table names should be passed dynamically in data flow mapping.

Upvotes: 1

Views: 3796

Answers (2)

Paul
Paul

Reputation: 1

Do you have an example syntax when using the same dynamic column name $ColumnName for both the streams? Because all I get is true because I assume the $ColumnName seems to be evaluated as a string and then "string = string" evaluates to true.

In some of the documentation it indicates inputStream@column == inputStream@column so I tried eg sourceStaging@$ColumnName == sourceWarhouse@$ColumnName... but that doesn't work either.

Upvotes: 0

Mark Kromer MSFT
Mark Kromer MSFT

Reputation: 3838

Use the Exists transformation in ADF data flows with the "Does not exists" option.

enter image description here

Upvotes: 1

Related Questions