CODEWITHSUNDEEP
azureazure-data-factory
BlakeB9
BlakeB9

Reputation: 647

Common fixes for a mismatch in row count between Source and Sink databases when using Azure Data Factory Upsert Copy Activity

I've got a pipeline in ADF that has a lookup to grab me all the tables from a couple of schemas as well as key columns that I've personally defined for the tables. I then have a Copy Activity using Upsert. Now, whenever I do a row comparison between the Source database and the Sink database, I notice that there are a lot of tables where the row count is slightly off between the two Source and Sink tables. I'm not sure exactly how to trouble shoot why this is happening. The only thing I could think of is defining new key columns, but I feel they're accurate.

Upvotes: 0

Views: 419

Answers (1)

Himanshu Kumar Sinha
Himanshu Kumar Sinha

Reputation: 1806

I'm not sure exactly how to trouble shoot why this is happening.

This is odd and if the keys are defined correctly it should not happen . Having said that if I were you i would have tried to find the records/rows which are mismatched . To do that you can use Mapping dataflow and set the sink and source as source1 and sourc2 and then use the exists activity .

enter image description here

Upvotes: 0

Related Questions