pentaho merge rows diff with using text file inputs

Question

I have a text file that I need to load into a database... I used merge rows(diff)... I compared the text file input with table input step.. i used sorted merge for sorting columns for both text file input and table input steps.. and i used merge rows(diff) step followed by Synchronize after merge... My problem is if i run my job first time its inserting the text file data to database.. and the second time also its inserting same rows again into the database... Can any one please help me what mistake i did..

Answer 1

use " Insert / Update " step in your transformation.. so it will avoid your duplication problem.

Insert/update Description