CODEWITHSUNDEEP
hadoopsqoop
Madhusudhan
Madhusudhan

Reputation: 91

Incremental import of Oracle tables which does not have primary key to HDFS

I have Oracle database with almost 300 tables out of that 200 tables doesn't have any primary key and few tables have composite primary key. My requirement is to import all tables data in incremental manner to HDFS. Can you please let me know how this can be achieved using Sqoop. It would be great help if any other option is suggested.

Upvotes: 2

Views: 215

Answers (1)

Dennis Jaheruddin
Dennis Jaheruddin

Reputation: 21563

Unfortunately, being unable to recognize updated rows (you indicate that you do not track update timestamps), makes it practically impossible to use incremental loads to capture the changes.

Some possibilities:

  1. Add timestamps
  2. Do a full load
  3. Use the rownumber to identify new records, and don't process updated records

Upvotes: 1

Related Questions