Mqi
Mqi

Reputation: 117

Import from sql server to hbase, retrieved 395809 records from sql using sqoop, but only 365587 rows in hbase

Import data from sql server to hbase, retrieved 395809 records from sql using sqoop, but only 365587 rows in hbase.

The import command I used is

 sqoop import --hbase-table test --hbase-row-key conversation_id --column-family cf1 --columns conversation_id,app_id --connect "jdbc:sqlserver://******;database=*******;username=test;password=*******" --table test -m 1

The command I used to create Hbase table is

 create 'test',{NAME=>'cf1',BLOCKCACHE=> false,BLOCKSIZE=>1073741824}

How can I solve this problem?

Thanks,

Mqi

Upvotes: 1

Views: 99

Answers (1)

generalpiston
generalpiston

Reputation: 891

It's difficult to say, but chances are conversation_id is not unique. For more interactive help on this subject, try the sqoop mailing lists.

Upvotes: 1

Related Questions