CODEWITHSUNDEEP
amazon-s3sqoopamazon-redshift
Swaroop Kumar Patra
Swaroop Kumar Patra

Reputation: 51

sqoop export to redshift

I was exploring option of exporting data from s3 to redshift using Sqoop. It turned out that instead of providing "--batch" option, insert was happing record by record. Can anyone help me with how I can perform batch insert to Redshift.

Thanks, Swaroop

Upvotes: 0

Views: 1881

Answers (1)

Sandesh Deshmane
Sandesh Deshmane

Reputation: 2305

To load data from S3 to redshift, you can use copy commands. Copy commands works in parallel and they load data faster. Also they take care of compressions.

You can use PHP, shell or java programs to load data to redshift.

Details for copy command are here

Upvotes: 1

Related Questions