CODEWITHSUNDEEP
postgresqlhadoopgson
user1680859
user1680859

Reputation: 1194

How to import data from PostgreSQL to Hadoop?

I'm just a beginner in Hadoop and one of my colleges asked me for help in migrating some of PostgreSQL tables to Hadoop. Since I don't have much experience with PostgreSQL (I know databases though), I am not sure what would be the best way for this migration to happen. One of my ideas was to export the tables as gson data and then to process them from the Hadoop, as in this example: http://www.codeproject.com/Articles/757934/Apache-Hadoop-for-Windows-Platform. Are there better ways to import data (tables & databases) from PostgreSQL to Hadoop?

Upvotes: 2

Views: 6581

Answers (2)

Javaid Mir
Javaid Mir

Reputation: 71

Use the below command. It is working for me.

sqoop import --driver=org.postgresql.Driver --connect jdbc:postgresql://localhost/your_db --username you_user --password your_password --table employees --target-dir /sqoop_data -m 1

Upvotes: 1

Amar
Amar

Reputation: 3845

Sqoop (http://sqoop.apache.org/) is a tool precisely made for this. Go through the documentation, sqoop provides the best and the easiest way to transfer your data.

Upvotes: 4

Related Questions