user2562618
Reputation: 337
How to move data between hadoop clusters
I have 2 hadoop clusters running on VMs. How do I move HDFS data between those clusters. I can scp the data on HDFS, how about metadata that sits on Data nodes ? Thanks
Upvotes: 0
Views: 727
Answers (1)
Chris Gerken
Reputation: 16392
Look at DistCp. It's a part of hadoop that does inter/intra cluster copying of data.
Upvotes: 6
Related Questions
- How to copy data from one HDFS to another HDFS?
- How to migrate data between clusters?
- How to migrate existing Hbase data to a new cluster
- how to copy from hive table to hive table across clusters?
- Moving partial data across hadoop instances
- How to replicate data in one Hadoop cluster to another Hadoop cluster?
- Hadoop and multiple clusters
- Transfer data between hadoop clusters
- Transferring whole HDFS from one Cluster to another
- getting data in and out of hadoop