KM Prak
Reputation: 127
Copy directory recursively from one Hadoop cluster to another
How can I copy a directory recursively from cluster1 to cluster2 in Hadoop HDFS? The outcome I would like is a directory structure mirrored with data.
Upvotes: 0
Views: 1507
Answers (1)
Mohamed IMLI
Reputation: 38
Use the built in tool distcp :
bash$ hadoop distcp hdfs://nn1:8020/foo/bar \ hdfs://nn2:8020/bar/foo
See the documentation here : Distcp tool
Upvotes: 1
Related Questions
- hadoop copy a local file system folder to HDFS
- hdfs copy multiple files to same target directory
- Hadoop copying directory with contents
- Java: HDFS copy directory
- Hadoop copy a directory?
- How to copy files from HDFS to remote HDFS
- Copy multiple directory using hadoop command
- copy data from one HDFS directory to another continuously
- Hadoop - Recursive copy/put from local to HDFS
- Hadoop Distcp Copy Contents inside directory to directory with same name