CODEWITHSUNDEEP
hadoophdfsclouderahortonworks-data-platformbiginsights
buckeyeosu
buckeyeosu

Reputation: 45

Copy files from Remote Unix and Windows servers into HDFS without intermediate staging

How can I copy files from remote Unix and Windows servers into HDFS without intermediate staging from the command line?

Upvotes: 2

Views: 1576

Answers (2)

proksch_ibm
proksch_ibm

Reputation: 278

You can use WebHDFS and cURL to upload files. This will not require having any hadoop binaries on your client, just a cURL or cURL like client. The BigInsights Knowledge Center has information on how to administer the file system using the HttpFS REST APIs.

Upvotes: 1

Mauro Midolo
Mauro Midolo

Reputation: 1958

You can use following command:

hadoop fs -cp /user/myuser/copyTestFolder/* hdfs://remoteServer:8020/user/remoteuser/copyTestFolder/

or vice versa to copy from server to local machine.

You can also read the hadoop documentation.

Upvotes: 1

Related Questions