CODEWITHSUNDEEP
hadoop
Gank
Gank

Reputation: 4667

hadoop on windows, how to add D:\folder1 and E:\folder1 to hdfs?

hadoop fs -put popularNames.txt /user/hadoop/dir1/popularNames.txt

My folders are very huge, about 3 TB. I don't want to copy the folder, I want to set the hdfs to the location. How to make it?

Upvotes: 0

Views: 386

Answers (1)

Ani Menon
Ani Menon

Reputation: 28209

HDFS: Hadoop distributed file system.

You can't add a link to point to a location, because the data must be present in the HDFS(not on local). The whole point of using hadoop is distributed computation, which is possible when your data is distributed on a cluster.

hadoop fs -put had to be used to move the file from your local to the hdfs in order to use hadoop framework.

Upvotes: 1

Related Questions