CODEWITHSUNDEEP
hadoop
Vishwanath Sharma
Vishwanath Sharma

Reputation: 231

Copy multiple directory using hadoop command

I know that hadoop has capability to copy multiple directory at the same time to common target path by using following command :-

hadoop fs -cp dir1 dir2 dir3 target

but i want to know that what is the max number of directory or files that i can copy simultaneously.

Upvotes: 0

Views: 386

Answers (1)

Raju Sharma
Raju Sharma

Reputation: 2516

Copying directories does not have any limitations (You can think of Integer.MAX_VALUE). The files, directories and blocks in HDFS are stored in Namenode memory.

But there is limit of hardware you would be using , Scaling up much beyond the hardware limit is the problem here.

Upvotes: 1

Related Questions