CODEWITHSUNDEEP
hadoopbenchmarkinghadoop2
eagertoLearn
eagertoLearn

Reputation: 10132

where is hadoop-test.jar in Hadoop2?

I want to use testmapredsort for benchmarking sort in Hadoop. I am NOT using TeraSort now.

hadoop-*test*.jar is supposed to contain the testmapredsort class. But I do not see hadoop-*test*.jar in Hadoop2. 

hadoop jar hadoop/share/hadoop/common/hadoop-common-2.2.0-tests.jar testmapredsort /data/unsorted-data -sortOutput /data/sorted-data

Upvotes: 0

Views: 1096

Answers (1)

Dennis Huo
Dennis Huo

Reputation: 10677

In Hadoop 1, testmapredsort is launched from AllTestDriver.java, which was indeed in e.g. hadoop-test-1.2.1.jar. In Hadoop 2, it's now in MapredTestDriver.java, which can be found inside of hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar

hadoop jar hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar testmapredsort -sortInput /data/unsorted-data -sortOutput /data/sorted-data

Upvotes: 2

Related Questions