CODEWITHSUNDEEP
hadoop
Muhammad Danish Khan
Muhammad Danish Khan

Reputation: 93

Not a Valid Jar When Running Hadoop Job

I want to run WordCount Example.

In eclipse it run correctly. In output folder the output file is present.

I made a jar file of WordCount and want to run it through command 

hadoop jar WordCount.jar /Projects/input /Projects/output

it gives me error

Not a valid JAR: /Projects/WordCount.jar

result of hdfs dfs -ls /Projects

Found 3 items
-rw-r--r-- 1 hduser supergroup 3418 2014-11-02 15:38 /Projects/WordCount.jar
drwxr-xr-x - hduser supergroup 0 2014-11-02 14:13 /Projects/input
drwxr-xr-x - hduser supergroup 0 2014-11-02 14:16 /Projects/output

it gives me same error on this also

  hadoop jar /Projects/WordCount.jar wordPackage.WordCount  /Projects/input /Projects/output

 Not a valid JAR: /Projects/WordCount.jar

how to solve this error.

I have run tvf command it gives this output

 jar -tvf /home/hduser/Desktop/Files/WordCount.jar

  60 Sun Nov 02 16:10:10 PKT 2014 META-INF/MANIFEST.MF
 1895 Sun Nov 02 14:02:38 PKT 2014 wordPackage/WordCount.class
 1295 Sun Nov 02 14:02:38 PKT 2014 wordPackage/WordCount.java
 2388 Sun Nov 02 14:02:06 PKT 2014 wordPackage/WordReducer.class
 707 Sun Nov 02 14:02:06 PKT 2014 wordPackage/WordReducer.java
 2203 Sun Nov 02 14:02:08 PKT 2014 wordPackage/WordMapper.class
 713 Sun Nov 02 14:02:06 PKT 2014 wordPackage/WordMapper.java
 16424 Sun Nov 02 13:50:00 PKT 2014 .classpath
 420 Sun Nov 02 13:50:00 PKT 2014 .project

Upvotes: 9

Views: 24795

Answers (3)

Venugopal
Venugopal

Reputation: 31

in spite of rebuilding your jar again if issue still persists, Please make sure you have given +x(execution chmod 755) privileges before you run the command. in my case this was the reason for the issue. command help: chmod +x jarname.jar

Upvotes: 0

Mohammed Asad
Mohammed Asad

Reputation: 1009

I faced the same issue. But in my case what I did was I wrote the java code referring to hadoop 1.x libraries and tried to execute it using 2.x. Initially, I got the same error in the terminal. Then I tried navigating to the path where I had my jar file. It worked.

May be you can actually try the following:(after navigating to the jar files path)

hadoop jar WordCount.jar  wordPackage.WordCount /Projects/input /Projects/output

Upvotes: -1

SachinJose
SachinJose

Reputation: 8522

You cannot keep the jar in HDFS when executing the same using hadoop command, Jar should be available in the local path

If the jar is not runnable try the following (Need to specify the package.mainclass)

hadoop jar /home/hduser/Desktop/Files/WordCount.jar wordPackage.WordCount /Projects/input /Projects/output

If the jar is runnable following can be used

hadoop jar /home/hduser/Desktop/Files/WordCount.jar /Projects/input /Projects/output

If the issue still persists, you need to rebuild this jar(WordCount.jar) in eclipse again

Upvotes: 11

Related Questions