CODEWITHSUNDEEP
apache-spark
hammadspark
hammadspark

Reputation: 85

IOException in my code java

I use spark using java, whenever I try to run my code it appears an IOException in this lines of code : 

     SparkConf conf = new SparkConf().setAppName("myapp").setMaster("local[*]");
     JavaSparkContext sc = new JavaSparkContext(conf);

the detail of this exception is : 

Could not locate executable null\bin\winutils.exe in the Hadoop binaries.

and when i tried to download winutils.exe and installed it i got this message :

the program cant start bcz MSVCR100.dll is misssing

so how can i solve it please?

Upvotes: 0

Views: 388

Answers (2)

hammadspark
hammadspark

Reputation: 85

finally i fixed this issue , i just followed the way explained in this link , it s easy and clear and efficient link: http://teknosrc.com/spark-error-java-io-ioexception-could-not-locate-executable-null-bin-winutils-exe-hadoop-binaries/ wanna thank you #Nishu Tayal

Upvotes: 0

Nishu Tayal
Nishu Tayal

Reputation: 20820

You need to set HADOOP_HOME variable to some path. Place winutils.exe inside %HADOOP_HOME%\bin.

For the MSVCR100.dll, download it and install.

Make sure, that you download 32 bit/64 bit winutils.exe and dll as per your machine configuration.

Here is the link to setup spark on windows: How to run Apache Spark on Windows7 in standalone mode

Hope it helps you..

Upvotes: 1

Related Questions