user-2147482428
user-2147482428

Reputation: 167

Spark installation - warning and error when running spark-shell command

I have Hadoop 2.7.7, Java JDK 13, and Spark 2.4.4. Hadoop is set-up and running correctly. I have defined my paths correctly, and double-checked them. When I run spark-shell command I get the following list of warnings and errors:

enter image description here

What's causing this?

Upvotes: 0

Views: 177

Answers (1)

user-2147482428
user-2147482428

Reputation: 167

Using JDK 8 instead of JDK 13 solved the problem without changing anything else, including the path configurations. Spark just does not seem to like any version of Java past version 8.

Upvotes: 1

Related Questions