CODEWITHSUNDEEP
scalaapache-sparkapache-spark-sql
BAR
BAR

Reputation: 17071

Compile Spark for Scala 2.11

When compiling Spark with Scala 2.11 we get errors associated with spark-sql.

build/mvn -Dscala-2.11 -DskipTests clean package

The Spark build docs say: Spark does not yet support its JDBC component for Scala 2.11.

There has to be a way to compile without this.

How do I compile Spark for Scala 2.11?

Upvotes: 2

Views: 823

Answers (1)

BAR
BAR

Reputation: 17071

Before build run:

./dev/change-scala-version.sh 2.11

to change the Scala version. Strangely, this is not mentioned in the docs.

Additionally the error probably isn't related to spark-sql directly but rather some dependency that was compiled with Scala 2.10.

Upvotes: 4

Related Questions