CODEWITHSUNDEEP
scalaapache-sparksbt
user7097216
user7097216

Reputation:

SBT dependency Error

This is an SBT build file which I have written

name := "HelloSpark"

version := "1.0"

scalaVersion := "2.12.2"

libraryDependencies += "org.apache.spark" % "spark-core_2.11" % "2.1.1"

when I run sbt package I get error message

[error] (*:update) sbt.ResolveException: unresolved dependency: org.apache.spark#spark-core_2.11;2.1.1: not found

[error] Total time: 2 s, completed Oct 29, 2017 1:01:13 AM

Upvotes: 0

Views: 870

Answers (1)

Dmytro Mitin
Dmytro Mitin

Reputation: 51703

Use Scala 2.11

scalaVersion := "2.11.11"
libraryDependencies += "org.apache.spark" %% "spark-core" % "2.1.1"

using scala 2.12 with spark 2.1

Spark does not support Scala 2.12

Just in case, you can find binaries for spark-core here: https://mvnrepository.com/artifact/org.apache.spark/spark-core_2.11

Upvotes: 2

Related Questions