CODEWITHSUNDEEP
eclipsescalamaven
Mbula Guy Marcel
Mbula Guy Marcel

Reputation: 81

Maven setup for spark project in Eclipse Scala IDE

Im using Eclipse for Scala IDE to develop a Spark application. Im using a Maven project, but when i try to import sparkcon like : 

import org.apache.spark.SparkConf

I have the error :

object apache is not a member of package org can you help me to setup spark dependancies

Upvotes: 0

Views: 4182

Answers (2)

SharpLu
SharpLu

Reputation: 1214

Please check the tutorial from

https://sparktutorials.github.io/2015/04/02/setting-up-a-spark-project-with-maven.html

Online tutorial

https://www.youtube.com/watch?v=4sO-VgqHLp4

Upvotes: 0

Gamer1120
Gamer1120

Reputation: 236

You need to put the Spark dependency in your pom.xml file. As of now, the latest version of Spark can be obtained by putting:

<dependency>
    <groupId>org.apache.spark</groupId>
    <artifactId>spark-core_2.10</artifactId>
    <version>2.2.0</version>
</dependency>

in the dependencies in your pom.xml.

Upvotes: 2

Related Questions