CODEWITHSUNDEEP
mavenintellij-ideaapache-spark
J.Fratzke
J.Fratzke

Reputation: 1465

Running Spark Unit Tests in IntelliJ

I have a spark job I'm developing in IntelliJ. It's builds via maven, the tests pass, and I can run the job locally. However, If I try to run the tests via IntelliJ, I get

Error:scalac: bad symbolic reference. A signature in SparkContext.class refers to term akka in package root which is not available. It may be completely missing from the current classpath, or the version on the classpath might be incompatible with the version used when compiling SparkContext.class.

Upvotes: 1

Views: 541

Answers (1)

J.Fratzke
J.Fratzke

Reputation: 1465

I ended up just busting and rebuilding the IMLs in IntelliJ and this fixed the issue.

Upvotes: 0

Related Questions