CODEWITHSUNDEEP
intellij-ideaapache-sparkpom.xmlspark-streaming
Gillespie
Gillespie

Reputation: 2228

How to build Spark with different version of json4s-jackson?

I use Spark 1.4.1, Maven and IntelliJ IDEA 14.1.4.

After finding this question Is it possible to use json4s 3.2.11 with Spark 1.3.0? I realise that in order to use json4s-jackson_2.10:3.2.11 functionality within my Spark streaming application, I need to rebuild Spark with the updated json4s version in the pom file.

How do I go about this?

Upvotes: 0

Views: 430

Answers (1)

Jacek Laskowski
Jacek Laskowski

Reputation: 74619

Change core/pom.xml so it references 3.2.11 (not 3.2.10 as it's now) and build Spark as described in Building Spark.

As to how it changes your applications, you should add the dependencies for Spark and json4s using appropriate versions as provided (since they come with Spark and are provided at runtime by Spark).

Upvotes: 1

Related Questions