CODEWITHSUNDEEP
javaapache-sparkjvmclassloaderoozie
user2895589
user2895589

Reputation: 1030

user lib jar precedence over oozie share lib in spark action

Is below option a best approach to give user jar precedence over oozie share lib jar while running on yarn cluster (to resolve class conflict issue)?

<property>
    <name>oozie.launcher.mapreduce.user.classpath.first</name>
    <value>true</value>
</property>

For more details, Apache Oozie ebook

Upvotes: 0

Views: 487

Answers (1)

Ravikumar
Ravikumar

Reputation: 1131

Yes, you can use this option but sometimes will get unexpected error while running the jobs if jars version is not compatible with yarn/spark cluster library (for example some methods might be removed in latest version).

Upvotes: 1

Related Questions