Sparkuser191
Reputation: 23
Where should Apache Livy be installed in cluster
We want to use apache Livy so that we can invoke spark job from restapi. So do we need to install Livy server on name node or edge node. What is the best practice.
Our spark fat jar will reside in NFS path.
Upvotes: 0
Views: 219
Answers (1)
Chris
Reputation: 23
Livy can be installed anywhere.You just need to configure it correctly to use the resource manager.It would be easier to configure if you install in Edge node from where you run the spark-submit.
Upvotes: 1
Related Questions
- Where to install livy or spark job server in cloudera setup
- Getting the version of Livy on the cluster
- Is it possible to configure Apache Livy to run with Spark Standalone?
- How can we install Apache Livy outside spark cluster?
- Apache Livy : How to share the same spark session?
- Apache Livy doesn't work with local jar file
- Apache Spark and Livy cluster
- Configuring Livy with Cloudera 5.14 and Spark2: Livy can't find its own JAR files
- Error when running Spark by livy
- How to set spark.driver.extraClassPath through Apache Livy on Azure Spark cluster?