CODEWITHSUNDEEP
apache-sparkhiveapache-spark-sql
WestCoastProjects
WestCoastProjects

Reputation: 63042

How to specify which hive metastore to connect to?

Going back a few versions of Spark it used to be required to put the 

 hive-site.xml

in the $SPARK_HOME/conf directory. Is that still the case?

The motivation for this question: we are unable to see hive tables that are defined within the metastore instance for which we did copy the hive-site.xml to the conf dir.

Upvotes: 1

Views: 726

Answers (1)

WestCoastProjects
WestCoastProjects

Reputation: 63042

I have verified that the hive-site.xml is still used. It is selected from the classpath of spark. This may be set up via

 export SPARK_CLASSPATH=/path/to/conf/dir

Upvotes: 1

Related Questions