CODEWITHSUNDEEP
apache-sparkapache-spark-sql
王金洒
王金洒

Reputation: 33

When it runs 'Spark.sql' ,always shows 'WARN Hive: Failed to access metastore. This class should not accessed in runtime'

When it runs 'Spark.sql' ,always shows 'WARN Hive: Failed to access metastore. This class should not accessed in runtime'

The detail is on the picture: enter image description here

Upvotes: 2

Views: 1629

Answers (2)

wypul
wypul

Reputation: 837

You can disable hive metastore in spark shell by setting the value of spark.sql.catalogImplementation to in-memory which is hive by default.

spark-shell --conf spark.sql.catalogImplementation=in-memory

Upvotes: 2

Eugene
Eugene

Reputation: 11075

If you're using Hive as metastore, please remember to start it by:

hive --service metastore

Upvotes: 0

Related Questions