CODEWITHSUNDEEP
apache-sparkhivecloudera
medloh
medloh

Reputation: 969

Cloudera Hive on Spark 2.x?

Looking at this:

https://www.cloudera.com/documentation/spark2/latest/topics/spark2_known_issues.html#hive_on_spark

To summarize, it says Hive doesn't work on Spark 2.x in Cloudera.

However, I assume Hive does run on Spark 2.x in other distributions. Has anyone configured CDH 5.10.x or higher to run Hive on Spark 2.x?

Is Spark 2.x a big leap forward from Spark 1.6?

Upvotes: 2

Views: 1884

Answers (1)

Yohan Liyanage
Yohan Liyanage

Reputation: 7000

The latest released version of Hive as of now is 2.1.x and it does not support Spark 2.x (see https://issues.apache.org/jira/browse/HIVE-14029). When Hive version 2.2.0 is released it will support Spark 2.x.

Upvotes: 2

Related Questions