Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Using Spark 2.x on Hive in Cloudera Manager

Highlighted

Using Spark 2.x on Hive in Cloudera Manager

New Contributor

Just following up on an old post, is there any chance that we will be able to use Hive on Spark 2.x in the near future?

https://community.cloudera.com/t5/Advanced-Analytics-Apache-Spark/Spark-2-x-and-Hive/td-p/54356

 

CM 5.15.1 does not seem to support, but can we use CM 6.0 to do this?

2 REPLIES 2

Re: Using Spark 2.x on Hive in Cloudera Manager

Master Collaborator
As I understant the release notes, in CDH 6.0 you can use Hive on Spark. But not really sure about the version of the Spark (if it is 2.1, 2.2 or 2.3)
https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_600_new_features.htm...

Re: Using Spark 2.x on Hive in Cloudera Manager

Contributor

CDH spark packed in CDH 6.0 is based on Apache Spark 2.2, cloudera then adds fixes/features which are improtant for its customers:

 

https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_60_packaging.html#cd...