Reply
New Contributor
Posts: 1
Registered: ‎09-09-2018

Using Spark 2.x on Hive in Cloudera Manager

Just following up on an old post, is there any chance that we will be able to use Hive on Spark 2.x in the near future?

https://community.cloudera.com/t5/Advanced-Analytics-Apache-Spark/Spark-2-x-and-Hive/td-p/54356

 

CM 5.15.1 does not seem to support, but can we use CM 6.0 to do this?

Master
Posts: 377
Registered: ‎07-01-2015

Re: Using Spark 2.x on Hive in Cloudera Manager

As I understant the release notes, in CDH 6.0 you can use Hive on Spark. But not really sure about the version of the Spark (if it is 2.1, 2.2 or 2.3)
https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_600_new_features.htm...
Cloudera Employee
Posts: 63
Registered: ‎03-01-2016

Re: Using Spark 2.x on Hive in Cloudera Manager

CDH spark packed in CDH 6.0 is based on Apache Spark 2.2, cloudera then adds fixes/features which are improtant for its customers:

 

https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_60_packaging.html#cd...

Announcements