Support Questions

Find answers, ask questions, and share your expertise

Using Spark 2.x on Hive in Cloudera Manager

New Contributor

Just following up on an old post, is there any chance that we will be able to use Hive on Spark 2.x in the near future?

https://community.cloudera.com/t5/Advanced-Analytics-Apache-Spark/Spark-2-x-and-Hive/td-p/54356

 

CM 5.15.1 does not seem to support, but can we use CM 6.0 to do this?

2 REPLIES 2

Master Collaborator
As I understant the release notes, in CDH 6.0 you can use Hive on Spark. But not really sure about the version of the Spark (if it is 2.1, 2.2 or 2.3)
https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_600_new_features.htm...

Contributor

CDH spark packed in CDH 6.0 is based on Apache Spark 2.2, cloudera then adds fixes/features which are improtant for its customers:

 

https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_60_packaging.html#cd...

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.