Reply
Explorer
Posts: 13
Registered: ‎04-01-2016

How to change hive engine from spark to spark2 ?

[ Edited ]

quckstart vm chd-5.10, spark2 parcel installed and working OK (spark2-shell is working). Hive execution engine set to spark using this instruction (Cloudera Manager part)

https://www.cloudera.com/documentation/enterprise/5-10-x/topics/admin_hive_configure.html#concept_i3...

 

Now my system use old spark 1.6 engine from hive, but my goal is to use spark2 from DBeaver ide, connecting to port 10000.

Cloudera Employee
Posts: 74
Registered: ‎11-16-2015

Re: How to change hive engine from spark to spark2 ?

What you are observing is true since Hive-On-Spark currently works only with CDH bundled Spark1.6 and not Spark2.0 . Hive-on-Spark2 It is targeted for supportability starting CDH 6.x, however there is no definitive ETA for it's GA at the moment. 

https://www.cloudera.com/documentation/spark2/2-0-x/topics/spark2_known_issues.html#hive_on_spark