Cloudera Labs
Provide feedback on Cloudera Labs

How can I run hive with Spark engine?

Rising Star

I want to run Spark as a engine instead of MapReduce. I am using CDH 5.4 VM.

 

Can I do something like: hive.execution.engine=spark; 

 

2 REPLIES 2

Cloudera Employee

Hi rio,

 

You should enable hive.enable.spark.execution.engine property.

 

Please read below document.

http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/admin_hos_config.html

 

I tried hive on Spark on my Quickstart VM yesterday. It worked. 🙂

 

Thanks,

--

Tatsuo

Explorer

Hi,
Just trying to undergo the procedure posted on the website Cloudera but can not be found in the Configuration tab of the parameter that contains the word Spark. I CDH update to version 5.4.2 and nothing.

 

Thanks,

 

Miro