Cloudera Labs
Provide feedback on Cloudera Labs
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How can I run hive with Spark engine?

How can I run hive with Spark engine?

Rising Star

I want to run Spark as a engine instead of MapReduce. I am using CDH 5.4 VM.

 

Can I do something like: hive.execution.engine=spark; 

 

2 REPLIES 2
Highlighted

Re: How can I run hive with Spark engine?

Cloudera Employee

Hi rio,

 

You should enable hive.enable.spark.execution.engine property.

 

Please read below document.

http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/admin_hos_config.html

 

I tried hive on Spark on my Quickstart VM yesterday. It worked. :)

 

Thanks,

--

Tatsuo

Re: How can I run hive with Spark engine?

Explorer

Hi,
Just trying to undergo the procedure posted on the website Cloudera but can not be found in the Configuration tab of the parameter that contains the word Spark. I CDH update to version 5.4.2 and nothing.

 

Thanks,

 

Miro