Reply
rio
Explorer
Posts: 48
Registered: ‎04-18-2014

How can I run hive with Spark engine?

[ Edited ]

I want to run Spark as a engine instead of MapReduce. I am using CDH 5.4 VM.

 

Can I do something like: hive.execution.engine=spark; 

 

Highlighted
Cloudera Employee
Posts: 3
Registered: ‎02-17-2015

Re: How can I run hive with Spark engine?

Hi rio,

 

You should enable hive.enable.spark.execution.engine property.

 

Please read below document.

http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/admin_hos_config.html

 

I tried hive on Spark on my Quickstart VM yesterday. It worked. :)

 

Thanks,

--

Tatsuo

Explorer
Posts: 7
Registered: ‎06-03-2015

Re: How can I run hive with Spark engine?

Hi,
Just trying to undergo the procedure posted on the website Cloudera but can not be found in the Configuration tab of the parameter that contains the word Spark. I CDH update to version 5.4.2 and nothing.

 

Thanks,

 

Miro