Reply
Highlighted
Explorer
Posts: 9
Registered: ‎01-25-2017
Accepted Solution

Can't switch Hive engine to Spark

Hi guys,

So I was trying to switch Hive engine from MR to Spark. I follow the like here . But I didn't see any Spark service name in the Spark On YARN Service under Configuration tab. Notice that there's already a gateway on running HiveServer2. Another thing worth to notice is that Spark 2 is manually installed. Here are some snapshots.

Screen Shot 2017-01-25 at 1.46.43 PM.pngScreen Shot 2017-01-25 at 1.53.34 PM.png

Screen Shot 2017-01-25 at 2.08.31 PM.png

Any input would be helpful. Thanks!

Cloudera Employee
Posts: 18
Registered: ‎01-12-2017

Re: Can't switch Hive engine to Spark

The screenshots is not available to me. Do you only have Spark2 service on Spark side?

Explorer
Posts: 9
Registered: ‎01-25-2017

Re: Can't switch Hive engine to Spark

Sorry could you be more specific? Not sure I understand

Explorer
Posts: 9
Registered: ‎01-25-2017

Re: Can't switch Hive engine to Spark

could you be more specific?
Cloudera Employee
Posts: 18
Registered: ‎01-12-2017

Re: Can't switch Hive engine to Spark

I am asking if your Spark service is Spark2 or not? Cloudera Manager is not supporting directly configuring Hive to depend on Spark2 yet. So you might want to try using 'Spark1' and see.

Announcements