Support Questions

Find answers, ask questions, and share your expertise

Can't switch Hive engine to Spark

avatar
Explorer

Hi guys,

So I was trying to switch Hive engine from MR to Spark. I follow the like here . But I didn't see any Spark service name in the Spark On YARN Service under Configuration tab. Notice that there's already a gateway on running HiveServer2. Another thing worth to notice is that Spark 2 is manually installed. Here are some snapshots.

Screen Shot 2017-01-25 at 1.46.43 PM.pngScreen Shot 2017-01-25 at 1.53.34 PM.png

Screen Shot 2017-01-25 at 2.08.31 PM.png

Any input would be helpful. Thanks!

1 ACCEPTED SOLUTION

avatar
Cloudera Employee

I am asking if your Spark service is Spark2 or not? Cloudera Manager is not supporting directly configuring Hive to depend on Spark2 yet. So you might want to try using 'Spark1' and see.

View solution in original post

4 REPLIES 4

avatar
Cloudera Employee

The screenshots is not available to me. Do you only have Spark2 service on Spark side?

avatar
Explorer

Sorry could you be more specific? Not sure I understand

avatar
Explorer
could you be more specific?

avatar
Cloudera Employee

I am asking if your Spark service is Spark2 or not? Cloudera Manager is not supporting directly configuring Hive to depend on Spark2 yet. So you might want to try using 'Spark1' and see.