Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Can't switch Hive engine to Spark

avatar
Explorer

Hi guys,

So I was trying to switch Hive engine from MR to Spark. I follow the like here . But I didn't see any Spark service name in the Spark On YARN Service under Configuration tab. Notice that there's already a gateway on running HiveServer2. Another thing worth to notice is that Spark 2 is manually installed. Here are some snapshots.

Screen Shot 2017-01-25 at 1.46.43 PM.pngScreen Shot 2017-01-25 at 1.53.34 PM.png

Screen Shot 2017-01-25 at 2.08.31 PM.png

Any input would be helpful. Thanks!

1 ACCEPTED SOLUTION

avatar
Cloudera Employee

I am asking if your Spark service is Spark2 or not? Cloudera Manager is not supporting directly configuring Hive to depend on Spark2 yet. So you might want to try using 'Spark1' and see.

View solution in original post

4 REPLIES 4

avatar
Cloudera Employee

The screenshots is not available to me. Do you only have Spark2 service on Spark side?

avatar
Explorer

Sorry could you be more specific? Not sure I understand

avatar
Explorer
could you be more specific?

avatar
Cloudera Employee

I am asking if your Spark service is Spark2 or not? Cloudera Manager is not supporting directly configuring Hive to depend on Spark2 yet. So you might want to try using 'Spark1' and see.