Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

realize Hive on Spark .(that is how to make hive use spark engine)

realize Hive on Spark .(that is how to make hive use spark engine)

New Contributor

Background:

Our company is using hdp clusters.

My boss asked me to configure hive on Spark.

Problem:

I know hortonworks dosen't support hive on Spark.

But I can't convince my boss.

So can I have any alternative methods to realize it ?

Such as building the original spark source code and installing it on hdp? or any other methods else.

Really hope anyone can help . Thanks very very much!!

5 REPLIES 5

Re: realize Hive on Spark .(that is how to make hive use spark engine)

Mentor

@lotusws lotusws

I quite surprised by your analogy, what exactly do you want to do. I have participated in projects where spark is having used against HDP cluster. Zeppelin note but is used to develop and run spark and hive.

What is your use case if you can explain what you intend to achieve then members can contribute.

HTH

Re: realize Hive on Spark .(that is how to make hive use spark engine)

New Contributor

Thanks very much!

I want to configure hive on spark.But I always failed.

I don't know the problem and how can I make it ?

Thanks very much!

Re: realize Hive on Spark .(that is how to make hive use spark engine)

New Contributor

HDP supports Hive On Spark. You just set the value ‘spark’ of hive engine in shell or query. But I strongly recommend to use Hive On Tez in case of HDP cluster.

Re: realize Hive on Spark .(that is how to make hive use spark engine)

New Contributor

Thanks very much!
Can you tell me the version of HDP?

I am using HDP 3.0.0, is it OK?

Really many thanks !!

Highlighted

Re: realize Hive on Spark .(that is how to make hive use spark engine)

New Contributor

@lotusws lotusws HDP 3.0.0 is OK to use it.

Don't have an account?
Coming from Hortonworks? Activate your account here