Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

in CDH 5.4, does Hive on Spark imply Spark is build with Hive dependencies?

in CDH 5.4, does Hive on Spark imply Spark is build with Hive dependencies?

New Contributor

In otherwords can this Spark build also act as a Hive client? 

 

My instinct is that it will but I don't have CDH 5.4 and can't immediately confirm. 

 

Is there a fast answer for this?

 

Thanks

-S

1 REPLY 1

Re: in CDH 5.4, does Hive on Spark imply Spark is build with Hive dependencies?

Super Collaborator

Hive on Spark uses Spark as the execution framework like MapReduce is the execution framework.

Spark SQL uses Hive dependencies but that side is not supported. Hive in CDH is newer than the Hive Spark is designed against and there are parts that do not work against the new release of Hive. Some parts will work others will not.

 

Wilfred

Don't have an account?
Coming from Hortonworks? Activate your account here