Support Questions

Find answers, ask questions, and share your expertise

Integrate Hive on Spark with Hue Cloudera CDP 7.1.7

avatar
Contributor

Hello everyone,
in a cdp 7.1.7 cluster I have not found a way to implement engine spark to run hive queries on hue. I can execute hive queries with spark engine with spark-shell but if I try to execute hive queries on hue by setting set hive.execution.engine=spark I get the following error:
Error while compiling statement: FAILED: Execution Error, return code 30041 from org.apache.hadoop.hive.ql.exec.spark.SparkTask. Failed to create Spark client for Spark session

Can anyone help me to implement hive on spark via hue?

Thanks in advance

1 ACCEPTED SOLUTION

avatar
Expert Contributor

@Lorenzo 

Hive is unaware of Spark and won't use it to execute commands

On the other hand, Spark can access Hive data using the HiveWarehouseConnector

Hope this helps,

-JMP

View solution in original post

5 REPLIES 5

avatar
Community Manager

@Lorenzo Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our Hive experts @Shmoo @mszurap  who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.


Regards,

Diana Torres,
Community Moderator


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:

avatar
Expert Contributor

@Lorenzo On CDP Hive the Spark engine is deprecated if favor of TEZ   

 

avatar
Contributor

And there is no way currently to integrate spark?

avatar
Expert Contributor

@Lorenzo 

Hive is unaware of Spark and won't use it to execute commands

On the other hand, Spark can access Hive data using the HiveWarehouseConnector

Hope this helps,

-JMP

avatar
Contributor

Thank you, for now i implemented scala on hue and it works