Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Integrate Hive on Spark with Hue Cloudera CDP 7.1.7

avatar
Contributor

Hello everyone,
in a cdp 7.1.7 cluster I have not found a way to implement engine spark to run hive queries on hue. I can execute hive queries with spark engine with spark-shell but if I try to execute hive queries on hue by setting set hive.execution.engine=spark I get the following error:
Error while compiling statement: FAILED: Execution Error, return code 30041 from org.apache.hadoop.hive.ql.exec.spark.SparkTask. Failed to create Spark client for Spark session

Can anyone help me to implement hive on spark via hue?

Thanks in advance

1 ACCEPTED SOLUTION

avatar
Expert Contributor

@Lorenzo 

Hive is unaware of Spark and won't use it to execute commands

On the other hand, Spark can access Hive data using the HiveWarehouseConnector

Hope this helps,

-JMP

View solution in original post

5 REPLIES 5

avatar
Community Manager

@Lorenzo Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our Hive experts @Shmoo @mszurap  who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.


Regards,

Diana Torres,
Senior Community Moderator


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:

avatar
Expert Contributor

@Lorenzo On CDP Hive the Spark engine is deprecated if favor of TEZ   

 

avatar
Contributor

And there is no way currently to integrate spark?

avatar
Expert Contributor

@Lorenzo 

Hive is unaware of Spark and won't use it to execute commands

On the other hand, Spark can access Hive data using the HiveWarehouseConnector

Hope this helps,

-JMP

avatar
Contributor

Thank you, for now i implemented scala on hue and it works