Support Questions
Find answers, ask questions, and share your expertise

saveAsTable in HUE 3.11 Spark Notebook not working

Highlighted

saveAsTable in HUE 3.11 Spark Notebook not working

New Contributor

I have set-up  hue 3.11 and Spark Notebook is working fine with Spark-2.0.0 through livy server.

I am able to create DF's,Datasets etc through tthe notebook. I have a hiveserver 2 running on same machine where hue is installed. I have placed the hive-site.xml in spark/conf directory.Also I have specified metastore

directory in spark-deafult.conf as /user/hive/warehouse. 

 

When I do saveAsTable on a DF,no error come's up.It say's done.df.saveAsTable("test")

But when I do a select on the same table using spark.sql("select * from test") or sql("select * from test").

An error shows up saying "Hive support is required to do select on the following table default.test"

 

What could be wrong here?

 

2 REPLIES 2
Highlighted

Re: saveAsTable in HUE 3.11 Spark Notebook not working

This is most probably a missing Spark configuration for Hive (not Hue),
would recommend to ask it on the Spark forum
Highlighted

Re: saveAsTable in HUE 3.11 Spark Notebook not working

New Contributor
To check if it's a Spark config problem,I started the spark-shell and did the following
sql("CREATE TABLE testing_table (col1 String, col2 Timestamp) STORED AS ORC")
sql("select * from testing_table")
It worked fine but same thing did not work through Spark notebook in hue.It gave me the same error as mentioned above.
Don't have an account?