About sajinb

sajinb · ‎10-31-2016

To check if it's a Spark config problem,I started the spark-shell and did the following sql("CREATE TABLE testing_table (col1 String, col2 Timestamp) STORED AS ORC") sql("select * from testing_table") It worked fine but same thing did not work through Spark notebook in hue.It gave me the same error as mentioned above.

sajinb · ‎10-30-2016

I have set-up hue 3.11 and Spark Notebook is working fine with Spark-2.0.0 through livy server. I am able to create DF's,Datasets etc through tthe notebook. I have a hiveserver 2 running on same machine where hue is installed. I have placed the hive-site.xml in spark/conf directory.Also I have specified metastore directory in spark-deafult.conf as /user/hive/warehouse. When I do saveAsTable on a DF,no error come's up.It say's done.df.saveAsTable("test") But when I do a select on the same table using spark.sql("select * from test") or sql("select * from test"). An error shows up saying "Hive support is required to do select on the following table default.test" What could be wrong here?

Online	Offline
Last Visited	‎11-03-2016 03:21 AM

Date Registered	‎10-30-2016 05:40 AM
Last Visited	‎11-03-2016 03:21 AM
Total Messages Posted	2

Re: saveAsTable in HUE 3.11 Spark Notebook not wor...

saveAsTable in HUE 3.11 Spark Notebook not working