Support Questions
Find answers, ask questions, and share your expertise

Unable to create hive table from df in Zeppelin

Explorer

Hello community,

I am using hdp3.0.1 and I can not create a hive table from a df in Zeppelin.

I have seen the below articles:

https://community.hortonworks.com/content/kbentry/223626/integrating-apache-hive-with-apache-spark-h...

https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.0.1/integrating-hive/content/hive_hivewarehouse...

I am able to execute the most of HiveWarehouseSession API operations (like show/create/drop table),however, I am unable to create a hive table from an existing df

I am getting the following error after running this command:

df.write.format(HIVE_WAREHOUSE_CONNECTOR).option("table", "new_hive_table").save()

java.util.NoSuchElementException: None.get
  at scala.None$.get(Option.scala:347)
  at scala.None$.get(Option.scala:345)
  at com.hortonworks.spark.sql.hive.llap.HiveWarehouseConnector.createWriter(HiveWarehouseConnector.java:51)
  at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:254)
  ... 61 elided<br>

If you require any other information, please let me know.

Thanks in advance

3 REPLIES 3

Explorer

Hi @cstefan,

Did you solve this?

I have the same problem.

Contributor

Hi @cstefan ,

 

Could you please check and let us know the value in "HIVE_WAREHOUSE_CONNECTOR"

 

And hive parameters setting in Spark2.

Explorer

Hi @cstefan,

 

I have the same problem but sometimes its works and sometimes no. I need start several time my jobs for not have the error. So did you solved this issue ?

 

thanks in advance for your help

; ;