Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Unable to create hive table from df in Zeppelin

Explorer

Hello community,

I am using hdp3.0.1 and I can not create a hive table from a df in Zeppelin.

I have seen the below articles:

https://community.hortonworks.com/content/kbentry/223626/integrating-apache-hive-with-apache-spark-h...

https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.0.1/integrating-hive/content/hive_hivewarehouse...

I am able to execute the most of HiveWarehouseSession API operations (like show/create/drop table),however, I am unable to create a hive table from an existing df

I am getting the following error after running this command:

df.write.format(HIVE_WAREHOUSE_CONNECTOR).option("table", "new_hive_table").save()

java.util.NoSuchElementException: None.get
  at scala.None$.get(Option.scala:347)
  at scala.None$.get(Option.scala:345)
  at com.hortonworks.spark.sql.hive.llap.HiveWarehouseConnector.createWriter(HiveWarehouseConnector.java:51)
  at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:254)
  ... 61 elided<br>

If you require any other information, please let me know.

Thanks in advance

3 REPLIES 3

Explorer

Hi @cstefan,

Did you solve this?

I have the same problem.

Contributor

Hi @cstefan ,

 

Could you please check and let us know the value in "HIVE_WAREHOUSE_CONNECTOR"

 

And hive parameters setting in Spark2.

Explorer

Hi @cstefan,

 

I have the same problem but sometimes its works and sometimes no. I need start several time my jobs for not have the error. So did you solved this issue ?

 

thanks in advance for your help

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.