Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

configure zeppelin so spark interpreter can create hive tables

avatar
Explorer

Hello community,

I am using HDP 3.0.1 and Zeppelin 0.8.0

I would like to create hive tables, however, I get the following error:

org.apache.spark.sql.AnalysisException: Hive support is required to CREATE Hive TABLE (AS SELECT);

I found that I have to add spark.sql.catalogImplementation=hive

If I execute spark.sessionState.catalog from Zeppelin, I get:

org.apache.spark.sql.catalyst.catalog.SessionCatalog = org.apache.spark.sql.catalyst.catalog.SessionCatalog@4c3b5588

However, If I run spark from cli using the following command:

spark-shell --master yarn --conf spark.sql.catalogImplementation=hive

and then type spark.sessionState.catalog

I get the following result

org.apache.spark.sql.catalyst.catalog.SessionCatalog = org.apache.spark.sql.hive.HiveSessionCatalog@5a384aef

Running the same code, I can create a hive table from cli, but I can't create it from Zeppelin

I would like to create hive tables from Zeppelin.

What configuration do I miss?

Thanks in advance.

1 ACCEPTED SOLUTION

avatar
Explorer

After editing JDBC interpreter and adding hive password solved the issue.

View solution in original post

2 REPLIES 2

avatar
Explorer

After editing JDBC interpreter and adding hive password solved the issue.

avatar
Explorer

In which file did you make the change? and what are the values?