configure zeppelin so spark interpreter can create hive tables

cstefan — Fri, 26 Oct 2018 22:02:44 GMT

Hello community,

I am using HDP 3.0.1 and Zeppelin 0.8.0

I would like to create hive tables, however, I get the following error:

org.apache.spark.sql.AnalysisException: Hive support is required to CREATE Hive TABLE (AS SELECT);

I found that I have to add spark.sql.catalogImplementation=hive

If I execute spark.sessionState.catalog from Zeppelin, I get:

org.apache.spark.sql.catalyst.catalog.SessionCatalog = org.apache.spark.sql.catalyst.catalog.SessionCatalog@4c3b5588

However, If I run spark from cli using the following command:

spark-shell --master yarn --conf spark.sql.catalogImplementation=hive

and then type spark.sessionState.catalog

I get the following result

org.apache.spark.sql.catalyst.catalog.SessionCatalog = org.apache.spark.sql.hive.HiveSessionCatalog@5a384aef

Running the same code, I can create a hive table from cli, but I can't create it from Zeppelin

I would like to create hive tables from Zeppelin.

What configuration do I miss?

Thanks in advance.

Re: configure zeppelin so spark interpreter can create hive tables

cstefan — Mon, 29 Oct 2018 15:25:09 GMT

After editing JDBC interpreter and adding hive password solved the issue.

mahmedrao — Thu, 26 Dec 2019 11:23:01 GMT

In which file did you make the change? and what are the values?