question Re: (Zeppelin) pyspark read hive TypeError: 'JavaPackage' object is not callable in Support Questions

(Zeppelin) pyspark read hive TypeError: 'JavaPackage' object is not callable

myzard — Thu, 22 Dec 2022 08:17:24 GMT

when i tried to running this note

%spark2.pyspark
import pyspark
from pyspark_llap import HiveWarehouseSession
hive = HiveWarehouseSession.session(spark).build()
df = hive.execute(" show databases ")

the result is

File "/tmp/spark-00e8a412-9248-4a78-803f-3ca9d8ddac2d/userFiles-2f95cdc1-3caa-42d7-8356-5b022b67b3b9/pyspark_hwc-1.0.0.3.1.0.0-78.zip/pyspark_llap/sql/session.py", line 228, in session return HiveWarehouseBuilder.session(session) File "/tmp/spark-00e8a412-9248-4a78-803f-3ca9d8ddac2d/userFiles-2f95cdc1-3caa-42d7-8356-5b022b67b3b9/pyspark_hwc-1.0.0.3.1.0.0-78.zip/pyspark_llap/sql/session.py", line 44, in session jvm.com.hortonworks.spark.sql.hive.llap.HiveWarehouseBuilder.session(jsparkSession)) TypeError: 'JavaPackage' object is not callable

how do i fix it ? thanks

Re: (Zeppelin) pyspark read hive TypeError: 'JavaPackage' object is not callable

Scharan — Thu, 22 Dec 2022 12:03:42 GMT

HI @myzard Is the Hive warehouse connector configured with the interpterter? If so, ensure that HWC is configured correctly with the settings mentioned in the below doc.

https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.0/integrating-hive/content/hive_zeppelin_configuration_hivewarehouseconnector.html

Re: (Zeppelin) pyspark read hive TypeError: 'JavaPackage' object is not callable

myzard — Fri, 23 Dec 2022 02:29:11 GMT

yes i already did that but still

TypeError: 'JavaPackage' object is not callable

Re: (Zeppelin) pyspark read hive TypeError: 'JavaPackage' object is not callable

Scharan — Sat, 24 Dec 2022 08:25:26 GMT

@myzard Can you share the screenshot of interpreter settings

Re: (Zeppelin) pyspark read hive TypeError: 'JavaPackage' object is not callable

myzard — Tue, 27 Dec 2022 03:55:56 GMT

i solved it by re configure spark.jars & spark.submit.Pyfiles in spark interpreters