Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 12-22-2022 12:17 AM
when i tried to running this note
%spark2.pyspark
import pyspark
from pyspark_llap import HiveWarehouseSession
hive = HiveWarehouseSession.session(spark).build()
df = hive.execute(" show databases ")
the result is
File "/tmp/spark-00e8a412-9248-4a78-803f-3ca9d8ddac2d/userFiles-2f95cdc1-3caa-42d7-8356-5b022b67b3b9/pyspark_hwc-1.0.0.3.1.0.0-78.zip/pyspark_llap/sql/session.py", line 228, in session return HiveWarehouseBuilder.session(session) File "/tmp/spark-00e8a412-9248-4a78-803f-3ca9d8ddac2d/userFiles-2f95cdc1-3caa-42d7-8356-5b022b67b3b9/pyspark_hwc-1.0.0.3.1.0.0-78.zip/pyspark_llap/sql/session.py", line 44, in session jvm.com.hortonworks.spark.sql.hive.llap.HiveWarehouseBuilder.session(jsparkSession)) TypeError: 'JavaPackage' object is not callable
how do i fix it ? thanks
Created 12-26-2022 07:55 PM
i solved it by re configure spark.jars & spark.submit.Pyfiles in spark interpreters
Created 12-22-2022 04:03 AM
HI @myzard Is the Hive warehouse connector configured with the interpterter? If so, ensure that HWC is configured correctly with the settings mentioned in the below doc.
Created 12-22-2022 06:29 PM
yes i already did that but still
Created 12-24-2022 12:25 AM
@myzard Can you share the screenshot of interpreter settings
Created 12-26-2022 07:55 PM
i solved it by re configure spark.jars & spark.submit.Pyfiles in spark interpreters