Created 11-08-2022 08:51 AM
hello cloudera community,
we are trying to use pyspark to interact with kudu
We were able to successfully execute the command below:
import kudu
but when running the command below:
from kudu.client import Partitioning
returns the error
ImportError: libkudu_client.so.0: cannot open shared object file: No such file or directory
ps: we are using cdp, cdh 7.1.7 and cm 7.6.1
Created 11-17-2022 04:39 AM
hi @Samanta001
unfortunately pyspark has no interaction with kudu
to interact with kudu (create, insert, delete) only works with scala or java api
for that you should use spark-shell
Created 11-17-2022 02:55 AM
Hi,
Here the VERSION CDP 7.1.7 we have to download the KUDU python client
Please follow the below document to get help
If the client not found we can use 7.1.6 client
Please confirm if we are getting the same error after the installation of kudu python client
Created 11-17-2022 04:39 AM
hi @Samanta001
unfortunately pyspark has no interaction with kudu
to interact with kudu (create, insert, delete) only works with scala or java api
for that you should use spark-shell