Skip to main content
cloudera_sso
Gold ⭐️
November 8, 2022
Solved

libkudu_client.so.0: cannot open shared object file: No such file or directory

hello cloudera community,

 

we are trying to use pyspark to interact with kudu

 

We were able to successfully execute the command below:

 

import kudu

 

but when running the command below:

 

from kudu.client import Partitioning

 

returns the error

 

ImportError: libkudu_client.so.0: cannot open shared object file: No such file or directory

 

ps: we are using cdp, cdh 7.1.7 and cm 7.6.1

cloudera_sso
Gold ⭐️
November 17, 2022

hi @Samanta001 

 

unfortunately pyspark has no interaction with kudu

 

to interact with kudu (create, insert, delete) only works with scala or java api

 

for that you should use spark-shell

2 replies

Samanta001
Silver ⭐️⭐️
Silver ⭐️⭐️
November 17, 2022

Hi,

 

Here the VERSION CDP 7.1.7 we have to download the KUDU python client

Please follow the below document to get help

https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/kudu-development/topics/kudu-python-client.html

 

If the client not found we can use  7.1.6 client

 

https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/kudu-development/topics/kudu-python-client.html

 

 

Please confirm if we are getting the same error after the installation of kudu python client

Translate
cloudera_sso
cloudera_ssoAuthorAnswer
Gold ⭐️
November 17, 2022

hi @Samanta001 

 

unfortunately pyspark has no interaction with kudu

 

to interact with kudu (create, insert, delete) only works with scala or java api

 

for that you should use spark-shell

Translate