Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

PySpark - Kudu API/command reference

avatar
Explorer

Hi

 

I have been searching for sometime for a command reference/API manual for PySpark-Kudu and I have been unsuccessful so far. Does Cloudera have something that can be of help?

 

Thanks.

1 ACCEPTED SOLUTION

avatar
Rising Star
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
6 REPLIES 6

avatar
Rising Star

I'm going to take a poke at this and hope I'm not wasting your time...

 

This looks like a good start:

https://kudu.apache.org/docs/developing.html

 

I have done minimal Python development using PySpark and Kudu.  It's not too bad...

 

avatar
Rising Star

I'm going to take a poke at this and hope I'm not wasting your time...

 

This looks like a good start:

https://kudu.apache.org/docs/developing.html

 

I have done minimal Python development using PySpark and Kudu.  It's not too bad...

 

avatar
Explorer

Could you please share how KuduContext is created in PySpark?

 

I am aware of KUDU-1603, but looking for workarounds and the weird java wrapper detailed in KUDU-1603 is not working as intended. 

avatar
Rising Star
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login

avatar
Rising Star

Whoops, the correct link to the WIP patch for PySpark integration work is

  http://gerrit.cloudera.org:8080/13088

avatar
Explorer

Yes - that WIP links back to KUDU-1603 that I shared earlier. Guess, we will have to wait it out. Thanks for your response.