Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

livy 0.5, spark 2.3 and kyro

livy 0.5, spark 2.3 and kyro

New Contributor

Hi Folks,


I've been experimenting with livy and have been hitting a snag with Kyro and the first job submission. Has anyone encountered the attached stack trace when trying run the pyspark livy example?



I've been using (0.5 - 0.6) from here (as there are references to spark2.3 being supported in the source):


as opposed to this repo, which looks to be untouched for some time now:




I've found at least one other person hitting the same issue here:





Does anyone have any workarounds (other than resubmitting the same job) ?


Thanks in advance!






*** Exception: org.apache.livy.shaded.kryo.kryo.KryoException: Encountered unregistered class ID: 510