Increase spark.kryoserializer.buffer.max property value value according to the required size , by default it is 64 MB.    Got same Exception, ran job by increasing the value and was able to run it properly. ... View more