Reply
New Contributor
Posts: 1
Registered: ‎11-11-2017

Task not serializable scala/spark?

writeing data into HDFS

I am creating threee functions in scala class

first function to create a file
second function to write into file
third function to close file

when i call the scala functions in mappartitionswithindex spark

I receive Task not serializable spark exception

please provide me the reasons.

Announcements