I have a kafka spark streaming job which runs a consumer which reads from a producer and the job runs fine for a while up to 25 hours but then for some reason it fails and it gives this error message.
I cant figure out why . I changed the spark submit to take the active and not stand by node.
Any suggestions would be greatly appreciated