Posts: 40
Registered: ‎02-01-2017

Spark streaming kafka job runs successfully then fails after about 24 hours

I have a kafka spark streaming job which runs a consumer which reads from a producer and the job runs fine for a while up to 25 hours but then for some reason it fails and it gives this error message.errorKafKaCode.PNG


I cant figure out why . I changed the spark submit to take the active and not stand by node.


Any suggestions would be greatly appreciated