Support Questions
Find answers, ask questions, and share your expertise

Spark streaming kafka job runs successfully then fails after about 24 hours

Highlighted

Spark streaming kafka job runs successfully then fails after about 24 hours

Explorer

I have a kafka spark streaming job which runs a consumer which reads from a producer and the job runs fine for a while up to 25 hours but then for some reason it fails and it gives this error message.errorKafKaCode.PNG

 

I cant figure out why . I changed the spark submit to take the active and not stand by node.

 

Any suggestions would be greatly appreciated

Don't have an account?