Support Questions

Find answers, ask questions, and share your expertise

Limit to recreate executor on given threshold value

New Contributor

how could we prevent executor creation(retry) on a given threshold basis when an executor got failed by any issue/error?

In my case driver create one executor but when it got any error it will recreate/retry n number of times, but I want to prevent it on a given threshold basis(like the driver create only 10 times)
I`m using Spark 3.1.2 with Kubernetes 
Thanks in advance

 

 

0 REPLIES 0
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.