Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Spark master shuts down when one of zookeeper dies

avatar
Contributor

I am using spark-3.4.1
I have a setup with three ZooKeeper servers, Spark master shuts down when a zookeeper instance is down a new master is
elected as leader and the cluster is up. But the original master that was down never comes up.
can anyone help me with this issue?

4 REPLIES 4

avatar
Contributor

It is the same as :-https://issues.apache.org/jira/browse/SPARK-15544

I see the ticket is Resolved but no solution is present.

avatar
Master Collaborator

Hi @KPG1 

Cloudera not yet supported Spark 3.4.1. Are you using open source apache spark? 

avatar
Contributor

yes it's Apache spark 3.4.1 

avatar
Master Collaborator

We are not sure, this kind of scenorio we are going to support. If you are cloudera customer, you can check with your account team to engage cloudera Professional Team to enagage and support this feature.