- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Spark master shuts down when one of zookeeper dies
Created ‎11-06-2023 04:52 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am using spark-3.4.1
I have a setup with three ZooKeeper servers, Spark master shuts down when a zookeeper instance is down a new master is
elected as leader and the cluster is up. But the original master that was down never comes up.
can anyone help me with this issue?
Created ‎11-06-2023 09:09 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
It is the same as :-https://issues.apache.org/jira/browse/SPARK-15544
I see the ticket is Resolved but no solution is present.
Created ‎11-19-2023 07:12 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @KPG1
Cloudera not yet supported Spark 3.4.1. Are you using open source apache spark?
Created ‎12-11-2023 02:24 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
yes it's Apache spark 3.4.1
Created ‎12-19-2023 03:29 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We are not sure, this kind of scenorio we are going to support. If you are cloudera customer, you can check with your account team to engage cloudera Professional Team to enagage and support this feature.
