Enable Spark Thrift Server High Availability

[#1]

Hi,

is it already possible to configure Spark Thrift Server high available?

There seems to be a Jira ticket I haven't found: https://www.mail-archive.com/[email protected]/msg51194.html .

[#2 · Accepted solution]

It could be this one: https://issues.apache.org/jira/browse/SPARK-19541

[#3]

Before ZK integration is done you can start 2 or more Thrift servers on different nodes and put a load balancer in front of them. That will do the job.

[#4]

@Predrag Minovicyes thank you, that could do the job, I was just wondering if it has been already implemented to enable it like you do with Namenode etc.