question Re: Enable Spark Thrift Server High Availability in Archives of Support Questions (Read Only)

Enable Spark Thrift Server High Availability

andreas_knapp — Wed, 22 Feb 2017 17:04:58 GMT

Hi,

is it already possible to configure Spark Thrift Server high available?

There seems to be a Jira ticket I haven't found: https://www.mail-archive.com/user@spark.apache.org/msg51194.html .

Re: Enable Spark Thrift Server High Availability

melek — Wed, 22 Feb 2017 18:44:49 GMT

It could be this one: https://issues.apache.org/jira/browse/SPARK-19541

Re: Enable Spark Thrift Server High Availability

pminovic — Wed, 22 Feb 2017 19:07:57 GMT

Before ZK integration is done you can start 2 or more Thrift servers on different nodes and put a load balancer in front of them. That will do the job.

Re: Enable Spark Thrift Server High Availability

andreas_knapp — Wed, 22 Feb 2017 19:18:10 GMT

@Predrag Minovicyes thank you, that could do the job, I was just wondering if it has been already implemented to enable it like you do with Namenode etc.