Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark thrift server down

Highlighted

Spark thrift server down

New Contributor

I'm on hdp 2.4.3 and I'm having an issue with my spark thrift servers. They go down shortly after starting, and I'm unable to find any relevant information in the logs located at /var/log/spark, am I looking in the wrong place? The logs don't update when I start the process so I feel as if there is a bigger issue here or that I'm not understanding something critical.

Thanks

9 REPLIES 9

Re: Spark thrift server down

What 'user' are you using to run the Spark thrift server?

Re: Spark thrift server down

New Contributor

I'm starting it using ambari. Should I be starting it manually as a specific user (hive?)

Re: Spark thrift server down

Re: Spark thrift server down

New Contributor

I've tried all of the stuff mentioned here, thanks though!

Re: Spark thrift server down

Contributor

You can check a couple of things:

-- which port is STS using? is that port in use?

-- check spark-env.sh, find the log directory

Re: Spark thrift server down

New Contributor

The log directory is /var/log/spark, and it's using port 10015.

I see this error in the .out file now when I try to start the thrift server ERROR ThriftCLIService: Error starting HiveServer2: could not start ThriftBinaryCLIService My hiveserver2 is up though.

Re: Spark thrift server down

Expert Contributor

That log is because STS derives from HS2. You will probably find an exception somewhere in the logs as to why STS could not start.

Re: Spark thrift server down

New Contributor

@Kevin Major Did you find a solution the STS crash?

Re: Spark thrift server down

Explorer

No, not at have any one faced same issue kindly let me know the soln

thanks,