Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark thrift server down

Spark thrift server down

I'm on hdp 2.4.3 and I'm having an issue with my spark thrift servers. They go down shortly after starting, and I'm unable to find any relevant information in the logs located at /var/log/spark, am I looking in the wrong place? The logs don't update when I start the process so I feel as if there is a bigger issue here or that I'm not understanding something critical.

Thanks

9 REPLIES 9
Highlighted

Re: Spark thrift server down

What 'user' are you using to run the Spark thrift server?

Highlighted

Re: Spark thrift server down

I'm starting it using ambari. Should I be starting it manually as a specific user (hive?)

Highlighted

Re: Spark thrift server down

Highlighted

Re: Spark thrift server down

I've tried all of the stuff mentioned here, thanks though!

Highlighted

Re: Spark thrift server down

Contributor

You can check a couple of things:

-- which port is STS using? is that port in use?

-- check spark-env.sh, find the log directory

Highlighted

Re: Spark thrift server down

The log directory is /var/log/spark, and it's using port 10015.

I see this error in the .out file now when I try to start the thrift server ERROR ThriftCLIService: Error starting HiveServer2: could not start ThriftBinaryCLIService My hiveserver2 is up though.

Highlighted

Re: Spark thrift server down

Expert Contributor

That log is because STS derives from HS2. You will probably find an exception somewhere in the logs as to why STS could not start.

Highlighted

Re: Spark thrift server down

Explorer

@Kevin Major Did you find a solution the STS crash?

Highlighted

Re: Spark thrift server down

Explorer

No, not at have any one faced same issue kindly let me know the soln

thanks,

Don't have an account?
Coming from Hortonworks? Activate your account here