Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

getting below error when trying to start /opt/cloudera/parcels/CDH/lib/spark/sbin/start-thriftserver

getting below error when trying to start /opt/cloudera/parcels/CDH/lib/spark/sbin/start-thriftserver

New Contributor

getting below error when trying to start /opt/cloudera/parcels/CDH/lib/spark/sbin/start-thriftserver.sh.

How to solve this issue


starting org.apache.spark.sql.hive.thriftserver.HiveThriftServer2, logging to /opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/spark/logs/spark-dihadoop-org.apache.spark.sql.hive.thriftserver.HiveThriftServer2-1-q2hdp4.diqa.net.out
failed to launch org.apache.spark.sql.hive.thriftserver.HiveThriftServer2:
  Failed to load main class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2.
  You need to build Spark with -Phive and -Phive-thriftserver.

1 REPLY 1

Re: getting below error when trying to start /opt/cloudera/parcels/CDH/lib/spark/sbin/start-thriftse

Super Collaborator

You can not solve this. The version of Spark that you have is compiled with -PHive.

However Spark is written against an older version of Hive and the thrift server uses an API that does not exist any more in the current release of Hive that is used in CDH..

There is work on going to fix this and move Spark to a newer release of Hive. Until that is fixed it is not possible to use the thrift server.

 

Progress seems to have been made for Spark 1.5

 

Wilfred