Reply
New Contributor
Posts: 1
Registered: ‎08-11-2015

getting below error when trying to start /opt/cloudera/parcels/CDH/lib/spark/sbin/start-thriftserver

getting below error when trying to start /opt/cloudera/parcels/CDH/lib/spark/sbin/start-thriftserver.sh.

How to solve this issue


starting org.apache.spark.sql.hive.thriftserver.HiveThriftServer2, logging to /opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/spark/logs/spark-dihadoop-org.apache.spark.sql.hive.thriftserver.HiveThriftServer2-1-q2hdp4.diqa.net.out
failed to launch org.apache.spark.sql.hive.thriftserver.HiveThriftServer2:
  Failed to load main class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2.
  You need to build Spark with -Phive and -Phive-thriftserver.

Cloudera Employee
Posts: 307
Registered: ‎01-16-2014

Re: getting below error when trying to start /opt/cloudera/parcels/CDH/lib/spark/sbin/start-thriftse

You can not solve this. The version of Spark that you have is compiled with -PHive.

However Spark is written against an older version of Hive and the thrift server uses an API that does not exist any more in the current release of Hive that is used in CDH..

There is work on going to fix this and move Spark to a newer release of Hive. Until that is fixed it is not possible to use the thrift server.

 

Progress seems to have been made for Spark 1.5

 

Wilfred