08-11-2015 04:11 PM
getting below error when trying to start /opt/cloudera/parcels/CDH/lib/spark/sbin/start-thriftserver.sh.
How to solve this issue
starting org.apache.spark.sql.hive.thriftserver.HiveThriftServer2, logging to /opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/spark/logs/spark-dihadoop-org.apache.spark.sql.hive.thriftserver.HiveThriftServer2-1-q2hdp4.diqa.net.out
failed to launch org.apache.spark.sql.hive.thriftserver.HiveThriftServer2:
Failed to load main class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2.
You need to build Spark with -Phive and -Phive-thriftserver.
08-11-2015 10:33 PM
You can not solve this. The version of Spark that you have is compiled with -PHive.
However Spark is written against an older version of Hive and the thrift server uses an API that does not exist any more in the current release of Hive that is used in CDH..
There is work on going to fix this and move Spark to a newer release of Hive. Until that is fixed it is not possible to use the thrift server.
Progress seems to have been made for Spark 1.5