Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Build failed for spark thriftserver - CDH5.10.0

avatar
Explorer

I'm trying to compile spark 1.6.0-cdh 5.10.0 on a Docker container (that should act as an edge node for the cluster with Jupiter).

This is the source:

http://archive.cloudera.com/cdh5/cdh/5/spark-1.6.0-cdh5.10.0-src.tar.gz

I am using the following Maven command:

build/mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=$V_CDH -Phive -Phive-thriftserver -DskipTests clean package

but I cannot continue over the thriftserver part.

I always get this error:

 

[error] /usr/local/spark-1.6.0-cdh5.10.0/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala:42: class SparkExecuteStatementOperation needs to be abstract, since method cancel in class Operation of type (x$1: org.apache.hive.service.cli.OperationState)Unit is not defined
[error] private[hive] class SparkExecuteStatementOperation(
[error]                     ^
[error] /usr/local/spark-1.6.0-cdh5.10.0/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala:252: method cancel overrides nothing.
[error] Note: the super classes of class SparkExecuteStatementOperation contain the following, non final members named cancel:
[error] def cancel(x$1: org.apache.hive.service.cli.OperationState): Unit
[error]   override def cancel(): Unit = {
[error]                ^
[error] /usr/local/spark-1.6.0-cdh5.10.0/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/server/SparkSQLOperationManager.scala:42: method newExecuteStatementOperation overrides nothing.
[error] Note: the super classes of class SparkSQLOperationManager contain the following, non final members named newExecuteStatementOperation:
[error] def newExecuteStatementOperation(x$1: org.apache.hive.service.cli.session.HiveSession,x$2: String,x$3: java.util.Map[String,String],x$4: Boolean,x$5: Long): org.apache.hive.service.cli.operation.ExecuteStatementOperation
[error]   override def newExecuteStatementOperation(

Any idea?

Thanks in advance,

Lorenzo

1 ACCEPTED SOLUTION

avatar
Master Collaborator

Yes, the thrift server isn't shipped or supported, in part because it doesn't work with the later Hive shipped by CDH. I don't think it will build with this profile enabled.

View solution in original post

2 REPLIES 2

avatar
Master Collaborator

Yes, the thrift server isn't shipped or supported, in part because it doesn't work with the later Hive shipped by CDH. I don't think it will build with this profile enabled.

avatar
Explorer
Ok,
Thanks,
Lorenzo