were you able to resolve it? I am facing some issue ... View more

I am also facing the same issue, I have followed documentation properly but still hitting the issue count on dataframe is working fine but head is not All I am doing it val hive = com.hortonworks.spark.sql.hive.llap.HiveWarehouseBuilder.session(spark).build() hive.executeQuery("select * from test1").head Here is my stack trace 19/07/29 14:10:20 ERROR HiveWarehouseDataSourceReader: Unable to submit query to HS2 java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: shadehive.org.apache.hive.service.cli.HiveSQLException: java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.NullPointerException   at com.hortonworks.spark.sql.hive.llap.HiveWarehouseDataSourceReader.createBatchDataReaderFactories(HiveWarehouseDataSourceReader.java:166)   at org.apache.spark.sql.execution.datasources.v2.DataSourceV2ScanExec.inputRDD$lzycompute(DataSourceV2ScanExec.scala:64)   at org.apache.spark.sql.execution.datasources.v2.DataSourceV2ScanExec.inputRDD(DataSourceV2ScanExec.scala:60)   at org.apache.spark.sql.execution.datasources.v2.DataSourceV2ScanExec.inputRDDs(DataSourceV2ScanExec.scala:79)   at org.apache.spark.sql.execution.WholeStageCodegenExec.doExecute(WholeStageCodegenExec.scala:605)   at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131)   at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:127)   at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)   at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)   at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)   at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:127)   at org.apache.spark.sql.execution.SparkPlan.getByteArrayRdd(SparkPlan.scala:247)   at org.apache.spark.sql.execution.SparkPlan.executeTake(SparkPlan.scala:337)   at org.apache.spark.sql.execution.CollectLimitExec.executeCollect(limit.scala:38)   at org.apache.spark.sql.Dataset.org$apache$spark$sql$Dataset$$collectFromPlan(Dataset.scala:3278)   at org.apache.spark.sql.Dataset$$anonfun$head$1.apply(Dataset.scala:2489)   at org.apache.spark.sql.Dataset$$anonfun$head$1.apply(Dataset.scala:2489)   at org.apache.spark.sql.Dataset$$anonfun$52.apply(Dataset.scala:3259)   at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:77)   at org.apache.spark.sql.Dataset.withAction(Dataset.scala:3258)   at org.apache.spark.sql.Dataset.head(Dataset.scala:2489)   at org.apache.spark.sql.Dataset.head(Dataset.scala:2496)   ... 49 elided Caused by: java.lang.RuntimeException: java.io.IOException: shadehive.org.apache.hive.service.cli.HiveSQLException: java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.NullPointerException   at com.hortonworks.spark.sql.hive.llap.HiveWarehouseDataSourceReader.getSplitsFactories(HiveWarehouseDataSourceReader.java:182)   at com.hortonworks.spark.sql.hive.llap.HiveWarehouseDataSourceReader.createBatchDataReaderFactories(HiveWarehouseDataSourceReader.java:162)   ... 70 more Caused by: java.io.IOException: shadehive.org.apache.hive.service.cli.HiveSQLException: java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.NullPointerException   at org.apache.hadoop.hive.llap.LlapBaseInputFormat.getSplits(LlapBaseInputFormat.java:298)   at com.hortonworks.spark.sql.hive.llap.HiveWarehouseDataSourceReader.getSplitsFactories(HiveWarehouseDataSourceReader.java:176)   ... 71 more Caused by: shadehive.org.apache.hive.service.cli.HiveSQLException: java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.NullPointerException   at shadehive.org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:300)   at shadehive.org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:286)   at shadehive.org.apache.hive.jdbc.HiveQueryResultSet.next(HiveQueryResultSet.java:379)   at org.apache.hadoop.hive.llap.LlapBaseInputFormat.getSplits(LlapBaseInputFormat.java:280)   ... 72 more Caused by: org.apache.hive.service.cli.HiveSQLException: java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.NullPointerException   at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:478)   at org.apache.hive.service.cli.operation.OperationManager.getOperationNextRowSet(OperationManager.java:328)   at org.apache.hive.service.cli.session.HiveSessionImpl.fetchResults(HiveSessionImpl.java:952)   at org.apache.hive.service.cli.CLIService.fetchResults(CLIService.java:564)   at org.apache.hive.service.cli.thrift.ThriftCLIService.FetchResults(ThriftCLIService.java:792)   at org.apache.hive.service.rpc.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1837)   at org.apache.hive.service.rpc.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1822)   at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)   at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) �   at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:647)   at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)   at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) �   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)   at java.lang.Thread.run(Thread.java:748) Caused by: java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.NullPointerException   at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:162)   at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:2738) �   at org.apache.hadoop.hive.ql.reexec.ReExecDriver.getResults(ReExecDriver.java:229)   at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:473)   ... 13 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.NullPointerException   at org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.process(GenericUDTFGetSplits.java:225)   at org.apache.hadoop.hive.ql.exec.UDTFOperator.process(UDTFOperator.java:116)   at org.apache.hadoop.hive.ql.exec.Operator.baseForward(Operator.java:994)   at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:940)   at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:927)   at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:95)   at org.apache.hadoop.hive.ql.exec.Operator.baseForward(Operator.java:994)   at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:940)   at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:125)   at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:519)   at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:511)   at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:146)   ... 16 more Caused by: java.io.IOException: java.lang.NullPointerException   at org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.getSplits(GenericUDTFGetSplits.java:498)   at org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.process(GenericUDTFGetSplits.java:210)   ... 27 more Caused by: java.lang.NullPointerException: null   at org.apache.hadoop.hive.llap.LlapUtil.generateClusterName(LlapUtil.java:117)   at org.apache.hadoop.hive.llap.coordinator.LlapCoordinator.getLlapSigner(LlapCoordinator.java:103)   at org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.getSplits(GenericUDTFGetSplits.java:441)   ... 28 more ... View more

Cluster autoscaling is not supported in cloudbreak 2.2, can someone please tell me what is expected release date of cloudbreak 2.4 ref: https://docs.hortonworks.com/HDPDocuments/Cloudbreak/Cloudbreak-2.2.0/content/releasenotes/index.html ... View more