The problem was that root user was being used to run the queries. Problem was solved when user was switched to hive. ... View more

verified in ambari that hiveserver2 interactive was started. verified that llap daemon is running. Same problem as before. output of ps : yarn 47364 47362 0 18:23 ? 00:00:00 /bin/bash -c python ./infra/agent/slider-agent/agent/main.py --label container_e20_1484001352838_0037_01_000011___LLAP --zk-quorum p264n11.pbm.ihost.com:2181,p264n01.pbm.ihost.com:2181,p264n02.pbm.ihost.com:2181 --zk-reg-path /registry/users/hive/services/org-apache-slider/llap0 > /hdd9/hadoop/yarn/log/application_1484001352838_0037/container_e20_1484001352838_0037_01_000011/slider-agent.out 2>&1 yarn 47375 47364 0 18:23 ? 00:00:00 python ./infra/agent/slider-agent/agent/main.py --label container_e20_1484001352838_0037_01_000011___LLAP --zk-quorum p264n11.pbm.ihost.com:2181,p264n01.pbm.ihost.com:2181,p264n02.pbm.ihost.com:2181 --zk-reg-path /registry/users/hive/services/org-apache-slider/llap0 yarn 47416 1 7 18:23 ? 00:00:22 /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.111-1.b15.el7_2.ppc64le/bin/java -Dproc_llapdaemon -Xms164864m -Xmx164864m -XX:+AlwaysPreTouch -XX:+UseG1GC -XX:TLABSize=8m -XX:+ResizeTLAB -XX:+UseNUMA -XX:+AggressiveOpts -XX:MetaspaceSize=1024m -XX:InitiatingHeapOccupancyPercent=80 -XX:MaxGCPauseMillis=200 -server -Djava.net.preferIPv4Stack=true -XX:NewRatio=8 -XX:+UseNUMA -XX:+PrintGCDetails -verbose:gc -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=4 -XX:GCLogFileSize=100M -Xloggc:/hdd9/hadoop/yarn/log/application_1484001352838_0037/container_e20_1484001352838_0037_01_000011//gc.log -Djava.io.tmpdir=/hdd9/hadoop/yarn/local/usercache/hive/appcache/application_1484001352838_0037/container_e20_1484001352838_0037_01_000011/tmp/ -Dlog4j.configurationFile=llap-daemon-log4j2.properties -Dllap.daemon.log.dir=/hdd9/hadoop/yarn/log/application_1484001352838_0037/container_e20_1484001352838_0037_01_000011/ -Dllap.daemon.log.file=llap-daemon-hive-p264n01.pbm.ihost.com.log -Dllap.daemon.root.logger=RFA -Dllap.daemon.log.level=INFO -classpath /hdd9/hadoop/yarn/local/usercache/hive/appcache/application_1484001352838_0037/container_e20_1484001352838_0037_01_000011/app/install//conf/:/hdd9/hadoop/yarn/local/usercache/hive/appcache/application_1484001352838_0037/container_e20_1484001352838_0037_01_000011/app/install//lib/*:/hdd9/hadoop/yarn/local/usercache/hive/appcache/application_1484001352838_0037/container_e20_1484001352838_0037_01_000011/app/install//lib/tez/*:/hdd9/hadoop/yarn/local/usercache/hive/appcache/application_1484001352838_0037/container_e20_1484001352838_0037_01_000011/app/install//lib/udfs/*:.: org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon ---------------------------------------------------------------------------------------------- /usr/hdp/2.5.3.0-38/hive2/bin/beeline -u jdbc:hive2:// which: no hbase in (/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/home/operf/oprofile_install/bin:/root/bin) SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/hdp/2.5.3.0-38/hive2/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/2.5.3.0-38/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Connecting to jdbc:hive2:// 17/01/09 18:30:37 [main]: WARN conf.HiveConf: HiveConf of name hive.llap.daemon.allow.permanent.fns does not exist 17/01/09 18:30:37 [main]: WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value 17/01/09 18:30:38 [main]: WARN conf.HiveConf: HiveConf of name hive.llap.daemon.allow.permanent.fns does not exist 17/01/09 18:30:38 [main]: WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value 17/01/09 18:30:42 [main]: WARN session.SessionState: METASTORE_FILTER_HOOK will be ignored, since hive.security.authorization.manager is set to instance of HiveAuthorizerFactory. 17/01/09 18:30:42 [main]: WARN metrics2.CodahaleMetrics: A Gauge with name [init_total_count_dbs] already exists. The old gauge will be overwritten, but this is not recommended 17/01/09 18:30:42 [main]: WARN metrics2.CodahaleMetrics: A Gauge with name [init_total_count_tables] already exists. The old gauge will be overwritten, but this is not recommended 17/01/09 18:30:42 [main]: WARN metrics2.CodahaleMetrics: A Gauge with name [init_total_count_partitions] already exists. The old gauge will be overwritten, but this is not recommended Connected to: Apache Hive (version 2.1.0.2.5.3.0-38) Driver: Hive JDBC (version 2.1.0.2.5.3.0-38) 17/01/09 18:30:42 [main]: WARN jdbc.HiveConnection: Request to set autoCommit to false; Hive does not support autoCommit=false. Transaction isolation: TRANSACTION_REPEATABLE_READ use tpcds_bin_partitioned_orc_10000; OK No rows affected (0.059 seconds) 0: jdbc:hive2://> source query12.sql; 17/01/09 18:33:12 [main]: WARN conf.HiveConf: HiveConf of name hive.llap.daemon.allow.permanent.fns does not exist 17/01/09 18:33:12 [main]: WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value 17/01/09 18:33:13 [69d264fd-a751-41c5-8b90-ca0dfd20b436 main]: ERROR hdfs.KeyProviderCache: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !! 17/01/09 18:33:15 [69d264fd-a751-41c5-8b90-ca0dfd20b436 main]: ERROR calcite.RelOptHiveTable: No Stats for tpcds_bin_partitioned_orc_10000@item, Columns: i_item_sk 17/01/09 18:33:15 [69d264fd-a751-41c5-8b90-ca0dfd20b436 main]: WARN parse.CalcitePlanner: Missing column stats (see previous messages), skipping join reordering in CBO Query ID = root_20170109183313_f1b39e2e-66fe-4b19-b7b2-a419b901956a Total jobs = 1 Launching Job 1 out of 1 Status: Failed 17/01/09 18:33:24 [HiveServer2-Background-Pool: Thread-51]: ERROR SessionState: Status: Failed Vertex failed, vertexName=Map 5, vertexId=vertex_1484001352838_0070_1_00, diagnostics=[Vertex vertex_1484001352838_0070_1_00 [Map 5] killed/failed due to:INIT_FAILURE, Fail to create InputInitializerManager, org.apache.tez.dag.api.TezReflectionException: Unable to instantiate class with 1 arguments: org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:70) at org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:89) at org.apache.tez.dag.app.dag.RootInputInitializerManager$1.run(RootInputInitializerManager.java:151) at org.apache.tez.dag.app.dag.RootInputInitializerManager$1.run(RootInputInitializerManager.java:148) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) at org.apache.tez.dag.app.dag.RootInputInitializerManager.createInitializer(RootInputInitializerManager.java:148) at org.apache.tez.dag.app.dag.RootInputInitializerManager.runInputInitializers(RootInputInitializerManager.java:121) at org.apache.tez.dag.app.dag.impl.VertexImpl.setupInputInitializerManager(VertexImpl.java:3986) at org.apache.tez.dag.app.dag.impl.VertexImpl.access$3100(VertexImpl.java:204) at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.handleInitEvent(VertexImpl.java:2818) at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition(VertexImpl.java:2765) at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition(VertexImpl.java:2747) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448) at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:59) at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1888) at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:203) at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2242) at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2228) at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183) at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:68) ... 25 more Caused by: java.lang.IllegalStateException: org.apache.hadoop.hive.ql.exec.tez.HostAffinitySplitLocationProviderneeds at least 1 location to function at com.google.common.base.Preconditions.checkState(Preconditions.java:149) at org.apache.hadoop.hive.ql.exec.tez.HostAffinitySplitLocationProvider.<init>(HostAffinitySplitLocationProvider.java:51) at org.apache.hadoop.hive.ql.exec.tez.Utils.getSplitLocationProvider(Utils.java:52) at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.<init>(HiveSplitGenerator.java:121) ... 30 more ... View more