Insert overwite query on LLAP is not working but it runs through normal Hive

[#1]

Insert overwite query on LLAP is not working but it runs through normal Hive. The same query works through hive but fails through LLAP throwing this error

Vertex failed, vertexName=Map 1, vertexId=vertex_1507670392589_0073_1_00, diagnostics=» Vertex vertex_1507670392589_0073_1_00» Map 1 killed/failed due to:INIT_FAILURE, Fail to create InputInitializerManager, org.apache.tez.dag.api.TezReflectionException: Unable to instantiate class with 1 arguments: org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator   at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:70)   at org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:89)   at org.apache.tez.dag.app.dag.RootInputInitializerManager$1.run(RootInputInitializerManager.java:151)   at org.apache.tez.dag.app.dag.RootInputInitializerManager$1.run(RootInputInitializerManager.java:148)   at java.security.AccessController.doPrivileged(Native Method)   at javax.security.auth.Subject.doAs(Subject.java:422)   at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)   at org.apache.tez.dag.app.dag.RootInputInitializerManager.createInitializer(RootInputInitializerManager.java:148)   at org.apache.tez.dag.app.dag.RootInputInitializerManager.runInputInitializers(RootInputInitializerManager.java:121)   at org.apache.tez.dag.app.dag.impl.VertexImpl.setupInputInitializerManager(VertexImpl.java:4031)   at org.apache.tez.dag.app.dag.impl.VertexImpl.access$3100(VertexImpl.java:204)   at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.handleInitEvent(VertexImpl.java:2855)   at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition(VertexImpl.java:2802)   at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition(VertexImpl.java:2784)   at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385)   at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)   at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)   at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)   at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:59)   at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1925)   at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:203)   at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2290)   at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2276)   at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:184)   at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:115)   at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.reflect.InvocationTargetException   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)   at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)   at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)   at java.lang.reflect.Constructor.newInstance(Constructor.java:423)   at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:68)   ... 25 more Caused by: java.lang.IllegalArgumentException: No running LLAP daemons! Please check LLAP service status and zookeeper configuration   at com.google.common.base.Preconditions.checkArgument(Preconditions.java:92)   at org.apache.hadoop.hive.ql.exec.tez.Utils.getSplitLocationProvider(Utils.java:47)   at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.(HiveSplitGenerator.java:121)   ... 30 more Vertex killed, vertexName=Reducer 2, vertexId=vertex_1507670392589_0073_1_01, diagnostics=» Vertex received Kill in NEW state., Vertex vertex_1507670392589_0073_1_01» Reducer 2 killed/failed due to:OTHER_VERTEX_FAILURE

DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1

[#2 · Accepted solution]

@viswanath

From the stack looks like none of the LLAP daemons are running. Please check the LLAP application in Yarn RM UI and ensure you have LLAP daemon containers running. You can also check the HiveServer2 Interactive UI for this.

java.lang.IllegalArgumentException: No running LLAP daemons! Please check LLAP service status and zookeeper

[#3]

This looks like a bug in Hive LLAP. I get the same error for a simple select count(*) on a table. The query is good in Hive and Spark. This error is what it prints on screen but the actual error when you see the logs is:

killed/failed due to:INIT_FAILURE, Fail to create
InputInitializerManager, org.apache.tez.dag.api.TezReflectionException: Unable
to instantiate class with 1 arguments:
org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator

[#4]

any one get solution for this ?