Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Insert overwite query on LLAP is not working but it runs through normal Hive

Solved Go to solution
Highlighted

Insert overwite query on LLAP is not working but it runs through normal Hive

New Contributor

Insert overwite query on LLAP is not working but it runs through normal Hive. The same query works through hive but fails through LLAP throwing this error

Vertex failed, vertexName=Map 1, vertexId=vertex_1507670392589_0073_1_00, diagnostics=» Vertex vertex_1507670392589_0073_1_00» Map 1 killed/failed due to:INIT_FAILURE, Fail to create InputInitializerManager, org.apache.tez.dag.api.TezReflectionException: Unable to instantiate class with 1 arguments: org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator   at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:70)   at org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:89)   at org.apache.tez.dag.app.dag.RootInputInitializerManager$1.run(RootInputInitializerManager.java:151)   at org.apache.tez.dag.app.dag.RootInputInitializerManager$1.run(RootInputInitializerManager.java:148)   at java.security.AccessController.doPrivileged(Native Method)   at javax.security.auth.Subject.doAs(Subject.java:422)   at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)   at org.apache.tez.dag.app.dag.RootInputInitializerManager.createInitializer(RootInputInitializerManager.java:148)   at org.apache.tez.dag.app.dag.RootInputInitializerManager.runInputInitializers(RootInputInitializerManager.java:121)   at org.apache.tez.dag.app.dag.impl.VertexImpl.setupInputInitializerManager(VertexImpl.java:4031)   at org.apache.tez.dag.app.dag.impl.VertexImpl.access$3100(VertexImpl.java:204)   at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.handleInitEvent(VertexImpl.java:2855)   at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition(VertexImpl.java:2802)   at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition(VertexImpl.java:2784)   at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385)   at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)   at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)   at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)   at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:59)   at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1925)   at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:203)   at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2290)   at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2276)   at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:184)   at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:115)   at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.reflect.InvocationTargetException   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)   at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)   at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)   at java.lang.reflect.Constructor.newInstance(Constructor.java:423)   at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:68)   ... 25 more Caused by: java.lang.IllegalArgumentException: No running LLAP daemons! Please check LLAP service status and zookeeper configuration   at com.google.common.base.Preconditions.checkArgument(Preconditions.java:92)   at org.apache.hadoop.hive.ql.exec.tez.Utils.getSplitLocationProvider(Utils.java:47)   at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.(HiveSplitGenerator.java:121)   ... 30 more Vertex killed, vertexName=Reducer 2, vertexId=vertex_1507670392589_0073_1_01, diagnostics=» Vertex received Kill in NEW state., Vertex vertex_1507670392589_0073_1_01» Reducer 2 killed/failed due to:OTHER_VERTEX_FAILURE

DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Insert overwite query on LLAP is not working but it runs through normal Hive

New Contributor
@viswanath

From the stack looks like none of the LLAP daemons are running. Please check the LLAP application in Yarn RM UI and ensure you have LLAP daemon containers running. You can also check the HiveServer2 Interactive UI for this.

java.lang.IllegalArgumentException: No running LLAP daemons! Please check LLAP service status and zookeeper
3 REPLIES 3

Re: Insert overwite query on LLAP is not working but it runs through normal Hive

New Contributor
@viswanath

From the stack looks like none of the LLAP daemons are running. Please check the LLAP application in Yarn RM UI and ensure you have LLAP daemon containers running. You can also check the HiveServer2 Interactive UI for this.

java.lang.IllegalArgumentException: No running LLAP daemons! Please check LLAP service status and zookeeper

Re: Insert overwite query on LLAP is not working but it runs through normal Hive

New Contributor

This looks like a bug in Hive LLAP. I get the same error for a simple select count(*) on a table. The query is good in Hive and Spark. This error is what it prints on screen but the actual error when you see the logs is:

killed/failed due to:INIT_FAILURE, Fail to create
InputInitializerManager, org.apache.tez.dag.api.TezReflectionException: Unable
to instantiate class with 1 arguments:
org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator

Re: Insert overwite query on LLAP is not working but it runs through normal Hive

New Contributor

any one get solution for this ?