Support Questions

Find answers, ask questions, and share your expertise

Tez query failed with UnsupportedOperationException

avatar
Explorer

I run a Tez query and got this error:

Vertex failed, vertexName=Map 1, vertexId=vertex_1491880209450_21671_1_14, diagnostics=[Vertex vertex_1491880209450_21671_1_14 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: tcaef_auth_dtl_full initializer failed, vertex=vertex_1491880209450_21671_1_14 [Map 1], java.lang.UnsupportedOperationException: Not expecting to handle any events

at org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.handleInputInitializerEvent(MRInputAMSplitGenerator.java:172)

at org.apache.tez.dag.app.dag.RootInputInitializerManager$InitializerWrapper.sendEvents(RootInputInitializerManager.java:482)

at org.apache.tez.dag.app.dag.RootInputInitializerManager$InitializerWrapper.onTaskSucceeded(RootInputInitializerManager.java:432)

at org.apache.tez.dag.app.dag.StateChangeNotifier.taskSucceeded(StateChangeNotifier.java:290)

at org.apache.tez.dag.app.dag.impl.TaskImpl$TaskStateChangedCallback.onStateChanged(TaskImpl.java:1498)

at org.apache.tez.dag.app.dag.impl.TaskImpl$TaskStateChangedCallback.onStateChanged(TaskImpl.java:1482)

at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:61)

at org.apache.tez.dag.app.dag.impl.TaskImpl.handle(TaskImpl.java:894)

at org.apache.tez.dag.app.dag.impl.TaskImpl.handle(TaskImpl.java:108)

at org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher.handle(DAGAppMaster.java:1894)

at org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher.handle(DAGAppMaster.java:1880)

at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)

at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)

at java.lang.Thread.run(Thread.java:745)

]

Vertex killed, vertexName=Reducer 4, vertexId=vertex_1491880209450_21671_1_17, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_1491880209450_21671_1_17 [Reducer 4] killed/failed due to:null]

Vertex killed, vertexName=Map 3, vertexId=vertex_1491880209450_21671_1_16, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_1491880209450_21671_1_16 [Map 3] killed/failed due to:null]

Vertex killed, vertexName=Map 18, vertexId=vertex_1491880209450_21671_1_15, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_15 [Map 18] killed/failed due to:null]

Vertex killed, vertexName=Map 2, vertexId=vertex_1491880209450_21671_1_13, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_13 [Map 2] killed/failed due to:null]

Vertex killed, vertexName=Map 17, vertexId=vertex_1491880209450_21671_1_12, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_12 [Map 17] killed/failed due to:null]

Vertex killed, vertexName=Map 5, vertexId=vertex_1491880209450_21671_1_02, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_02 [Map 5] killed/failed due to:null]

Vertex killed, vertexName=Map 8, vertexId=vertex_1491880209450_21671_1_01, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_01 [Map 8] killed/failed due to:null]

Vertex killed, vertexName=Map 16, vertexId=vertex_1491880209450_21671_1_11, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_11 [Map 16] killed/failed due to:null]

Vertex killed, vertexName=Map 15, vertexId=vertex_1491880209450_21671_1_10, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_10 [Map 15] killed/failed due to:null]

Vertex killed, vertexName=Map 12, vertexId=vertex_1491880209450_21671_1_07, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_07 [Map 12] killed/failed due to:null]

Vertex killed, vertexName=Map 11, vertexId=vertex_1491880209450_21671_1_06, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_06 [Map 11] killed/failed due to:null]

Vertex killed, vertexName=Map 10, vertexId=vertex_1491880209450_21671_1_05, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_05 [Map 10] killed/failed due to:null]

DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:12

FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1491880209450_21671_1_14, diagnostics=[Vertex vertex_1491880209450_21671_1_14 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: tcaef_auth_dtl_full initializer failed, vertex=vertex_1491880209450_21671_1_14 [Map 1], java.lang.UnsupportedOperationException: Not expecting to handle any events

at org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.handleInputInitializerEvent(MRInputAMSplitGenerator.java:172)

at org.apache.tez.dag.app.dag.RootInputInitializerManager$InitializerWrapper.sendEvents(RootInputInitializerManager.java:482)

at org.apache.tez.dag.app.dag.RootInputInitializerManager$InitializerWrapper.onTaskSucceeded(RootInputInitializerManager.java:432)

at org.apache.tez.dag.app.dag.StateChangeNotifier.taskSucceeded(StateChangeNotifier.java:290)

at org.apache.tez.dag.app.dag.impl.TaskImpl$TaskStateChangedCallback.onStateChanged(TaskImpl.java:1498)

at org.apache.tez.dag.app.dag.impl.TaskImpl$TaskStateChangedCallback.onStateChanged(TaskImpl.java:1482)

at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:61)

at org.apache.tez.dag.app.dag.impl.TaskImpl.handle(TaskImpl.java:894)

at org.apache.tez.dag.app.dag.impl.TaskImpl.handle(TaskImpl.java:108)

at org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher.handle(DAGAppMaster.java:1894)

at org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher.handle(DAGAppMaster.java:1880)

at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)

at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)

at java.lang.Thread.run(Thread.java:745)

]Vertex killed, vertexName=Reducer 4, vertexId=vertex_1491880209450_21671_1_17, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_1491880209450_21671_1_17 [Reducer 4] killed/failed due to:null]Vertex killed, vertexName=Map 3, vertexId=vertex_1491880209450_21671_1_16, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_1491880209450_21671_1_16 [Map 3] killed/failed due to:null]Vertex killed, vertexName=Map 18, vertexId=vertex_1491880209450_21671_1_15, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_15 [Map 18] killed/failed due to:null]Vertex killed, vertexName=Map 2, vertexId=vertex_1491880209450_21671_1_13, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_13 [Map 2] killed/failed due to:null]Vertex killed, vertexName=Map 17, vertexId=vertex_1491880209450_21671_1_12, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_12 [Map 17] killed/failed due to:null]Vertex killed, vertexName=Map 5, vertexId=vertex_1491880209450_21671_1_02, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_02 [Map 5] killed/failed due to:null]Vertex killed, vertexName=Map 8, vertexId=vertex_1491880209450_21671_1_01, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_01 [Map 8] killed/failed due to:null]Vertex killed, vertexName=Map 16, vertexId=vertex_1491880209450_21671_1_11, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_11 [Map 16] killed/failed due to:null]Vertex killed, vertexName=Map 15, vertexId=vertex_1491880209450_21671_1_10, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_10 [Map 15] killed/failed due to:null]Vertex killed, vertexName=Map 12, vertexId=vertex_1491880209450_21671_1_07, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_07 [Map 12] killed/failed due to:null]Vertex killed, vertexName=Map 11, vertexId=vertex_1491880209450_21671_1_06, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_06 [Map 11] killed/failed due to:null]Vertex killed, vertexName=Map 10, vertexId=vertex_1491880209450_21671_1_05, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_05 [Map 10] killed/failed due to:null]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:12

1 REPLY 1

avatar
Guru

Seems like a known bug https://issues.apache.org/jira/browse/TEZ-3336 fixed in 2.6.