Member since
04-14-2017
4
Posts
0
Kudos Received
0
Solutions
07-20-2017
10:22 PM
I run a Tez query and got IllegalArgumentException. I notice this error only happens when I give date with empty data. When I change the date to a date with data, like '2017-03-01', the query works. Am I missing any settings? SQL: select * from t1 where date in ('2015-03-01', '2015-03-02', '2015-03-03') group by date; Stacktrace: Map 1: -/- Map 2: -/- Map 3: -/- Map 5: -/- Reducer 4: 0/2 Status: Failed Vertex failed, vertexName=Map 1, vertexId=vertex_1500433809286_8042_2_01, diagnostics=[Vertex vertex_1500433809286_8042_2_01 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: tcaef_aut h_dtl_full initializer failed, vertex=vertex_1500433809286_8042_2_01 [Map 1], java.lang.IllegalArgumentException at java.util.concurrent.ThreadPoolExecutor.<init>(ThreadPoolExecutor.java:1307) at java.util.concurrent.ThreadPoolExecutor.<init>(ThreadPoolExecutor.java:1195) at java.util.concurrent.Executors.newFixedThreadPool(Executors.java:89) at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:519) at org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateOldSplits(MRInputHelpers.java:446) at org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateInputSplitsToMem(MRInputHelpers.java:300) at org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.initialize(MRInputAMSplitGenerator.java:123) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:278) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:269) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:269) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) ] Vertex killed, vertexName=Reducer 4, vertexId=vertex_1500433809286_8042_2_04, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_1500433809286_8042_2_04 [Reducer 4] killed/failed due to:OTHER_VERTEX_FAILURE] Vertex killed, vertexName=Map 3, vertexId=vertex_1500433809286_8042_2_03, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_1500433809286_8042_2_03 [Map 3] killed/failed due to:OTHER_VERTEX_FAILURE] Vertex killed, vertexName=Map 2, vertexId=vertex_1500433809286_8042_2_02, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_1500433809286_8042_2_02 [Map 2] killed/failed due to:OTHER_VERTEX_FAILURE] Vertex killed, vertexName=Map 5, vertexId=vertex_1500433809286_8042_2_00, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_1500433809286_8042_2_00 [Map 5] killed/failed due to:OTHER_VERTEX_FAILURE]
... View more
Labels:
- Labels:
-
Apache Tez
04-15-2017
06:28 AM
I run a Tez query and got this error: Vertex failed, vertexName=Map 1,
vertexId=vertex_1491880209450_21671_1_14, diagnostics=[Vertex
vertex_1491880209450_21671_1_14 [Map 1] killed/failed due
to:ROOT_INPUT_INIT_FAILURE, Vertex Input: tcaef_auth_dtl_full initializer
failed, vertex=vertex_1491880209450_21671_1_14 [Map 1],
java.lang.UnsupportedOperationException: Not expecting to handle any events at org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.handleInputInitializerEvent(MRInputAMSplitGenerator.java:172) at
org.apache.tez.dag.app.dag.RootInputInitializerManager$InitializerWrapper.sendEvents(RootInputInitializerManager.java:482) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InitializerWrapper.onTaskSucceeded(RootInputInitializerManager.java:432) at
org.apache.tez.dag.app.dag.StateChangeNotifier.taskSucceeded(StateChangeNotifier.java:290) at
org.apache.tez.dag.app.dag.impl.TaskImpl$TaskStateChangedCallback.onStateChanged(TaskImpl.java:1498) at
org.apache.tez.dag.app.dag.impl.TaskImpl$TaskStateChangedCallback.onStateChanged(TaskImpl.java:1482) at
org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:61) at org.apache.tez.dag.app.dag.impl.TaskImpl.handle(TaskImpl.java:894) at
org.apache.tez.dag.app.dag.impl.TaskImpl.handle(TaskImpl.java:108) at
org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher.handle(DAGAppMaster.java:1894) at
org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher.handle(DAGAppMaster.java:1880) at
org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183) at
org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114) at java.lang.Thread.run(Thread.java:745) ] Vertex killed, vertexName=Reducer 4,
vertexId=vertex_1491880209450_21671_1_17, diagnostics=[Vertex received Kill in
INITED state., Vertex vertex_1491880209450_21671_1_17 [Reducer 4] killed/failed
due to:null] Vertex killed, vertexName=Map 3, vertexId=vertex_1491880209450_21671_1_16,
diagnostics=[Vertex received Kill in INITED state., Vertex
vertex_1491880209450_21671_1_16 [Map 3] killed/failed due to:null] Vertex killed, vertexName=Map 18,
vertexId=vertex_1491880209450_21671_1_15, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_15 [Map 18]
killed/failed due to:null] Vertex killed, vertexName=Map 2,
vertexId=vertex_1491880209450_21671_1_13, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_13 [Map 2]
killed/failed due to:null] Vertex killed, vertexName=Map 17, vertexId=vertex_1491880209450_21671_1_12,
diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not
succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex
vertex_1491880209450_21671_1_12 [Map 17] killed/failed due to:null] Vertex killed, vertexName=Map 5,
vertexId=vertex_1491880209450_21671_1_02, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_02 [Map 5]
killed/failed due to:null] Vertex killed, vertexName=Map 8,
vertexId=vertex_1491880209450_21671_1_01, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_01 [Map 8]
killed/failed due to:null] Vertex killed, vertexName=Map 16,
vertexId=vertex_1491880209450_21671_1_11, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0
killedTasks:1, Vertex vertex_1491880209450_21671_1_11 [Map 16] killed/failed
due to:null] Vertex killed, vertexName=Map 15,
vertexId=vertex_1491880209450_21671_1_10, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_10 [Map 15]
killed/failed due to:null] Vertex killed, vertexName=Map 12,
vertexId=vertex_1491880209450_21671_1_07, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_07 [Map 12]
killed/failed due to:null] Vertex killed, vertexName=Map 11,
vertexId=vertex_1491880209450_21671_1_06, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_06 [Map 11]
killed/failed due to:null] Vertex killed, vertexName=Map 10, vertexId=vertex_1491880209450_21671_1_05,
diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not
succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex
vertex_1491880209450_21671_1_05 [Map 10] killed/failed due to:null] DAG did not succeed due to VERTEX_FAILURE. failedVertices:1
killedVertices:12 FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1,
vertexId=vertex_1491880209450_21671_1_14, diagnostics=[Vertex vertex_1491880209450_21671_1_14
[Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input:
tcaef_auth_dtl_full initializer failed, vertex=vertex_1491880209450_21671_1_14
[Map 1], java.lang.UnsupportedOperationException: Not expecting to handle any
events at
org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.handleInputInitializerEvent(MRInputAMSplitGenerator.java:172) at
org.apache.tez.dag.app.dag.RootInputInitializerManager$InitializerWrapper.sendEvents(RootInputInitializerManager.java:482) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InitializerWrapper.onTaskSucceeded(RootInputInitializerManager.java:432) at
org.apache.tez.dag.app.dag.StateChangeNotifier.taskSucceeded(StateChangeNotifier.java:290) at org.apache.tez.dag.app.dag.impl.TaskImpl$TaskStateChangedCallback.onStateChanged(TaskImpl.java:1498) at
org.apache.tez.dag.app.dag.impl.TaskImpl$TaskStateChangedCallback.onStateChanged(TaskImpl.java:1482) at
org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:61) at org.apache.tez.dag.app.dag.impl.TaskImpl.handle(TaskImpl.java:894) at
org.apache.tez.dag.app.dag.impl.TaskImpl.handle(TaskImpl.java:108) at
org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher.handle(DAGAppMaster.java:1894) at org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher.handle(DAGAppMaster.java:1880) at
org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183) at
org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114) at java.lang.Thread.run(Thread.java:745) ]Vertex killed, vertexName=Reducer 4,
vertexId=vertex_1491880209450_21671_1_17, diagnostics=[Vertex received Kill in
INITED state., Vertex vertex_1491880209450_21671_1_17 [Reducer 4] killed/failed
due to:null]Vertex killed, vertexName=Map 3, vertexId=vertex_1491880209450_21671_1_16,
diagnostics=[Vertex received Kill in INITED state., Vertex
vertex_1491880209450_21671_1_16 [Map 3] killed/failed due to:null]Vertex
killed, vertexName=Map 18, vertexId=vertex_1491880209450_21671_1_15,
diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not
succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex
vertex_1491880209450_21671_1_15 [Map 18] killed/failed due to:null]Vertex
killed, vertexName=Map 2, vertexId=vertex_1491880209450_21671_1_13,
diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not
succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex
vertex_1491880209450_21671_1_13 [Map 2] killed/failed due to:null]Vertex
killed, vertexName=Map 17, vertexId=vertex_1491880209450_21671_1_12,
diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not
succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex
vertex_1491880209450_21671_1_12 [Map 17] killed/failed due to:null]Vertex
killed, vertexName=Map 5, vertexId=vertex_1491880209450_21671_1_02,
diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not
succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex
vertex_1491880209450_21671_1_02 [Map 5] killed/failed due to:null]Vertex
killed, vertexName=Map 8, vertexId=vertex_1491880209450_21671_1_01,
diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not
succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_01
[Map 8] killed/failed due to:null]Vertex killed, vertexName=Map 16,
vertexId=vertex_1491880209450_21671_1_11, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_11 [Map 16]
killed/failed due to:null]Vertex killed, vertexName=Map 15,
vertexId=vertex_1491880209450_21671_1_10, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_10 [Map 15]
killed/failed due to:null]Vertex killed, vertexName=Map 12,
vertexId=vertex_1491880209450_21671_1_07, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_07 [Map 12]
killed/failed due to:null]Vertex killed, vertexName=Map 11,
vertexId=vertex_1491880209450_21671_1_06, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_06 [Map 11]
killed/failed due to:null]Vertex killed, vertexName=Map 10,
vertexId=vertex_1491880209450_21671_1_05, diagnostics=[Vertex received Kill
while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,
failedTasks:0 killedTasks:1, Vertex vertex_1491880209450_21671_1_05 [Map 10]
killed/failed due to:null]DAG did not succeed due to VERTEX_FAILURE.
failedVertices:1 killedVertices:12
... View more
Labels:
- Labels:
-
Apache Tez