Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

org.apache.tez.dag.api.TezUncheckedException: Atleast 1 bipartite source should exist

org.apache.tez.dag.api.TezUncheckedException: Atleast 1 bipartite source should exist

Explorer

our jobs are failing with below exception we are using HDP 2.5.3.0 , Tez 0.7.0.2.5 , Hive 1.2.1.2.5 and Ambari 2.4.0

failing with below exception

Status: Failed
Vertex failed, vertexName=Reducer 2, vertexId=vertex_**, diagnostics=[Exception in VertexManager, vertex:vertex_ [Reducer 2],org.apache.tez.dag.api.TezUncheckedException: Atleast 1 bipartite source should exist
        at org.apache.tez.dag.library.vertexmanager.ShuffleVertexManager.onVertexStarted(ShuffleVertexManager.java:456)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEventOnVertexStarted.invoke(VertexManager.java:587)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:658)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:653)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent.call(VertexManager.java:653)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent.call(VertexManager.java:642)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
, Vertex did not succeed due to AM_USERCODE_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_** [Reducer 2] killed/failed due to:AM_USERCODE_FAILURE]

 Vertex did not succeed due to AM_USERCODE_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_ [Reducer 2] killed/failed due to:AM_USERCODE_FAILURE]Vertex killed, vertexName=Reducer 3, vertexId=vertex_, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_ [Reducer 3] killed/failed due to:OTHER_VERTEX_FAILURE]Vertex killed, vertexName=Map 4, vertexId=vertex_, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_ [Map 4] killed/failed due to:OTHER_VERTEX_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:2
After Staging execution

is it something related to

https://issues.apache.org/jira/browse/TEZ-3239

https://issues.apache.org/jira/browse/TEZ-2107

Thanks.

1 REPLY 1
Highlighted

Re: org.apache.tez.dag.api.TezUncheckedException: Atleast 1 bipartite source should exist

Explorer

Issue resolved by setting below property

set tez.grouping.max-size = 268,435,456;

Don't have an account?
Coming from Hortonworks? Activate your account here