I have a job which runs a hive query inside. When it comes the time for the query Oozie throws this error:
Error while compiling statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex re-running, vertexName=Map 1, vertexId=vertex_1668428709182_0049_1_00Vertex re-running, vertexName=Map 1, vertexId=vertex_1668428709182_0049_1_00Vertex re-running, vertexName=Map 1, vertexId=vertex_1668428709182_0049_1_00Vertex failed, vertexName=Map 1, vertexId=vertex_1668428709182_0049_1_00, diagnostics=[Vertex vertex_1668428709182_0049_1_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE, Vertex vertex_1668428709182_0049_1_00 [Map 1] failed as task task_1668428709182_0049_1_00_000000 failed after vertex succeeded.]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
I can not understand a lot of this error but when I run the job through terminal it ends successfully.
Created 11-23-2022 07:28 AM
Can you please share the app logs? it looks like data issue.
Created 11-23-2022 07:38 AM
Hi @Shahrukh_shaikh. I do not have them now. What do you mean data issue? When I run theough terminal everything runs smoothly
Created 11-23-2022 07:46 AM
most of the time vertex error comes when you have something wrong with data. Check if any data offloading or transforming is happening.
Created 11-24-2022 12:46 AM
@drgenious Can you please provide below:
1. oozie wf logs(oozie application logs) ==> i can find the exact hive query executed.
2. Hive application logs.
Please collect it using:
yarn logs -applicationId <appid> > <appid>.txt ==> FOr bith Oozie and hive