Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

My hive(tez) job load gets fail quit often which are schedule in tivoli..please help below is the logs..

Highlighted

My hive(tez) job load gets fail quit often which are schedule in tivoli..please help below is the logs..

Rising Star

Below is error log i get..

Exact failure occurred while running: hive -f /data/edw/prod/nazhdp/c720/bin/wrk/PID_Gen/pre_stage_to_delta.sql Please look into the above sql script Log : Loading data to table db_c720_stg.event_int_key Table db_c720_stg.event_int_key stats: [numFiles=33, numRows=523, totalSize=2033867, rawDataSize=7853] MapReduce Jobs Launched: Job 0: HDFS Read: 0 HDFS Write: 0 SUCCESS Job 1: HDFS Read: 0 HDFS Write: 0 SUCCESS

Total MapReduce CPU Time Spent: 0 msec

OK

Time taken: 36.036 seconds

Logging initialized using configuration in file:/etc/hive/conf.dist/hive-log4j.properties Warning: Map Join MAPJOIN[42][bigTable=?] in task 'Map 2' is a cross product Query ID = abic720prod_20160831050606_407ea339-96de-4b5b-85bb-1f808d0d7354 Total jobs = 1 Launching Job 1 out of 1

Status: Running (application id: application_1443521267046_245061) Map 1: -/- Map 2: -/- Map 3: -/- Map 4: -/- Map 5: -/- Map 6: -/- Reducer 7: 0/1

Status: Failed Vertex failed, vertexName=Map 5, vertexId=vertex_1443521267046_245061_1_03, diagnostics=[Vertex Input: a initializer failed.]

Vertex killed, vertexName=Map 4, vertexId=vertex_1443521267046_245061_1_04, diagnostics=[Vertex received Kill in INITED state.]

Vertex killed, vertexName=Map 1, vertexId=vertex_1443521267046_245061_1_06, diagnostics=[Vertex received Kill in INITED state.]

Vertex killed, vertexName=Map 3, vertexId=vertex_1443521267046_245061_1_05, diagnostics=[Vertex received Kill in INITED state.]

Vertex killed, vertexName=Reducer 7, vertexId=vertex_1443521267046_245061_1_01, diagnostics=[Vertex received Kill in INITED state.]

Vertex killed, vertexName=Map 6, vertexId=vertex_1443521267046_245061_1_02, diagnostics=[Vertex received Kill in INITED state.]

Vertex killed, vertexName=Map 2, vertexId=vertex_1443521267046_245061_1_00, diagnostics=[Vertex received Kill in INITED state.]

DAG failed due to vertex failure. failedVertices:1 killedVertices:6 FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask c720DlyEvt.sh returned 2 for last run. Script Aborted.

2 REPLIES 2

Re: My hive(tez) job load gets fail quit often which are schedule in tivoli..please help below is the logs..

New Contributor

Sankar,

Does the job run to completion when you use M/R?

Re: My hive(tez) job load gets fail quit often which are schedule in tivoli..please help below is the logs..

New Contributor

If somebody preferes being on tez, he can switch this property to false : 'set auto.hive.convert.join=false', this should work too.

Don't have an account?
Coming from Hortonworks? Activate your account here