Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Unable to rename output - Hive

Highlighted

Unable to rename output - Hive

New Contributor

Hi,

 

Recently we started seeing Unable to rename output files and its causing job failures and also found a bug not sure if its related

 

https://issues.apache.org/jira/browse/HIVE-4605

 

We are on Hive1.2.1000.2.5.3.0-37

HDP: 2.5.3.0-37

 

Unable to rename output from: /apps/hive/warehouse/<testxyx.db/.hive-staging_hive_2019-08-28_07-37-56_908_2490136324495723304-3/_ta... to: /apps/hive/warehouse/testxyx.db.db/.hive-staging_hive_2019-08-28_07-37-56_908_2490136324495723304-3/_tmp.-ext-10002/000079_0

 Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to rename output from: /apps/hive/warehouse/testxyz.db/.hive-staging_hive_2019-08-28_06-38-58_174_8774387112611734538-10/_task_tmp.-ext-10002/_tmp.000048_3 to: /apps/hive/warehouse/testxyz.db/.hive-staging_hive_2019-08-28_06-38-58_174_8774387112611734538-10/_tmp.-ext-10002/000048_3 at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commit(FileSinkOperator.java:241) at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.access$200(FileSinkOperator.java:145) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:1062) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:617) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:631) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:631) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecordProcessor.java:290) ... 15 more ]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:504, Vertex vertex_1563822885587_4235051_1_66 [Reducer 15] killed/failed due to:OWN_TASK_FAILURE]Vertex killed, vertexName=Map 65, vertexId=vertex_1563822885587_4235051_1_15, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1563822885587_4235051_1_15 [Map 65] killed/failed due to:OTHER_VERTEX_FAILURE]Vertex killed, vertexName=Reducer 18, vertexId=vertex_1563822885587_4235051_1_10,