Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

Hive action query running through Oozie throwing error - Hive Runtime Error while closing operators

Hive action query running through Oozie throwing error - Hive Runtime Error while closing operators

New Contributor

I am getting below error when running hive queries parallely using oozie hive action fork. this error is random sometimes the query works and sometimes throws below error. Iam running this on CDH 5.14 Hive 1.1.0.

Can someone help resolve.

 

  2018-07-12 12:58:45,075 INFO [IPC Server handler 1 on 46529] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1531406373684_0218_m_000000_3: Error: java.lang.RuntimeException: Hive Runtime Error while closing operators
        at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.close(ExecMapper.java:217)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 

    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to rename output from: hdfs://env1/../../../hive-result/ActData/.hive-staging_hive_2018-07-12_12-57-45_965_7504058334715068276-159/_task_tmp.-ext-10002/_tmp.000000_3 to: hdfs://env1/../../../12345_t6/hive-result/ActData/.hive-staging_hive_2018-07-12_12-57-45_965_7504058334715068276-159/_tmp.-ext-10002/000000_3.snappy 
    at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commit(FileSinkOperator.java:237)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.access$200(FileSinkOperator.java:134)
        at org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:1015)
        at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:598)
        at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610)
        at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610)
        at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610)
        at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.close(ExecMapper.java:199)
        ... 8 more