Reply
Highlighted
New Contributor
Posts: 1
Registered: ‎07-13-2018

Hive action query running through Oozie throwing error - Hive Runtime Error while closing operators

I am getting below error when running hive queries parallely using oozie hive action fork. this error is random sometimes the query works and sometimes throws below error. Iam running this on CDH 5.14 Hive 1.1.0.

Can someone help resolve.

 

  2018-07-12 12:58:45,075 INFO [IPC Server handler 1 on 46529] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1531406373684_0218_m_000000_3: Error: java.lang.RuntimeException: Hive Runtime Error while closing operators
        at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.close(ExecMapper.java:217)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:459)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 

    org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
    Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to rename output from: hdfs://env1/../../../hive-result/ActData/.hive-staging_hive_2018-07-12_12-57-45_965_7504058334715068276-159/_task_tmp.-ext-10002/_tmp.000000_3 to: hdfs://env1/../../../12345_t6/hive-result/ActData/.hive-staging_hive_2018-07-12_12-57-45_965_7504058334715068276-159/_tmp.-ext-10002/000000_3.snappy 
    at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commit(FileSinkOperator.java:237)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.access$200(FileSinkOperator.java:134)
        at org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:1015)
        at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:598)
        at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610)
        at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610)
        at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610)
        at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.close(ExecMapper.java:199)
        ... 8 more

 

Announcements