question Re: Error while processing statement in Hive using UNION ALL in Archives of Support Questions (Read Only)

Error while processing statement in Hive using UNION ALL

dorio — Thu, 21 Apr 2016 03:28:14 GMT

We're working on a data preparation phase with Hive and Tez. We're experiencing the following error:

Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Session stats:submittedDAGs=0, successfulDAGs=0, failedDAGs=0, killedDAGs=0 (state=08S01,code=2)

We're using HDP 2.3.2 with Hive 1.2.1 using ORC format and Tez engine.

Does anyone already found this error?

Re: Error while processing statement in Hive using UNION ALL

bpreachuk — Thu, 21 Apr 2016 04:17:10 GMT

Hi Andrea. Could you post the UNION ALL query you are executing along with the DDL for the tables involved? (via 'Show create table <tblname>')? That would help the debugging...

Re: Error while processing statement in Hive using UNION ALL

KuldeepK — Thu, 21 Apr 2016 11:57:58 GMT

@Andrea D'Orio

I'm suspecting this issue is related to below apache jira tickets:

https://issues.apache.org/jira/browse/HIVE-10929

https://issues.apache.org/jira/browse/HIVE-11313

This issue should be fixed in tez version 1.2.1

If you run same query with "mr" as hive.execution.engine then it should run fine.

Re: Error while processing statement in Hive using UNION ALL

dorio — Thu, 21 Apr 2016 16:16:15 GMT

@Kuldeep Kulkarni

Thanks! Do you know when Tez 1.2.1 will be released? It's planned for HDP 2.4.2?

Re: Error while processing statement in Hive using UNION ALL

dorio — Fri, 22 Apr 2016 02:59:51 GMT

Hi ,

it could be a compliance issue posting the DDL and query in public. If you can send me an email I can send you the DDL in private.

Thanks,

Andrea

Re: Error while processing statement in Hive using UNION ALL

dorio — Fri, 22 Apr 2016 03:02:09 GMT

We've just made a lot of tests: we do not have null value and we already use Hive 1.2.1. We also tried to delete partition from the tables involved in the queries but we always got the same error.

Re: Error while processing statement in Hive using UNION ALL

KuldeepK — Fri, 22 Apr 2016 13:41:35 GMT

@Andrea D'Orio - I'm checking, will get back to you

Re: Error while processing statement in Hive using UNION ALL

bpreachuk — Sat, 23 Apr 2016 01:07:41 GMT

Hi Andrea. I suspect the issue is as Kuldeep mentioned... But please do send the DDL and query - I would be glad to try to recreate it. bpreachuk@hortonworks.com

Re: Error while processing statement in Hive using UNION ALL

raunaqsharma — Wed, 03 Aug 2016 12:04:13 GMT

The issue can be resolved in lower versions also by using the distribute by keyword in the query