Error while processing statement in Hive using UNION ALL

[#1]

We're working on a data preparation phase with Hive and Tez. We're experiencing the following error:

Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Session stats:submittedDAGs=0, successfulDAGs=0, failedDAGs=0, killedDAGs=0 (state=08S01,code=2)

We're using HDP 2.3.2 with Hive 1.2.1 using ORC format and Tez engine.

Does anyone already found this error?

[#2]

Hi Andrea. Could you post the UNION ALL query you are executing along with the DDL for the tables involved? (via 'Show create table <tblname>')? That would help the debugging...

[#3]

Hi ,

it could be a compliance issue posting the DDL and query in public. If you can send me an email I can send you the DDL in private.

Thanks,

Andrea

[#4]

Hi Andrea. I suspect the issue is as Kuldeep mentioned... But please do send the DDL and query - I would be glad to try to recreate it. bpreachuk@hortonworks.com

[#5 · Accepted solution]

@Andrea D'Orio

I'm suspecting this issue is related to below apache jira tickets:

https://issues.apache.org/jira/browse/HIVE-10929

https://issues.apache.org/jira/browse/HIVE-11313

This issue should be fixed in tez version 1.2.1

If you run same query with "mr" as hive.execution.engine then it should run fine.

[#6]

We've just made a lot of tests: we do not have null value and we already use Hive 1.2.1. We also tried to delete partition from the tables involved in the queries but we always got the same error.

[#7]

@Kuldeep Kulkarni

Thanks! Do you know when Tez 1.2.1 will be released? It's planned for HDP 2.4.2?

[#8]

@Andrea D'Orio - I'm checking, will get back to you

[#9]

The issue can be resolved in lower versions also by using the distribute by keyword in the query