Support Questions
Find answers, ask questions, and share your expertise

INSERT failed in Hive on tez but queries function perfectly

New Contributor

Hello,

     I was running an INSERT in Hive on tez. It failed with the following error messages:

 

Query ID = atguigu_20220309164809_a7f22472-57c1-456d-bfa4-b114f4170db1
Total jobs = 1
Launching Job 1 out of 1
FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.tez.TezTask. org.apache.hadoop.security.UserGroupInformation.getGroups()Ljava/util/List;

  

    Then I changed by setting  hive.execution.engine=mr and re-ran my INSERT.  It failed again with the following new messages:

 

Number of reduce tasks not specified. Estimated from input data size: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapreduce.job.reduces=<number>
java.io.IOException: Unable to close file because the last block does not have enough number of replicas.

 

      To save disk space, I set replica to 1 in hadoop.  What's strange is all queries work well in the same environment. Here is some basic information of  my hive on tez.

 

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/module/tez-0.9.1/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/module/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/module/hadoop-2.7.2/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Hive 3.1.2
Git file:///home/atguigu/apache-hive-3.1.2-src -r Unknown
Compiled by atguigu on Wed Apr 15 02:24:36 CST 2020
From source with checksum b3d7991c863bd601e167fd96bd029ec6

 

  I am using Centos for my test system.

 

[atguigu@hadoop102 hive]$ cat /etc/redhat-release
CentOS Linux release 7.9.2009 (Core)

 

   Could anyone please advise?  Really appreciate it!

 

                                                             Kelvin 

 

 

 

 

 

 

0 REPLIES 0
; ;