Member since
03-09-2022
1
Post
0
Kudos Received
0
Solutions
03-09-2022
03:30 AM
Hello, I was running an INSERT in Hive on tez. It failed with the following error messages: Query ID = atguigu_20220309164809_a7f22472-57c1-456d-bfa4-b114f4170db1 Total jobs = 1 Launching Job 1 out of 1 FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.tez.TezTask. org.apache.hadoop.security.UserGroupInformation.getGroups()Ljava/util/List; Then I changed by setting hive.execution.engine=mr and re-ran my INSERT. It failed again with the following new messages: Number of reduce tasks not specified. Estimated from input data size: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer=<number> In order to limit the maximum number of reducers: set hive.exec.reducers.max=<number> In order to set a constant number of reducers: set mapreduce.job.reduces=<number> java.io.IOException: Unable to close file because the last block does not have enough number of replicas. To save disk space, I set replica to 1 in hadoop. What's strange is all queries work well in the same environment. Here is some basic information of my hive on tez. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/module/tez-0.9.1/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/module/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/module/hadoop-2.7.2/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] Hive 3.1.2 Git file:///home/atguigu/apache-hive-3.1.2-src -r Unknown Compiled by atguigu on Wed Apr 15 02:24:36 CST 2020 From source with checksum b3d7991c863bd601e167fd96bd029ec6 I am using Centos for my test system. [atguigu@hadoop102 hive]$ cat /etc/redhat-release CentOS Linux release 7.9.2009 (Core) Could anyone please advise? Really appreciate it! Kelvin
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Tez