Cloudera Community

Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Tez failed when insert any record to Hive based on Tez

Labels:
avatar
author-rank Kaher
New Contributor

Created ‎08-04-2023 10:45 AM

After configuring Hive with Tez, it works properly and the ACID table is created successfully. but when trying to run insert statement to insert record to this table, Tez failed with below log

------------------------------------------------------------------------------------------------------------------

2023-08-04 09:48:26,265 [INFO] [main] |common.TezClassLoader|: Created TezClassLoader with parent classloader: sun.misc.Launcher$AppClassLoader@677327b6, thread: 1, system classloader: sun.misc.Launcher$AppClassLoader@677327b6
2023-08-04 09:48:27,355 [INFO] [main] |app.DAGAppMaster|: Creating DAGAppMaster for applicationId=application_1691002829482_0026, attemptNum=1, AMContainerId=container_1691002829482_0026_01_000001, jvmPid=83708, userFromEnv=hadoop, cliSessionOption=true, pwd=/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001, localDirs=/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026, logDirs=/opt/hadoop-3.1.1/logs/userlogs/application_1691002829482_0026/container_1691002829482_0026_01_000001
2023-08-04 09:48:28,487 [INFO] [main] |security.SecurityUtil|: Updating Configuration
2023-08-04 09:48:29,360 [INFO] [main] |app.DAGAppMaster|: Created DAGAppMaster for application appattempt_1691002829482_0026_000001, versionInfo=[ component=tez-dag, version=0.10.2, revision=72977b8720b2337ab0a0a3bf3b12e1c57900fa69, SCM-URL=scm:git:https://gitbox.apache.org/repos/asf/tez.git, buildTime=2022-07-08T16:21:10Z, buildUser=laszlobodor, buildJavaVersion=1.8.0_292 ]
2023-08-04 09:48:29,624 [INFO] [main] |app.DAGAppMaster|: 
/************************************************************
[system properties]
os.name: Linux
os.version: 3.10.0-1160.el7.x86_64
java.home: /opt/jdk1.8.0_202/jre
java.runtime.version: 1.8.0_202-b08
java.vendor: Oracle Corporation
java.version: 1.8.0_202
java.vm.name: Java HotSpot(TM) 64-Bit Server VM
java.class.path: /tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/hive-exec-3.1.2-50b0545693ae9392559584116a172ee32922e57ae9ea0eb7dc120290c217c2d5.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/hadoop-shim-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-api-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-build-tools-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-common-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-runtime-internals-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-runtime-library-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-mapreduce-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-examples-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-dag-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-tests-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-ext-service-tests-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-protobuf-history-plugin-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-yarn-timeline-history-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-yarn-timeline-history-with-acls-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-yarn-timeline-cache-plugin-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-yarn-timeline-history-with-fs-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-history-parser-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-job-analyzer-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/tez-javadoc-tools-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/hadoop-shim-2.8-0.10.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/slf4j-api-1.7.36.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/guava-31.1-jre.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/failureaccess-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/checker-qual-3.12.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/error_prone_annotations-2.11.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/j2objc-annotations-1.3.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-io-2.8.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-lang-2.6.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jettison-1.3.4.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/stax-api-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-common-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-shaded-protobuf_3_7-1.1.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-shaded-guava-1.1.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-math3-3.1.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-net-3.6.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-collections-3.2.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jakarta.activation-api-1.2.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jetty-server-9.4.40.v20210413.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jetty-http-9.4.40.v20210413.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jetty-io-9.4.40.v20210413.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jetty-util-9.4.40.v20210413.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jetty-servlet-9.4.40.v20210413.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jetty-security-9.4.40.v20210413.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jetty-util-ajax-9.4.40.v20210413.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jetty-webapp-9.4.40.v20210413.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jetty-xml-9.4.40.v20210413.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jersey-servlet-1.19.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-logging-1.1.3.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/log4j-1.2.17.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-beanutils-1.9.4.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-configuration2-2.1.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-lang3-3.7.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-text-1.4.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/slf4j-log4j12-1.7.30.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/avro-1.7.7.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/paranamer-2.3.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/re2j-1.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/gson-2.2.4.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/curator-client-4.2.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/curator-recipes-4.2.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/htrace-core4-4.1.0-incubating.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/zookeeper-3.5.6.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/zookeeper-jute-3.5.6.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/audience-annotations-0.5.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-compress-1.19.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerb-core-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerby-pkix-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerby-asn1-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerby-util-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jackson-databind-2.10.5.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/stax2-api-4.2.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/woodstox-core-5.3.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/dnsjava-2.1.7.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/snappy-java-1.1.8.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-auth-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/nimbus-jose-jwt-9.8.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jcip-annotations-1.0-1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/json-smart-2.4.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/accessors-smart-2.4.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/asm-8.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/curator-framework-4.2.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerb-simplekdc-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerb-client-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerby-config-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerb-common-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerb-crypto-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerb-util-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/token-provider-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerb-admin-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerb-server-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerb-identity-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/kerby-xdr-1.0.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-annotations-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-yarn-api-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jaxb-api-2.2.11.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jackson-annotations-2.10.5.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-yarn-common-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jersey-core-1.19.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jsr311-api-1.1.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/guice-servlet-4.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/guice-4.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/javax.inject-1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/aopalliance-1.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jersey-guice-1.19.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jackson-core-2.10.5.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jackson-module-jaxb-annotations-2.10.5.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jakarta.xml.bind-api-2.3.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jackson-jaxrs-json-provider-2.10.5.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jackson-jaxrs-base-2.10.5.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-yarn-client-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/websocket-client-9.4.40.v20210413.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jetty-client-9.4.40.v20210413.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/websocket-common-9.4.40.v20210413.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/websocket-api-9.4.40.v20210413.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jline-3.9.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-collections4-4.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/protobuf-java-2.5.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jsr305-3.0.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/fst-2.50.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jersey-client-1.19.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jersey-json-1.19.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jaxb-impl-2.2.3-1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jackson-core-asl-1.9.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jackson-mapper-asl-1.9.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jackson-jaxrs-1.9.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jackson-xc-1.9.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-hdfs-client-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/okhttp-2.7.5.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/okio-1.6.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/slf4j-reload4j-1.7.36.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/reload4j-1.2.19.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/async-http-client-2.12.3.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/async-http-client-netty-utils-2.12.3.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/reactive-streams-1.0.3.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-reactive-streams-2.0.4.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/jakarta.activation-1.2.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-all-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-buffer-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-codec-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-codec-dns-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-codec-haproxy-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-codec-http-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-codec-http2-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-codec-memcache-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-codec-mqtt-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-codec-redis-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-codec-smtp-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-codec-socks-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-codec-stomp-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-codec-xml-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-common-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-handler-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-tcnative-classes-2.0.46.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-handler-proxy-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-resolver-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-resolver-dns-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-transport-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-transport-rxtx-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-transport-sctp-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-transport-udt-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-transport-classes-epoll-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-transport-native-unix-common-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-transport-classes-kqueue-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-resolver-dns-classes-macos-4.1.72.Final.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-transport-native-epoll-4.1.72.Final-linux-x86_64.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-transport-native-epoll-4.1.72.Final-linux-aarch_64.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-transport-native-kqueue-4.1.72.Final-osx-x86_64.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-transport-native-kqueue-4.1.72.Final-osx-aarch_64.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-resolver-dns-native-macos-4.1.72.Final-osx-x86_64.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/netty-resolver-dns-native-macos-4.1.72.Final-osx-aarch_64.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-yarn-server-web-proxy-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-yarn-server-common-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-registry-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-daemon-1.0.13.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/leveldbjni-all-1.8.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/ehcache-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/HikariCP-java7-2.4.12.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/mssql-jdbc-6.2.1.jre7.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/bcpkix-jdk15on-1.60.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/RoaringBitmap-0.7.45.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/shims-0.7.45.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-codec-1.11.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/commons-cli-1.2.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/javax.servlet-api-3.1.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-mapreduce-client-core-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-mapreduce-client-common-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-yarn-server-timeline-pluginstorage-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/hadoop-yarn-server-applicationhistoryservice-3.3.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/objenesis-2.5.1.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/java-util-1.9.0.jar:/tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tezlib/lib/json-io-2.5.1.jar:
java.io.tmpdir: /tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001/tmp
user.dir: /tmp/hadoop-hadoop/nm-local-dir/usercache/hadoop/appcache/application_1691002829482_0026/container_1691002829482_0026_01_000001
user.name: hadoop
************************************************************/
2023-08-04 09:48:29,717 [INFO] [main] |counters.Limits|: Counter limits initialized with parameters:  GROUP_NAME_MAX=256, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200
2023-08-04 09:48:29,717 [INFO] [main] |counters.Limits|: Counter limits initialized with parameters:  GROUP_NAME_MAX=256, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=120
2023-08-04 09:48:29,751 [INFO] [main] |shim.HadoopShimsLoader|: Trying to locate HadoopShimProvider for hadoopVersion=3.3.1, majorVersion=3, minorVersion=3
2023-08-04 09:48:29,754 [INFO] [main] |shim.HadoopShimsLoader|: Picked HadoopShim org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null, overrideProviderViaConfig=null, hadoopVersion=3.3.1, majorVersion=3, minorVersion=3
2023-08-04 09:48:30,056 [INFO] [main] |app.DAGAppMaster|: AM Level configured TaskSchedulers: [0:TezYarn:null],[1:TezUber:null]
2023-08-04 09:48:30,056 [INFO] [main] |app.DAGAppMaster|: AM Level configured ContainerLaunchers: [0:TezYarn:null],[1:TezUber:null]
2023-08-04 09:48:30,056 [INFO] [main] |app.DAGAppMaster|: AM Level configured TaskCommunicators: [0:TezYarn:null],[1:TezUber:null]
2023-08-04 09:48:30,056 [INFO] [main] |app.DAGAppMaster|: Comparing client version with AM version, clientVersion=0.10.2, AMVersion=0.10.2
2023-08-04 09:48:31,885 [INFO] [main] |service.AbstractService|: Service org.apache.tez.dag.app.DAGAppMaster failed in state INITED
java.lang.ClassCastException: org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$GetFileInfoRequestProto cannot be cast to com.google.protobuf.Message
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:233)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:123)
	at com.sun.proxy.$Proxy12.getFileInfo(Unknown Source)
	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:965)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422)
	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165)
	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157)
	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359)
	at com.sun.proxy.$Proxy13.getFileInfo(Unknown Source)
	at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1731)
	at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1752)
	at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1749)
	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
	at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1764)
	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1760)
	at org.apache.tez.common.TezCommonUtils.getTezBaseStagingPath(TezCommonUtils.java:88)
	at org.apache.tez.common.TezCommonUtils.getTezSystemStagingPath(TezCommonUtils.java:146)
	at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:484)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
	at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2600)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878)
	at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2597)
	at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2384)
2023-08-04 09:48:31,893 [WARN] [main] |service.AbstractService|: When stopping the service org.apache.tez.dag.app.DAGAppMaster
java.lang.NullPointerException
	at org.apache.tez.dag.app.DAGAppMaster.initiateStop(DAGAppMaster.java:2111)
	at org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2126)
	at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
	at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
	at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
	at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2600)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878)
	at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2597)
	at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2384)
2023-08-04 09:48:31,893 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster
java.lang.ClassCastException: org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$GetFileInfoRequestProto cannot be cast to com.google.protobuf.Message
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:233)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:123)
	at com.sun.proxy.$Proxy12.getFileInfo(Unknown Source)
	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:965)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422)
	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165)
	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157)
	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359)
	at com.sun.proxy.$Proxy13.getFileInfo(Unknown Source)
	at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1731)
	at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1752)
	at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1749)
	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
	at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1764)
	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1760)
	at org.apache.tez.common.TezCommonUtils.getTezBaseStagingPath(TezCommonUtils.java:88)
	at org.apache.tez.common.TezCommonUtils.getTezSystemStagingPath(TezCommonUtils.java:146)
	at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:484)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
	at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2600)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878)
	at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2597)
	at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2384)
2023-08-04 09:48:31,941 [INFO] [shutdown-hook-0] |app.DAGAppMaster|: DAGAppMasterShutdownHook invoked
1,223 Views
0 Kudos
3 REPLIES 3

avatar
author-rank DianaTorres author-rank
Community Manager

Created ‎08-04-2023 12:18 PM

@Kaher Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our Hive experts @Shmoo and @mszurap  who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Regards,

Diana Torres,
Community Moderator

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:
1,218 Views
0 Kudos

avatar
author-rank Kaher
New Contributor

Created on ‎08-07-2023 10:15 AM - edited ‎08-07-2023 11:04 AM

Any updates here plz, MR is working properly with Hive but Tez can assist in creating Hive DB and select from tables but insertion always fails.

here is my tez-site.xml

--------------------------------------------------

<configuration>
<property>
<name>tez.lib.uris</name>
<value>${fs.default.name}/apps/tez/tez-0.10.2/share/tez.tar.gz</value>
</property>

<property>
<name>tez.am.resource.memory.mb</name>
<value>3024</value>
</property>

<property>
<name>tez.am.java.opts</name>
<value>Xmx2024m</value>
</property>


</configuration>

--------------------------------------------------

Update, when i tried to test tez using below command

hadoop jar /opt/tez-0.10.2/tez-examples-0.10.2.jar orderedwordcount /tmp/derby.log /tmp/output

Tez took long time more than 15 minutes without finalizing the task.

keep logging as below

023-08-07 10:25:48,434 INFO impl.YarnClientImpl: Submitted application application_1691427806408_0004
2023-08-07 10:25:48,469 INFO client.TezClient: The url to track the Tez AM: http://198.168.11.141:8088/proxy/application_1691427806408_0004/
2023-08-07 10:26:03,257 INFO client.DAGClientImpl: DAG initialized: CurrentState=Running
2023-08-07 10:26:03,269 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:03,338 INFO client.DAGClientImpl: VertexStatus: VertexName: Tokenizer Progress: 0% TotalTasks: -1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:03,375 INFO client.DAGClientImpl: VertexStatus: VertexName: Summation Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:03,380 INFO client.DAGClientImpl: VertexStatus: VertexName: Sorter Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:08,457 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% TotalTasks: 3 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:08,464 INFO client.DAGClientImpl: VertexStatus: VertexName: Tokenizer Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:08,468 INFO client.DAGClientImpl: VertexStatus: VertexName: Summation Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:08,481 INFO client.DAGClientImpl: VertexStatus: VertexName: Sorter Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:13,567 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% TotalTasks: 3 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:13,584 INFO client.DAGClientImpl: VertexStatus: VertexName: Tokenizer Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:13,588 INFO client.DAGClientImpl: VertexStatus: VertexName: Summation Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:13,591 INFO client.DAGClientImpl: VertexStatus: VertexName: Sorter Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:18,699 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% TotalTasks: 3 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:18,706 INFO client.DAGClientImpl: VertexStatus: VertexName: Tokenizer Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:18,739 INFO client.DAGClientImpl: VertexStatus: VertexName: Summation Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:18,741 INFO client.DAGClientImpl: VertexStatus: VertexName: Sorter Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:23,915 INFO client.DAGClientImpl: DAG: State: RUNNING Progress: 0% TotalTasks: 3 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:23,918 INFO client.DAGClientImpl: VertexStatus: VertexName: Tokenizer Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:23,923 INFO client.DAGClientImpl: VertexStatus: VertexName: Summation Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-08-07 10:26:23,928 INFO client.DAGClientImpl: VertexStatus: VertexName: Sorter Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0 Killed: 0

 

 

1,151 Views
0 Kudos

avatar
author-rank smruti author-rank
Master Collaborator

Created ‎08-22-2023 03:03 AM

@Kaher Could you find out what's the value you have set for "tez.staging-dir"; if it's not set, the default path is /tmp/${user.name}/staging. Do verify if there is any issue with the /tmp filesystem.

Also, there is a dash missing in the following value:

<name>tez.am.java.opts</name>
<value>-Xmx2024m</value>
1,082 Views
0 Kudos
Announcements
What's New @ Cloudera
Updates to the HDFS clusters on AWS environments to add supp...
What's New @ Cloudera
Enhancements to the create-database command
Community Announcements
September 2024 Community Highlights
What's New @ Cloudera
Cloudera Streams Messaging Operator 1.1
What's New @ Cloudera
From Silos to Synergy: Unifying Data Warehousing and AI
View More Announcements