About ggangadharan

ggangadharan · ‎11-13-2024

Cloudera Manager offers configurations and tools to optimize the usage of Tez as an execution engine for big data workloads, particularly when using Hive. The Tez CM-UI in Cloudera Manager allows for fine-tuning of Tez configurations to meet specific workload requirements, including adjusting Tez container sizes, memory settings, and parallelism levels. These Tez configurations can be applied cluster-wide, specifically for Hive. Please verify that the HIVE and Hive_ON_TEZ services are active and functioning properly. Similarly, the Core configuration applies to the entire cluster and provides an interface to change configurations cluster-wide. Ensure that all services are running smoothly. If any particular service appears as red, investigate the individual service logs for further troubleshooting.

DianaTorres · ‎11-13-2024

@alex88 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.

djunifi · ‎11-12-2024

For partitionColumn, can you use Date column and date range for lower and upper bound for spark 2.4.8 ?

amru · ‎11-11-2024

Thanks for the response. I tried using these steps, I am getting the following response when I use command: Error: kafka-topics --bootstrap-server <broker:port> --list --command-config client.properties 24/11/11 08:08:21 INFO authenticator.AbstractLogin: [main]: Successfully logged in. 24/11/11 08:08:21 INFO kerberos.KerberosLogin: [kafka-kerberos-refresh-thread-null]: [Principal=null]: TGT refresh thread started. 24/11/11 08:08:21 INFO kerberos.KerberosLogin: [kafka-kerberos-refresh-thread-null]: [Principal=null]: TGT valid starting at: 2024-11-11T07:56:28.000+0000 24/11/11 08:08:21 INFO kerberos.KerberosLogin: [kafka-kerberos-refresh-thread-null]: [Principal=null]: TGT expires: 2024-11-11T17:56:28.000+0000 24/11/11 08:08:21 INFO kerberos.KerberosLogin: [kafka-kerberos-refresh-thread-null]: [Principal=null]: TGT refresh sleeping until: 2024-11-11T16:22:10.118+0000 24/11/11 08:08:21 WARN admin.AdminClientConfig: [main]: These configurations '[ssl.truststore.password.generator]' were supplied but are not used yet. 24/11/11 08:08:21 INFO utils.AppInfoParser: [main]: Kafka version: 3.4.1.7.1.9.0-387 24/11/11 08:08:21 INFO utils.AppInfoParser: [main]: Kafka commitId: b0573bcfb543760f 24/11/11 08:08:21 INFO utils.AppInfoParser: [main]: Kafka startTimeMs: 1731312501450 24/11/11 08:08:22 INFO utils.AppInfoParser: [kafka-admin-client-thread | adminclient-1]: App info kafka.admin.client for adminclient-1 unregistered 24/11/11 08:08:22 WARN kerberos.KerberosLogin: [kafka-kerberos-refresh-thread-null]: [Principal=null]: TGT renewal thread has been interrupted and will exit. 24/11/11 08:08:22 INFO metrics.Metrics: [kafka-admin-client-thread | adminclient-1]: Metrics scheduler closed 24/11/11 08:08:22 INFO metrics.Metrics: [kafka-admin-client-thread | adminclient-1]: Closing reporter org.apache.kafka.common.metrics.JmxReporter 24/11/11 08:08:22 INFO metrics.Metrics: [kafka-admin-client-thread | adminclient-1]: Metrics reporters closed

rsurti · ‎11-10-2024

Thanks yes it was version mismatch issue upgrading hive - 4.0 and tez 0.10.3 works forme

ggangadharan · ‎10-25-2024

From the below , it does looks like tez session itself not initialized. Validate configuration from set -v , make sure everything fine and try re-running the query. org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1726980746968_0077 failed 1 times (global limit =2; local limit is =1) due to AM Container for appattempt_1726980746968_0077_000001 exited with exitCode: -1000 Failing this attempt.Diagnostics: [2024-10-13 10:30:27.706]Application application_1726980746968_0077 initialization failed (exitCode=255) with output: main : command provided 0 If you can't able to identify the incorrect configuration , raise a support case for the same.

ggangadharan · ‎10-25-2024

Error looks similar to HIVE-27778. Can you try the workaround given in the kb

DianaTorres · ‎10-10-2024

@IanWilloughby If you are still experiencing the issue, can you provide the information @ggandharan has requested? Thanks.

ggangadharan · ‎10-07-2024

We recommend utilizing CDW for Kubernetes on Hive. Based on the description, it seems that you are currently using the apache-hive library. In the upstream (Apache), images have already been pushed to Docker Hub, so you can utilize the same. I have attached the relevant documents for your reference. https://hive.apache.org/development/quickstart/ https://docs.cloudera.com/data-warehouse/cloud/overview/topics/dw-service-architecture.html

kartheekb · ‎09-18-2024

This solution worked for eliminating error , but data is not being fetched from table. empty data frame showing.

Online	Offline
Last Visited	‎10-05-2025 10:59 PM

Member Since	‎09-16-2021 02:45 AM
Last Visited	‎10-05-2025 10:59 PM
Posts	420
Kudos received	54

Cloudera Community

Re: Using Hadoop Iceberg catalog with Hive engine ...

Re: Where can I find the Maven repository for HDP ...

Re: Failed with exception java.io.IOException:org....

Re: Hive on TEZ memory footprint and Impala stats...

Re: Hive little query slow

Re: Core configuration service and tez is not wor...

Re: Unexpected error during the SELECT query execu...

Re: reading data from oracle in parallel

Re: Error while using kafka-topics

Re: Issue with Hive HQL insert query - KryoExcepti...

Re: Getting error during batch execution of record...

Re: Error when do an alter table change column on ...

Re: Hive2 vs Hive3 regexp_replace differences

Re: HIVE -K8S / failure to login: javax.security....

Re: Spark cannot read Hive managed table