About ggangadharan

ggangadharan · ‎10-22-2025

HWC libraries will be present in the CDH parcels. Reference - ls -lrt /opt/cloudera/parcels/CDH/lib/hwc_for_spark3/ total 24 drwxr-xr-x 2 root root 4096 Jun 21 01:26 conf drwxr-xr-x 6 root root 4096 Jun 21 01:26 SparklyrHWC lrwxrwxrwx 1 root root 42 Jun 21 01:26 pyspark_hwc-spark3.zip -> pyspark_hwc-spark3-1.0.0.7.3.1.400-100.zip -rw-r--r-- 1 root root 6116 Jun 21 01:26 pyspark_hwc-spark3-1.0.0.7.3.1.400-100.zip lrwxrwxrwx 1 root root 64 Jun 21 01:26 hive-warehouse-connector-spark3-assembly.jar -> hive-warehouse-connector-spark3-assembly-1.0.0.7.3.1.400-100.jar lrwxrwxrwx 1 root root 75 Jun 21 01:37 hive-warehouse-connector-spark3-assembly-1.0.0.7.3.1.400-100.jar -> ../../jars/hive-warehouse-connector-spark3-assembly-1.0.0.7.3.1.400-100.jar In 7.3.1 HWC is still supported. Reference - https://docs.cloudera.com/cdp-private-cloud-base/7.3.1/integrating-hive-and-bi/topics/hive_hivewarehouseconnector_for_handling_apache_spark_data.html Still could see HWC related classes under the package com.hortonworks.spark.sql.hive.llap. Reference jar -tvf /opt/cloudera/parcels/CDH/lib/hwc_for_spark3/hive-warehouse-connector-spark3-assembly.jar | grep -i "com.hortonworks.spark.sql.hive.llap" | wc -l 97 jar -tvf /opt/cloudera/parcels/CDH/lib/hwc_for_spark3/hive-warehouse-connector-spark3-assembly.jar | grep -i "com.hortonworks.spark.sql.hive.llap" | head 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/catalog/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/common/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/examples/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/query/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/query/builder/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/streaming/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/streaming/examples/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/util/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/wrapper/

ggangadharan · ‎09-05-2025

use the following command. CREATE EXTERNAL TABLE ice_t (i int, s string) STORED BY ICEBERG;

ggangadharan · ‎08-19-2025

Is the source table a JdbcStorageHandler table? Please provide the DDL of the source table, the query used, and any sample data if possible. This information will help us understand the problem better. Also, validate the set -v command, especially configurations like hive.tez.container.size.

ggangadharan · ‎07-16-2025

HIVE-24552 is back-ported from CDP 7.1.7 and higher versions.

ggangadharan · ‎07-15-2025

https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-common/3.1.1.3.1.5.0-152

ggangadharan · ‎07-15-2025

In Hive , __HIVE_DEFAULT_PARTITION__ is a special value used internally to represent: NULL or EMPTY STRINGS in partition column values . Since it's just a string literal in the metadata , you can access it just like any other string in a query. Example : SELECT * FROM your_table WHERE data_dt = '__HIVE_DEFAULT_PARTITION__'; We cannot do WHERE data_dt IS NULL — because NULLs are replaced with __HIVE_DEFAULT_PARTITION__ before being written If you do WHERE length(data_dt) = 26 — it won’t match anything, because partition columns behave differently.

ggangadharan · ‎07-15-2025

This appears to be a new issue. To help us investigate further, could you please provide the steps to reproduce the problem?

ggangadharan · ‎07-02-2025

Please connect using the Beeline client included with the CDP parcel. Then, check the HiveServer2 (HS2) logs to determine the root cause. Sharing the complete stack trace will also help us identify the issue.

ggangadharan · ‎06-24-2025

Please share the Maven coordinates (groupId and artifactId) for the dependency. On a related note, I recommend we begin a transition from our current HDP dependencies to the latest versions available on the CDP. The HDP dependencies are no longer current, and migrating to CDP will improve our application's stability and supportability.

ggangadharan · ‎06-23-2025

Mostly it will be under hortonworks-repo . Look for particular dependency , for example hadoop-common-repo

Online	Offline
Last Visited	‎12-01-2025 11:05 PM

Member Since	‎09-16-2021 02:45 AM
Last Visited	‎12-01-2025 11:05 PM
Posts	421
Kudos received	55

Cloudera Community

Re: HWC on CDP 7.3.1 with Spark 3.5

Re: Using Hadoop Iceberg catalog with Hive engine ...

Re: Where can I find the Maven repository for HDP ...

Re: Failed with exception java.io.IOException:org....

Re: Hive on TEZ memory footprint and Impala stats...

Re: HWC on CDP 7.3.1 with Spark 3.5

Re: Using Hadoop Iceberg catalog with Hive engine ...

Re: NiFI Failed to update Hive for FlowFile; java....

Re: When will Cloudera on base support Hive 4?

Re: Where can I find the Maven repository for HDP ...

Re: search nothing about '__HIVE_DEFAULT_PARTIT...

Re: Error when deleting data from Iceberg Table v2...

Re: Running queries on Hive

Re: Where can I find the Maven repository for HDP ...

Re: Where can I find the Maven repository for HDP ...