Member since
09-16-2021
421
Posts
55
Kudos Received
39
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 189 | 10-22-2025 05:48 AM | |
| 292 | 09-05-2025 07:19 AM | |
| 761 | 07-15-2025 02:22 AM | |
| 1312 | 06-02-2025 06:55 AM | |
| 1603 | 05-22-2025 03:00 AM |
10-22-2025
05:48 AM
1 Kudo
HWC libraries will be present in the CDH parcels. Reference - ls -lrt /opt/cloudera/parcels/CDH/lib/hwc_for_spark3/
total 24
drwxr-xr-x 2 root root 4096 Jun 21 01:26 conf
drwxr-xr-x 6 root root 4096 Jun 21 01:26 SparklyrHWC
lrwxrwxrwx 1 root root 42 Jun 21 01:26 pyspark_hwc-spark3.zip -> pyspark_hwc-spark3-1.0.0.7.3.1.400-100.zip
-rw-r--r-- 1 root root 6116 Jun 21 01:26 pyspark_hwc-spark3-1.0.0.7.3.1.400-100.zip
lrwxrwxrwx 1 root root 64 Jun 21 01:26 hive-warehouse-connector-spark3-assembly.jar -> hive-warehouse-connector-spark3-assembly-1.0.0.7.3.1.400-100.jar
lrwxrwxrwx 1 root root 75 Jun 21 01:37 hive-warehouse-connector-spark3-assembly-1.0.0.7.3.1.400-100.jar -> ../../jars/hive-warehouse-connector-spark3-assembly-1.0.0.7.3.1.400-100.jar In 7.3.1 HWC is still supported. Reference - https://docs.cloudera.com/cdp-private-cloud-base/7.3.1/integrating-hive-and-bi/topics/hive_hivewarehouseconnector_for_handling_apache_spark_data.html Still could see HWC related classes under the package com.hortonworks.spark.sql.hive.llap. Reference jar -tvf /opt/cloudera/parcels/CDH/lib/hwc_for_spark3/hive-warehouse-connector-spark3-assembly.jar | grep -i "com.hortonworks.spark.sql.hive.llap" | wc -l
97
jar -tvf /opt/cloudera/parcels/CDH/lib/hwc_for_spark3/hive-warehouse-connector-spark3-assembly.jar | grep -i "com.hortonworks.spark.sql.hive.llap" | head
0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/
0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/catalog/
0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/common/
0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/examples/
0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/query/
0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/query/builder/
0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/streaming/
0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/streaming/examples/
0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/util/
0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/wrapper/
... View more
09-05-2025
07:19 AM
use the following command. CREATE EXTERNAL TABLE ice_t (i int, s string) STORED BY ICEBERG;
... View more
08-19-2025
10:33 PM
Is the source table a JdbcStorageHandler table? Please provide the DDL of the source table, the query used, and any sample data if possible. This information will help us understand the problem better. Also, validate the set -v command, especially configurations like hive.tez.container.size.
... View more
07-16-2025
06:52 AM
HIVE-24552 is back-ported from CDP 7.1.7 and higher versions.
... View more
07-15-2025
02:22 AM
https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-common/3.1.1.3.1.5.0-152
... View more
07-15-2025
12:19 AM
In Hive , __HIVE_DEFAULT_PARTITION__ is a special value used internally to represent: NULL or EMPTY STRINGS in partition column values . Since it's just a string literal in the metadata , you can access it just like any other string in a query. Example : SELECT * FROM your_table WHERE data_dt = '__HIVE_DEFAULT_PARTITION__'; We cannot do WHERE data_dt IS NULL — because NULLs are replaced with __HIVE_DEFAULT_PARTITION__ before being written If you do WHERE length(data_dt) = 26 — it won’t match anything, because partition columns behave differently.
... View more
07-15-2025
12:10 AM
This appears to be a new issue. To help us investigate further, could you please provide the steps to reproduce the problem?
... View more
07-02-2025
12:48 AM
Please connect using the Beeline client included with the CDP parcel. Then, check the HiveServer2 (HS2) logs to determine the root cause. Sharing the complete stack trace will also help us identify the issue.
... View more
06-24-2025
06:26 AM
Please share the Maven coordinates (groupId and artifactId) for the dependency. On a related note, I recommend we begin a transition from our current HDP dependencies to the latest versions available on the CDP. The HDP dependencies are no longer current, and migrating to CDP will improve our application's stability and supportability.
... View more
06-23-2025
04:11 AM
Mostly it will be under hortonworks-repo . Look for particular dependency , for example hadoop-common-repo
... View more