Cloudera Community
ggangadharan
user rank
user rank
Master Collaborator

Re: gbk转utf8方案

by Master Collaborator Master Collaborator in Support Questions
‎01-11-2026 10:14 PM
‎01-11-2026 10:14 PM
@zhouweibo  As mentioned previously, please provide the DDL, sample data, and corresponding SQL to reproduce the problem. With this information, we can reproduce the problem locally and  offer an exact working solution.  ... View more

Re: gbk转utf8方案

by Master Collaborator Master Collaborator in Support Questions
‎12-18-2025 02:47 AM
‎12-18-2025 02:47 AM
The error stack trace indicates an issue with the hive encode UDF statement. Please provide the DDL, sample data, and corresponding SQL to reproduce the problem. ... View more

Re: HWC on CDP 7.3.1 with Spark 3.5

by Master Collaborator Master Collaborator in Support Questions
‎10-22-2025 05:48 AM
1 Kudo
‎10-22-2025 05:48 AM
1 Kudo
HWC libraries will be present in the CDH parcels.  Reference -  ls -lrt /opt/cloudera/parcels/CDH/lib/hwc_for_spark3/ total 24 drwxr-xr-x 2 root root 4096 Jun 21 01:26 conf drwxr-xr-x 6 root root 4096 Jun 21 01:26 SparklyrHWC lrwxrwxrwx 1 root root 42 Jun 21 01:26 pyspark_hwc-spark3.zip -> pyspark_hwc-spark3-1.0.0.7.3.1.400-100.zip -rw-r--r-- 1 root root 6116 Jun 21 01:26 pyspark_hwc-spark3-1.0.0.7.3.1.400-100.zip lrwxrwxrwx 1 root root 64 Jun 21 01:26 hive-warehouse-connector-spark3-assembly.jar -> hive-warehouse-connector-spark3-assembly-1.0.0.7.3.1.400-100.jar lrwxrwxrwx 1 root root 75 Jun 21 01:37 hive-warehouse-connector-spark3-assembly-1.0.0.7.3.1.400-100.jar -> ../../jars/hive-warehouse-connector-spark3-assembly-1.0.0.7.3.1.400-100.jar  In 7.3.1 HWC is still supported.  Reference - https://docs.cloudera.com/cdp-private-cloud-base/7.3.1/integrating-hive-and-bi/topics/hive_hivewarehouseconnector_for_handling_apache_spark_data.html Still could see HWC related classes under the package  com.hortonworks.spark.sql.hive.llap.  Reference  jar -tvf /opt/cloudera/parcels/CDH/lib/hwc_for_spark3/hive-warehouse-connector-spark3-assembly.jar | grep -i "com.hortonworks.spark.sql.hive.llap" | wc -l 97 jar -tvf /opt/cloudera/parcels/CDH/lib/hwc_for_spark3/hive-warehouse-connector-spark3-assembly.jar | grep -i "com.hortonworks.spark.sql.hive.llap" | head 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/catalog/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/common/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/examples/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/query/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/query/builder/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/streaming/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/streaming/examples/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/util/ 0 Fri Jun 20 22:46:34 UTC 2025 com/hortonworks/spark/sql/hive/llap/wrapper/   ... View more

Re: Using Hadoop Iceberg catalog with Hive engine ...

by Master Collaborator Master Collaborator in Support Questions
‎09-05-2025 07:19 AM
‎09-05-2025 07:19 AM
use the following command.  CREATE EXTERNAL TABLE ice_t (i int, s string) STORED BY ICEBERG;   ... View more

Re: NiFI Failed to update Hive for FlowFile; java....

by Master Collaborator Master Collaborator in Support Questions
‎08-19-2025 10:33 PM
‎08-19-2025 10:33 PM
Is the source table a JdbcStorageHandler table? Please provide the DDL of the source table, the query used, and any sample data if possible. This information will help us understand the problem better. Also, validate the set -v command, especially configurations like hive.tez.container.size. ... View more

Re: When will Cloudera on base support Hive 4?

by Master Collaborator Master Collaborator in Support Questions
‎07-16-2025 06:52 AM
‎07-16-2025 06:52 AM
HIVE-24552  is back-ported from CDP 7.1.7 and higher versions.  ... View more

Re: Where can I find the Maven repository for HDP ...

by Master Collaborator Master Collaborator in Support Questions
‎07-15-2025 02:22 AM
‎07-15-2025 02:22 AM
https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-common/3.1.1.3.1.5.0-152 ... View more

Re: search nothing about '__HIVE_DEFAULT_PARTIT...

by Master Collaborator Master Collaborator in Support Questions
‎07-15-2025 12:19 AM
‎07-15-2025 12:19 AM
In Hive , __HIVE_DEFAULT_PARTITION__ is a special value used internally to represent:  NULL or EMPTY STRINGS in partition column values . Since it's just a string literal in the metadata , you can access it just like any other string in a query.  Example :  SELECT * FROM your_table WHERE data_dt = '__HIVE_DEFAULT_PARTITION__'; We cannot do WHERE data_dt IS NULL — because NULLs are replaced with __HIVE_DEFAULT_PARTITION__ before being written If you do WHERE length(data_dt) = 26 — it won’t match anything, because partition columns behave differently.  ... View more

Re: Error when deleting data from Iceberg Table v2...

by Master Collaborator Master Collaborator in Support Questions
‎07-15-2025 12:10 AM
‎07-15-2025 12:10 AM
This appears to be a new issue. To help us investigate further, could you please provide the steps to reproduce the problem? ... View more

Re: Running queries on Hive

by Master Collaborator Master Collaborator in Support Questions
‎07-02-2025 12:48 AM
‎07-02-2025 12:48 AM
Please connect using the Beeline client included with the CDP parcel. Then, check the HiveServer2 (HS2) logs to determine the root cause. Sharing the complete stack trace will also help us identify the issue. ... View more
Contact Me
Online
Offline
Last Visited
‎08-04-2026 11:33 PM
Community Statistics
Member Since ‎09-16-2021 02:45 AM
Last Visited ‎08-04-2026 11:33 PM
Posts 423
Kudos received 55