About Shmoo

Imran_chaush · ‎08-29-2023

create connection between Dbeaver and Hive on a CDP 7.1.8 centos 7 cloudera 7.1.8 i am also facing same issue in cluster Kerberos is enabled

ggangadharan · ‎07-14-2023

If my understanding is correct, the schema is altered for different input files, which implies that the data itself lacks a structured schema. Given the frequent changes in the schema, it is advisable to store the data in a column-oriented system such as HBASE. The Same HBASE data can be accessed through spark using HBase-Spark Connector. Ref - https://docs.cloudera.com/cdp-private-cloud-base/7.1.8/accessing-hbase/topics/hbase-example-using-hbase-spark-connector.html

Shmoo · ‎03-23-2023

Hi @dearvenkat , Sorry I was thinking that you just want to change the value, but if you are using RENAME PARTITION sql command it will depend on which type of table you have If it's EXTERNAL the data in HDFS will remain in the same old directory. If your table is MANAGED it should change the directory name to the new one. Please refer to this article: https://community.cloudera.com/t5/Support-Questions/Partition-rename-in-Hive-HDFS-path/td-p/193283 Apache Hive SQL Reference: https://cwiki.apache.org/confluence/display/hive/languagemanual+ddl#LanguageManualDDL-RenamePartition

RobVi · ‎02-08-2023

Hi @Shmoo , Thank you for the suggestion. This works! The MV can be rebuilt after manually deleting the stale locks. However, the next interesting question would be why do we get the stale lock? If we know why, we could prevent this from happening again, as an access to hive metastore is not something that we want to make available to all users.

DianaTorres · ‎08-22-2022

@Teradata GTS Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.

Online	Offline
Last Visited	‎09-22-2023 03:05 PM

Member Since	‎11-01-2019 12:00 PM
Last Visited	‎09-22-2023 03:05 PM
Posts	133
Kudos received	3

Cloudera Community

Cloudera Community

Re: query on partitioning

Re: Rebuilding Materialized View does not work, sa...

Re: create connection between Dbeaver and Hive on ...

Re: Hive with spark table schema changes sensitivi...

Re: query on partitioning

Re: Rebuilding Materialized View does not work, sa...

Re: TEZ without mapreduce