Member since
11-11-2019
636
Posts
34
Kudos Received
27
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 967 | 10-09-2025 12:29 AM | |
| 8372 | 02-19-2025 09:43 PM | |
| 2441 | 02-28-2023 09:32 PM | |
| 5076 | 02-27-2023 03:33 AM | |
| 26761 | 12-24-2022 05:56 AM |
07-18-2021
08:37 AM
All the hive related tables are stored under "hive" database in mysql. You can take mysql dump for a database hive and can prevent this from happening in the future. You can use command like: mysqldump -u root -p hive Reference: https://www.sqlshack.com/how-to-backup-and-restore-mysql-databases-using-the-mysqldump-command/
... View more
07-18-2021
08:32 AM
Following is the criteria:
ORC and Managed table
ACID enabled
HDFS directory should be owned by Hive
According to the shouldTableBeExternal method in HiveStrictMigration.java, a table is external if it is a StorageHandler table, or if it is an Avro/Text/Parquet table, or if it is a list bucketed table, or the directory is not owned by Hive.
Following is the codebase that describes the same:
String reason = shouldTableBeExternal(tableObj, ownerName, conf, hms, isPathOwnedByHive); if (reason != null) { LOG.debug("Converting {} to external table. {}", getQualifiedName(tableObj), reason); result = TableMigrationOption.EXTERNAL; } else { result = TableMigrationOption.MANAGED;
Reference: HiveStrictManagedMigration (GitHub)
It should be converted to an EXTERNAL table, in case it does not fit the criteria for the upgrade.
... View more
07-18-2021
08:22 AM
Please provide the below information: 1. What is the version? HDP/CDP/CDH ? 2. provide "scriptpro" 3. What si the error recieved ?
... View more
07-09-2021
05:19 AM
Please follow below instructions: Instructions to add Tez and Hive on Tez: 1. Add Tez service on the cluster. 2. Run sudo -u hdfs hdfs dfs -mkdir /user/tez
sudo -u hdfs hdfs dfs -put /opt/cloudera/parcels/CDH/lib/tez/tez.tar.gz /user/tez 3. Add Hive on Tez service.
... View more
07-09-2021
04:28 AM
hi megh Can you share application logs and beeline trace . Thaanks, Asish
... View more
07-05-2021
10:56 PM
Please provide driver DEBUG To enable logging in the driver please modify the odbc.ini file and under the [Driver] section set LogLevel to 6 and LogPath to point to a writeable directory where you would like to driver to create the log files in. For example: [Driver] LogLevel=6 LogPath=/tmp
... View more
07-05-2021
10:47 PM
By default hive displays in UTC. If you want to use specific timestamp,you can run below command SELECT from_utc_timestamp(cast(from_unixtime(cast(1623943533 AS bigint)) as TIMESTAMP),"Asia/Kolkata") ;
... View more
07-02-2021
05:18 AM
Hi Srinivas, Thanks for the update. Could you please give the kudos,if the solution has worked ? Thanks, Asish
... View more
07-02-2021
04:37 AM
Hi Srini, This looks good. Regards, Asish
... View more
07-02-2021
02:38 AM
You have to whitelist the parameter to be configured in beeline . Please follow https://docs.cloudera.com/cdp/latest/data-migration/topics/ug_hive_property_overview.html
... View more