Member since
10-28-2020
578
Posts
46
Kudos Received
40
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
765 | 02-17-2025 06:54 AM | |
4996 | 07-23-2024 11:49 PM | |
868 | 05-28-2024 11:06 AM | |
1423 | 05-05-2024 01:27 PM | |
903 | 05-05-2024 01:09 PM |
07-09-2024
05:45 AM
@ldylag You may find the DDLs under /opt/cloudera/parcels/CDH/lib/hive/scripts/metastore/upgrade/<db type>
... View more
06-28-2024
03:33 AM
1 Kudo
@zhuodongLi It will be difficult to find the cause of the issue from the error message in the screenshot. It will be best if you could create a support case with the YARN app log of application_1719542914905_0002, and HS2 logs covering the job run period.
... View more
06-27-2024
11:23 PM
1 Kudo
@kaif This is non-Cloudera Hive you are testing. But let me share my two cents. You are using 'org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdConfOnlyAuthorizerFactory' as the auth manager. You may want to use the following auth provider that enables you to use GRANT/REVOKE statements. hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAuthorizerFactory ...and use: GRANT ROLE admin TO USER kaif; SET ROLE admin;
... View more
06-27-2024
11:02 PM
@kaif Hive does have information_schema database, that you can access from beeline or Hue. You also have SYS db that fetches different information from the RDBMS that is used to store hive metadata. Here's the DDLs of those tables, and this will also give you some idea on what data they store.
... View more
06-27-2024
10:54 PM
1 Kudo
@ldylag No, it is not expected behavior. We expect the tables to be created in the 'public' schema under 'metastore' database.
... View more
05-31-2024
11:05 PM
1 Kudo
@hadoopranger It seems like a transaction is in failed state. a drop database call probably did not complete successfully. Did we make config changes in postgres while Hive service was running? That could lead to data corruption. I notice the following error: Cannot get Object result for param = 6 for column ""MV_CREATION_METADATA"."TXN_LIST"" : ERROR: current transaction is aborted, commands ignored until end of transaction block
org.datanucleus.exceptions.NucleusDataStoreException: Cannot get Object result for param = 6 for column ""MV_CREATION_METADATA"."TXN_LIST"" : ERROR: current transaction is aborted, commands ignored until end of transaction block You may get the out of the following command and see which transaction is in idle but aborted state. select * from pg_stat_activity; Then try to terminate the transaction or perform a ROLLBACK. Take a backup of the database before making these changes to be on the safer side.
... View more
05-28-2024
11:06 AM
@Marks_08 The encoding is being performed by HBase SerDe, for the binary data. Could you change the col data type to STRING if your data does not really require binary storage?
... View more
05-24-2024
03:02 AM
1 Kudo
@hadoopranger Make sure that [1] Hive namespace "hiveserver2" is correct, [2] You have a valid kerberos ticket in the client machine.
... View more
05-08-2024
06:03 AM
@shofialau great! Now we can download mysql jdbc connector and place in the HMS node under the location /usr/share/java Detailed information can be found here - https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/upgrade-hdp/topics/amb-install-mysql-jdbc.html#pnavId2
... View more
05-07-2024
07:55 AM
@shofialau Let's not get confused with that JDBC driver mentioned in the doc. We can ignore that for now. We have two options relating to the metastore DB situation. Recover the password of the hive metastore DB user. Create a new database and user. I had shared the command to reset the DB user password(Option - 1) , or if you plan to create a new database(option -2), try the following commands: mysql> CREATE DATABASE hmsdb;
mysql> CREATE USER 'hiveuser'@'metastorehost' IDENTIFIED BY 'mypassword';
mysql> REVOKE ALL PRIVILEGES, GRANT OPTION FROM 'hiveuser'@'metastorehost';
mysql> GRANT ALL PRIVILEGES ON hmsdb.* TO 'hiveuser'@'metastorehost';
mysql> FLUSH PRIVILEGES;
mysql> quit; Replace the "metastorehost" with the Hive metastore node hostname.
... View more