Member since
11-18-2022
5
Posts
0
Kudos Received
0
Solutions
05-04-2023
04:14 AM
Hi Need help regarding adding host in CDH cluster We are using kerberised Cloudera 5.14.0 , we have installed cloudera manager agent, java and other prereuisite on the host and then we are trying to add host through the CM UI ->Add host wizard so it is distributing parcels on host and also host monitor run fine but in next step it is showing deploying krb5.conf and it get failed with massage 'unable to deploy krb5.conf' We have copied krb5.conf file from the other host which currently running in our cluster. Can someone please suggest any configuration changes that i should check or change
... View more
Labels:
- Labels:
-
Kerberos
03-23-2023
03:35 AM
Hello Need your help regarding the hive metastore. we are using cdh 5.14 cluster with hive and other services, we are facing issue with hive metastore. Every week our hive metastore goes in bad health with alert shows "canary status bad". when we checked logs of HMS there is nothing suspected. we have given 78G of mem to the host when we check the host memory on HMS host it shows near about 23G physical memory used but it shows the chaches memory used 53 G Any suggestion on this issue. - If we do HMS HA, Is it possible both the HMS work parallelly if yes how we can achieve this? Thanks Shahezad
... View more
Labels:
- Labels:
-
Apache Hive
11-18-2022
02:33 AM
HI We are using CM 5.14 , every two hours our HMS goes down with the following error "The hive metastore canary failled to create a database" when I checked logs 2022-11-16 02:07:25,150 ERROR org.apache.hadoop.hive.metastore.RetryingHMSHandler: [pool-5-thread-191]: AlreadyExistsException(message:Database newData_graveyard already exists) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_database(HiveMetaStore.java:979) at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:140) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:99) at com.sun.proxy.$Proxy10.create_database(Unknown Source) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_database.getResult(ThriftHiveMetastore.java:9570) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_database.getResult(ThriftHiveMetastore.java:9554) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:752) at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:747) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1917) at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:747) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
... View more
Labels:
- Labels:
-
Cloudera Manager