@BrianChan Does the AD user have permissions to view the Hive table? This privilege need to be set under Hadoop SQL policies in Ranger. If this is already done, you also need to set required atlas policies.  Refer to https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/atlas-securing/topics/atlas-configure-ranger-authorization.html Make sure that the entiity-type is set correctly. ... View more

@mwblee I am not sure if you are using any Cloudera Hive distribution, if you are, consider upgrading to latest CDP version where we have fixed many issues around compactor initiator/worker/cleaner.  e.g. For initiator:  upstream Jiras - HIVE-21917, HIVE-22568, HIVE-22081   For this specific issue, you may check take a look at multiple factors, such as Hive metastore being overloaded, slow/large(certain txn related tables) metastore database. You may enable DEBUG logging in Hive metastore, and this will provide more information on why/where the compactor is stuck. If you are using opensource Hive, upgrade to Hive 4.x; you will have much better experience w.r.t. compaction. ... View more

@keifuku  Broken Pipe means the socket connection to HS2 is getting terminated either from Client or Server end. Do you have any timeout set in Client end, because we do not have any timeout configured in Hiveserver2. Also do check if your HS2 servers are under heavy load. You may get an idea by looking at number of active sessions, and heap utilization. If you are seeing too many connections, or notice JVM pause messages in HS2 logs, consider adding more resources, or adding more HS2 instances(place them behind a load balancer). ... View more

@Shahezad We do not have any way to put HMS behind a Load Balancers. If we have more than one HMS instances, they only work in  Active-Active mode.   Do consider increasing the metastore client timeout for Service Montitor.  Also, see if there is any slowness with RDBMS used as metastore DB.   The memory cached in Host level should not be a problem, They get freed when there is a requirement. Ref https://www.baeldung.com/linux/empty-buffer-cache ... View more

@dmharshit It will not be easy to tell you what could be causing this from this error message alone. Maybe if you could share the query EXPLAIN PLAN as well as HS2 logs, that will give us a better idea. Else, just try the following config change in Hive metastore, and in my experience this should help: CDP > Hive > Configuration > Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml 1# property: hive.metastore.event.listener Value:<leave it blank> Note: do not add anyting in the Value field 2# Property: hive.metastore.transactional.event.listeners Value: < leave it blank> Note: do not add anyting in the Value field ... View more

@grojas How is the response when you ping 127.0.0.1 ? If it is faster, do check what's the order of the HOST resolution in nsswitch.conf file: # grep -i hosts /etc/nsswitch.conf #hosts: db files nisplus nis dns hosts: files dns myhostname  Make sure you have files as the first entry. Also, add an entry in the /etc/hosts file as follows: #cat /etc/hosts 127.0.0.1 localhost ... View more

@ArtG001 Have you enabled SSL/TLS for Hiveserver2 as per the doc you have shared above, else we should see a valid result here? Do confirm.   I tried the openssl command on a non SSL Hive endpoint and I got similar response. ... View more

Could you please share screenshots of the Instance tab from both Hive and Hive on Tez services? Based on our experience, the following action should resolve the issue.   Stop and delete the "HiveServer2" and "WebHCat" instances from Cloudera Manager > Hive > Instances Check that the role "HiveServer2" is present in Cloudera Manager > Hive on Tez > Instances Verify the Configuration page for 'Hive on Tez'; ensure that 'Hive Metastore Connector' is pointed at the Hive service that is running the Hive Metastore Restart the stale services ... View more