Hi @pragz  Not sure how you usually start HMS, but I would start with something like: ./bin/start-metastore >/var/tmp/hms-stdout.log 2>/var/tmp/hms-stderr.log   or   nohup ./bin/start-metastore >/var/tmp/hms-stdout.log 2>/var/tmp/hms-stderr.log &   to start in the background. With that you should have a separate stdout and and stderr logfile. If a process suddenly exits, usually it is because the OS killed it, so look in dmesg or messages if there is a sign for the oomkiller. Also check your $HIVE_CONF_DIR/hive-log4j.properties is there and verify where the ordinary log4j based HMS logging messages are going.   Hope this helps.  Miklos ... View more

@Choolake, Thank you for your participation in Cloudera Community. I'm happy to see you resolved your issue. Please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.   ... View more

Thank you @mszurap for you response . I tried the suggested work around already and it seems like the issue still persists .  I agree the table has lot of partitions but I am pretty sure the code times out before 5 mins .  I have also tried enforcing the hive-site.xml with the updated timeout which also did not help much.  Only thing which worked was adding spark.catalog.recoverPartitions(table) before issuing the drop partition command .  I am really not sure as why recovering the partitions in the catalog eliminated the metastore warning .  Below is the updated code which is working without any warning : spark.sql.catalog.recoverPartitions(orders) spark.sql("alter table orders drop if exists partition(year=2023)") data.write.mode('Overwrite').parquet(hdfsPath) Any help here in understanding the problem will be much appreciated . ... View more

Hi @JinTong , I assume you refer to links in Cloudera Manager UI. I don't think using IP addresses instead of the hostnames would be possible. For your best interest and future proof operations please set up DNS properly in the cluster. Please see our documentation: https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/installation/topics/cdpdc-configure-network-names.html  Thank you  Miklos ... View more

Glad to hear that. 🙂 The "hive.stats.autogather" should be unrelated to this, it just controls whether Hive should gather statistics at the end of INSERT statements, disabling it just speeds up the insert query somewhat. If you see something weird or not working with that enabled, feel free to open a support case on our Support Portal. See this and all the hive configuration descriptions in the HiveConf.java source code. Cheers,  Miklos ... View more

This sounds a Spring boot specific issue, a quick googling was leading me to  https://stackoverflow.com/questions/42073194/unable-to-detect-database-type please check if the suggestions in that discussion helps. ... View more

@Vinylal Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.   ... View more

I assume you meant NVL function returns 0 or 1 if a null is found, or the specified expression in the argument - when using Hive. With Impala and NVL2 you would still need to have the outer query to "sum" up all the 1 values what we have mapped from the column value (from their real value to 0 or to 1). It would just be a bit nicer, but no real change. ... View more

@KaimingGu Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks ... View more

<property> <name>hive.server2.authentication</name> <value>NONE</value> <final>false</final> <source>programmatically</source> <source>org.apache.hadoop.hive.conf.LoopingByteArrayInputStream@3fffff43</source> </property> ... View more