HiveMetaStore logs not showing logs from custom event listener using HiveMetaStoreEventListener

aakash_nand — Wed, 01 Jul 2020 12:52:40 GMT

I am trying to create a very basic Custom HiveMetastore Event Listener using the following blog. I have successfully created the JAR file and have executed the following steps on beeline but the event listener logs are still not getting displayed in /var/log/hive/hivemetastore.log

Followed Tutorial=> https://towardsdatascience.com/apache-hive-hooks-and-metastore-listeners-a-tale-of-your-metadata-903b751ee99f

Git Repository=> https://github.com/mesmacosta/hive-custom-metastore-listener

Step 1: Added JAR to hdfs

hadoop fs -put custom-metastore-listener.jar /user/data/

Step 2: Added JAR from HDFS to the hive

beeline> add jar hdfs:///user/data/custom-metastore-listener.jar;

Step3: Set event listener

beeline> set hive.metastore.event.listeners=com.medium.hive.metastore.listerner.CustomListener;

Step4: Run create table command and check hivemetastore logs.

beeline> CREATE TABLE test(name string) STORED AS ORC;

But the log does not show anything from a custom event listener. Apart from this, I have also tried adding JAR through hive-site.xml and also tried restarting hive metastore service from ambari but it is still not working. Any help on this would be highly appreciated.
Thank You,
Aakash

Re: HiveMetaStore logs not showing logs from custom event listener using HiveMetaStoreEventListener

aakash_nand — Thu, 02 Jul 2020 03:39:52 GMT

I have found a solution to the above problem. The jar file needs to be placed under /usr/hdp/version-number/hive/auxlib as described in this question
https://community.cloudera.com/t5/Support-Questions/How-add-path-with-aux-jars-for-Hive-client/td-p/213667
After placing jar under auxlib, I changed the hive.metastore.event.listeners property from ambari. There are three values of the same property name under ambari-> hive->configs->advanced
1) Advanced hive-interactive-site
2) Advanced hive-site
3) Advanced hivemetastore-site
changed all of them to com.medium.hive.metastore.listerner.CustomListener;
Restarted all hive services and the problem was solved.
Hope this helps someone.
Regards,
Aakash

question Re: HiveMetaStore logs not showing logs from custom event listener using HiveMetaStoreEventListener in Support Questions

HiveMetaStore logs not showing logs from custom event listener using HiveMetaStoreEventListener

Re: HiveMetaStore logs not showing logs from custom event listener using HiveMetaStoreEventListener