Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Atlas Metadata not being created when objects created in Hive/HDFS

Highlighted

Atlas Metadata not being created when objects created in Hive/HDFS

New Contributor

Atlas is running fine in Ambari and I can successfully import metadata into Atlas from Hive. However apart from this initial load metadata is not kept in sync when new objects are created.

I have checked the Ranger policies for HBase and Kafka are appropriately set. Any advice here would be appreciated.

There are none of the ERROR messages in the Atlas logs I can see regarding authorisation issues to the Kafka topics that I have seen on other threads.

3 REPLIES 3

Re: Atlas Metadata not being created when objects created in Hive/HDFS

Expert Contributor

@David Mason

Is the Atlas Hive Hook enabled ? To capture live Hive metadata events , Hook should be enabled.

To check if Hive hook for Atlas is enabled , go to Hive -> check if Enable Atlas Hook is checked and org.apache.atlas.hive.hook.HiveHook is present in hive.exec.post.hooks

Re: Atlas Metadata not being created when objects created in Hive/HDFS

New Contributor

Hi

Both of these are set appropriately.

Re: Atlas Metadata not being created when objects created in Hive/HDFS

Cloudera Employee

Please check and share logs :

  • Create a Hive DB / Table and
  • Look for any Exception / Error related to AtlasHook or Kafka Notifications in /var/log/hive/hiveserver2.log

Please share the exception to get to root cause.