Support Questions
Find answers, ask questions, and share your expertise

Hive table is not reflecting in atlas automatically.

when i run the import-hive.sh file manually tables getting sync with atlas and when i debug more i found that when i am creating tables with owner as hive then its reflecting in atlas automatically but when i am creating tables from particular user its not getting sync with atlas so i have to run the import-hive.sh script manually to sync the tables with atlas.

4 REPLIES 4

Re: Hive table is not reflecting in atlas automatically.

I am having the same issue. Did you ever find a solution for this?

Re: Hive table is not reflecting in atlas automatically.

Expert Contributor

@Mustaquim Ulde

You are creating table from HiveCli or HiveServer2 ?

Can you add logs from console and hive.log

Re: Hive table is not reflecting in atlas automatically.

Cloudera Employee

Here is the log. I am facing the same issue too.

[admin@c152-node2 hook-bin]$ ./import-hive.sh

Using Hive configuration directory [/etc/hive/conf]

Log file for import is /usr/hdp/current/atlas-server/logs/import-hive.log

log4j:WARN No such property [maxFileSize] in org.apache.log4j.PatternLayout.

log4j:WARN No such property [maxBackupIndex] in org.apache.log4j.PatternLayout.

log4j:ERROR setFile(null,true) call failed.

java.io.FileNotFoundException: /usr/hdp/current/atlas-server/logs/import-hive.log (Permission denied)

at java.io.FileOutputStream.open0(Native Method)

at java.io.FileOutputStream.open(FileOutputStream.java:270)

at java.io.FileOutputStream.<init>(FileOutputStream.java:213)

at java.io.FileOutputStream.<init>(FileOutputStream.java:133)

at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)

at org.apache.log4j.RollingFileAppender.setFile(RollingFileAppender.java:207)

at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)

at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)

at org.apache.log4j.xml.DOMConfigurator.parseAppender(DOMConfigurator.java:295)

at org.apache.log4j.xml.DOMConfigurator.findAppenderByName(DOMConfigurator.java:176)

at org.apache.log4j.xml.DOMConfigurator.findAppenderByReference(DOMConfigurator.java:191)

at org.apache.log4j.xml.DOMConfigurator.parseChildrenOfLoggerElement(DOMConfigurator.java:523)

at org.apache.log4j.xml.DOMConfigurator.parseCategory(DOMConfigurator.java:436)

at org.apache.log4j.xml.DOMConfigurator.parse(DOMConfigurator.java:1004)

at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:872)

at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:778)

at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:483)

at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)

at org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:64)

at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:281)

at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:301)

at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.<clinit>(HiveMetaStoreBridge.java:77)

Enter username for atlas :- admin

Enter password for atlas :-

Hive Meta Data imported successfully!!!

Re: Hive table is not reflecting in atlas automatically.

New Contributor

Hi I too having same issue. I logged into via Hive beeline and created external Table , but I am unable to see those table in ATLAS. I am not sure is this the way ATLAS behave ?