Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hive table is not reflecting in atlas automatically.

Highlighted

Hive table is not reflecting in atlas automatically.

New Contributor

when i run the import-hive.sh file manually tables getting sync with atlas and when i debug more i found that when i am creating tables with owner as hive then its reflecting in atlas automatically but when i am creating tables from particular user its not getting sync with atlas so i have to run the import-hive.sh script manually to sync the tables with atlas.

4 REPLIES 4

Re: Hive table is not reflecting in atlas automatically.

New Contributor

I am having the same issue. Did you ever find a solution for this?

Re: Hive table is not reflecting in atlas automatically.

Expert Contributor

@Mustaquim Ulde

You are creating table from HiveCli or HiveServer2 ?

Can you add logs from console and hive.log

Re: Hive table is not reflecting in atlas automatically.

New Contributor

Here is the log. I am facing the same issue too.

[admin@c152-node2 hook-bin]$ ./import-hive.sh

Using Hive configuration directory [/etc/hive/conf]

Log file for import is /usr/hdp/current/atlas-server/logs/import-hive.log

log4j:WARN No such property [maxFileSize] in org.apache.log4j.PatternLayout.

log4j:WARN No such property [maxBackupIndex] in org.apache.log4j.PatternLayout.

log4j:ERROR setFile(null,true) call failed.

java.io.FileNotFoundException: /usr/hdp/current/atlas-server/logs/import-hive.log (Permission denied)

at java.io.FileOutputStream.open0(Native Method)

at java.io.FileOutputStream.open(FileOutputStream.java:270)

at java.io.FileOutputStream.<init>(FileOutputStream.java:213)

at java.io.FileOutputStream.<init>(FileOutputStream.java:133)

at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)

at org.apache.log4j.RollingFileAppender.setFile(RollingFileAppender.java:207)

at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)

at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)

at org.apache.log4j.xml.DOMConfigurator.parseAppender(DOMConfigurator.java:295)

at org.apache.log4j.xml.DOMConfigurator.findAppenderByName(DOMConfigurator.java:176)

at org.apache.log4j.xml.DOMConfigurator.findAppenderByReference(DOMConfigurator.java:191)

at org.apache.log4j.xml.DOMConfigurator.parseChildrenOfLoggerElement(DOMConfigurator.java:523)

at org.apache.log4j.xml.DOMConfigurator.parseCategory(DOMConfigurator.java:436)

at org.apache.log4j.xml.DOMConfigurator.parse(DOMConfigurator.java:1004)

at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:872)

at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:778)

at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:483)

at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)

at org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:64)

at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:281)

at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:301)

at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.<clinit>(HiveMetaStoreBridge.java:77)

Enter username for atlas :- admin

Enter password for atlas :-

Hive Meta Data imported successfully!!!

Re: Hive table is not reflecting in atlas automatically.

New Contributor

Hi I too having same issue. I logged into via Hive beeline and created external Table , but I am unable to see those table in ATLAS. I am not sure is this the way ATLAS behave ?

Don't have an account?
Coming from Hortonworks? Activate your account here