Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Apache atlas- Hive Hook Bridge issue

Highlighted

Apache atlas- Hive Hook Bridge issue

New Contributor

Hi All,

I have done configurations for Atlas Hive hook and using ambari for configuration as following:

atlas.hook.hive.synchronous = true

hive.exec.post.hooks = org.apache.hadoop.hive.ql.hooks.ATSHook,org.apache.atlas.hive.hook.HiveHook

atlas.cluster.name = Clusterone (as per atlas-application.properties)

export HIVE_AUX_JARS_PATH=/usr/hdp/current/atlas-server/hook/hive

atlas.hook.hive.maxThreads = 5

hive.server2.async.exec.threads = 100

default.replication.factor = 1

offsets.topic.replication.factor = 3


After running import-hive.sh script ,lineage is showing in atlas but i want to make it automatic


And when i run this command:

/usr/hdp/2.6.5.1100-53/kafka/bin/kafka-console-consumer.sh --zookeeper dlm01.sic:2181,dlm02.sic:2181,dlm03.sic:2181 --topic ATLAS_HOOK --from-beginning

it shows me:

Using the ConsoleConsumer with old consumer is deprecated and will be removed in a future major release. Consider using the new consumer by passing [bootstrap-server] instead of [zookeeper].

No brokers found in ZK.

same for ATLAS_ENTITIES


And here is my logs "/var/log/atlas/application.log"

[pool-2-thread-10 - 36de2e5f-9f3d-43e1-8f0e-7ca5cdff76aa:] ~ graph rollback due to exception AtlasBaseException:Instance __AtlasUserProfile with unique attribute {name=admin} does not exist (GraphTransactionInterceptor:79)


These are the links for hive hook configuration, according to this we have completed almost all the steps

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.6/bk_command-line-installation/content/config...


https://community.hortonworks.com/articles/142035/how-to-correctly-configuring-apache-hive-hook-for....



Please @Ronak bansal @Vadim Vaks @Sharmadha Sainath @Ryan Cicak @Ayub Khan help me in this as soon as possible.

Don't have an account?
Coming from Hortonworks? Activate your account here