Hi All,
I have done configurations for Atlas Hive hook and using ambari for configuration as following:
atlas.hook.hive.synchronous = true
hive.exec.post.hooks = org.apache.hadoop.hive.ql.hooks.ATSHook,org.apache.atlas.hive.hook.HiveHook
atlas.cluster.name = Clusterone (as per atlas-application.properties)
export HIVE_AUX_JARS_PATH=/usr/hdp/current/atlas-server/hook/hive
atlas.hook.hive.maxThreads = 5
hive.server2.async.exec.threads = 100
default.replication.factor = 1
offsets.topic.replication.factor = 3
After running import-hive.sh script ,lineage is showing in atlas but i want to make it automatic
And when i run this command:
/usr/hdp/2.6.5.1100-53/kafka/bin/kafka-console-consumer.sh --zookeeper dlm01.sic:2181,dlm02.sic:2181,dlm03.sic:2181 --topic ATLAS_HOOK --from-beginning
it shows me:
Using the ConsoleConsumer with old consumer is deprecated and will be removed in a future major release. Consider using the new consumer by passing [bootstrap-server] instead of [zookeeper].
No brokers found in ZK.
same for ATLAS_ENTITIES
And here is my logs "/var/log/atlas/application.log"
[pool-2-thread-10 - 36de2e5f-9f3d-43e1-8f0e-7ca5cdff76aa:] ~ graph rollback due to exception AtlasBaseException:Instance __AtlasUserProfile with unique attribute {name=admin} does not exist (GraphTransactionInterceptor:79)
These are the links for hive hook configuration, according to this we have completed almost all the steps
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.6/bk_command-line-installation/content/config...
https://community.hortonworks.com/articles/142035/how-to-correctly-configuring-apache-hive-hook-for....
Please @Ronak bansal @Vadim Vaks @Sharmadha Sainath @Ryan Cicak @Ayub Khan help me in this as soon as possible.
