@Karthikeyan Arjunan, sqoop hook is the way to import RDBMS data into Atlas. Currently we don't have hooks specific to RDBMS db like Oracle or Teradata ... View more

currently there is no way to disable lineage rendering in UI for any table. ... View more

@Owez Mujawar you should have the following libraries for import-hive.sh to work. Not sure why you have lot of libraries. Did you manually copy atlas lib jars here?/usr/hdp/current/atlas-server/hook/hive/atlas-hive-plugin-impl [root@localhost atlas-hive-plugin-impl]# ls -ltr total 37448 -rw-r--r--. 1 atlas hadoop 4573750 May 11 2018 scala-reflect-2.11.8.jar -rw-r--r--. 1 atlas hadoop 802818 May 11 2018 scalap-2.11.8.jar -rw-r--r--. 1 atlas hadoop 5744974 May 11 2018 scala-library-2.11.8.jar -rw-r--r--. 1 atlas hadoop 15487351 May 11 2018 scala-compiler-2.11.8.jar -rw-r--r--. 1 atlas hadoop 1590487 May 11 2018 kafka-clients-1.0.0.2.6.5.0-292.jar -rw-r--r--. 1 atlas hadoop 7532355 May 11 2018 kafka_2.11-1.0.0.2.6.5.0-292.jar -rw-r--r--. 1 atlas hadoop 67829 May 11 2018 json4s-native_2.11-3.2.11.jar -rw-r--r--. 1 atlas hadoop 589462 May 11 2018 json4s-core_2.11-3.2.11.jar -rw-r--r--. 1 atlas hadoop 82421 May 11 2018 json4s-ast_2.11-3.2.11.jar -rw-r--r--. 1 atlas hadoop 53275 May 11 2018 jersey-multipart-1.19.jar -rw-r--r--. 1 atlas hadoop 70540 May 11 2018 hive-bridge-0.8.0.2.6.5.0-292.jar -rw-r--r--. 1 atlas hadoop 11639 May 11 2018 hdfs-model-0.8.0.2.6.5.0-292.jar -rw-r--r--. 1 atlas hadoop 577458 May 11 2018 hbase-common-1.1.2.2.6.5.0-292.jar -rw-r--r--. 1 atlas hadoop 232482 May 11 2018 gson-2.5.jar -rw-r--r--. 1 atlas hadoop 408746 May 11 2018 atlas-typesystem-0.8.0.2.6.5.0-292.jar -rw-r--r--. 1 atlas hadoop 98221 May 11 2018 atlas-notification-0.8.0.2.6.5.0-292.jar -rw-r--r--. 1 atlas hadoop 222090 May 11 2018 atlas-intg-0.8.0.2.6.5.0-292.jar -rw-r--r--. 1 atlas hadoop 64778 May 11 2018 atlas-common-0.8.0.2.6.5.0-292.jar -rw-r--r--. 1 atlas hadoop 18040 May 11 2018 atlas-client-v2-0.8.0.2.6.5.0-292.jar -rw-r--r--. 1 atlas hadoop 43414 May 11 2018 atlas-client-v1-0.8.0.2.6.5.0-292.jar -rw-r--r--. 1 atlas hadoop 35271 May 11 2018 atlas-client-common-0.8.0.2.6.5.0-292.jar ... View more

@Owez Mujawar So you see the same exception when you try to publish a sample message to ATLAS_ENTITIES topic as atlas user. Some kafka config has been messed up - kafka brokers have been added or removed. Please follow https://community.hortonworks.com/content/supportkb/150063/how-to-add-new-kafka-brokers-to-a-cluster-and-move.html to reassign ATLAS_ENTITIES/ATLAS_HOOK topic with new broker information. ... View more

@Owez Mujawar So you see the same exception when you try to publish a sample message to ATLAS_ENTITIES topic as atlas user. Some kafka config has been messed up - kafka brokers have been added or removed. Please follow https://community.hortonworks.com/content/supportkb/150063/how-to-add-new-kafka-brokers-to-a-cluster-and-move.html to reassign ATLAS_ENTITIES/ATLAS_HOOK topic with new broker information. ... View more

@Owez Mujawar Seems like you are missing jersey related jars in the impl directory again. Can you list all the jars in the impl directory? How was this cluster setup? The environment seems to miss many dependent jars ... View more

Looks like commons-configuration is not found in the classpath. Can you confirm if commons-configuration.jar is present in /usr/hdp/current/atlas-server/hook/hive/atlas-hive-plugin-impl directory. ... View more

@Owez Mujawar You see the NotificationException because Atlas is unable to send a message to kafka topic ATLAS_ENTITIES. Can you check if Kafka service is healthy? Another possible reason is when a new kafka broker was added and assigned leader and atlas doesn't know about it. To isolate this issue, can you try publishing a sample message to ATLAS_ENTITIES topic as atlas user and see if you see any permission issues. ... View more

@Megha U Is it mandatory to run the Ranger plugin on this external hive instance to get the Tagsync working? => No it is not mandatory to run ranger plugin on your external hive as long as you have the service with name = 'atlastest_hive' defined in ranger admin. 1. Can you confirm if you have the service with name defined 'atlastest_hive' in Ranger ? 2. If you have the service 'atlastest_hive' defined already, can you provide us with ranger admin logs to help debug further. ... View more