Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

How to import/assign metadata to an entities in apache atlas(version 0.5)?

avatar
Super Collaborator

I have installed apache atlas version 0.5 on my cluster.I want to see How atlas does data classification?

Could you please send me step by step process for import/assign metadas to an entity?

1 ACCEPTED SOLUTION

avatar
New Member

@Manoj Dhake - Depending on how Atlas was installed, you may need to configure the Atlas post execution Hive hook (see: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/configu.... Once this is completed, Atlas will receive notifications from hive for all queries & DDL statements executed resulting in entity creations in Atlas which can be subsequently searched and viewed through the UI.

To import all existing Hive databases, tables, views etc., you can execute the hive-bridge which will perform an import of all of the existing data in the catalog ($ATLAS_HOME/bin/import-hive.sh). This is typically a one time operation.

Once the above steps are completed, you will be able to search for entities in Atlas using the Atlas UI.

Atlas 0.5 (included in HDP-2.3/2.4 provides integration with Hive alone. Atlas 0.7, to be released with HDP-2.5, includes integrations with a broader set of services, including Sqoop, Falcon, Storm & improved Hive integration as well as a slew of other features such as HA, Ranger integration, security, UI improvements, Business Taxonomy etc.

View solution in original post

2 REPLIES 2

avatar
New Member

@Manoj Dhake - Depending on how Atlas was installed, you may need to configure the Atlas post execution Hive hook (see: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/configu.... Once this is completed, Atlas will receive notifications from hive for all queries & DDL statements executed resulting in entity creations in Atlas which can be subsequently searched and viewed through the UI.

To import all existing Hive databases, tables, views etc., you can execute the hive-bridge which will perform an import of all of the existing data in the catalog ($ATLAS_HOME/bin/import-hive.sh). This is typically a one time operation.

Once the above steps are completed, you will be able to search for entities in Atlas using the Atlas UI.

Atlas 0.5 (included in HDP-2.3/2.4 provides integration with Hive alone. Atlas 0.7, to be released with HDP-2.5, includes integrations with a broader set of services, including Sqoop, Falcon, Storm & improved Hive integration as well as a slew of other features such as HA, Ranger integration, security, UI improvements, Business Taxonomy etc.

avatar
Super Collaborator

Thank you Erik,