Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to import/assign metadata to an entities in apache atlas(version 0.5)?

Solved Go to solution

How to import/assign metadata to an entities in apache atlas(version 0.5)?

Rising Star

I have installed apache atlas version 0.5 on my cluster.I want to see How atlas does data classification?

Could you please send me step by step process for import/assign metadas to an entity?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: How to import/assign metadata to an entities in apache atlas(version 0.5)?

New Contributor

@Manoj Dhake - Depending on how Atlas was installed, you may need to configure the Atlas post execution Hive hook (see: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/configu.... Once this is completed, Atlas will receive notifications from hive for all queries & DDL statements executed resulting in entity creations in Atlas which can be subsequently searched and viewed through the UI.

To import all existing Hive databases, tables, views etc., you can execute the hive-bridge which will perform an import of all of the existing data in the catalog ($ATLAS_HOME/bin/import-hive.sh). This is typically a one time operation.

Once the above steps are completed, you will be able to search for entities in Atlas using the Atlas UI.

Atlas 0.5 (included in HDP-2.3/2.4 provides integration with Hive alone. Atlas 0.7, to be released with HDP-2.5, includes integrations with a broader set of services, including Sqoop, Falcon, Storm & improved Hive integration as well as a slew of other features such as HA, Ranger integration, security, UI improvements, Business Taxonomy etc.

2 REPLIES 2
Highlighted

Re: How to import/assign metadata to an entities in apache atlas(version 0.5)?

New Contributor

@Manoj Dhake - Depending on how Atlas was installed, you may need to configure the Atlas post execution Hive hook (see: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/configu.... Once this is completed, Atlas will receive notifications from hive for all queries & DDL statements executed resulting in entity creations in Atlas which can be subsequently searched and viewed through the UI.

To import all existing Hive databases, tables, views etc., you can execute the hive-bridge which will perform an import of all of the existing data in the catalog ($ATLAS_HOME/bin/import-hive.sh). This is typically a one time operation.

Once the above steps are completed, you will be able to search for entities in Atlas using the Atlas UI.

Atlas 0.5 (included in HDP-2.3/2.4 provides integration with Hive alone. Atlas 0.7, to be released with HDP-2.5, includes integrations with a broader set of services, including Sqoop, Falcon, Storm & improved Hive integration as well as a slew of other features such as HA, Ranger integration, security, UI improvements, Business Taxonomy etc.

Re: How to import/assign metadata to an entities in apache atlas(version 0.5)?

Rising Star

Thank you Erik,