Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 05-13-2016 03:01 PM
I have installed apache atlas version 0.5 on my cluster.I want to see How atlas does data classification?
Could you please send me step by step process for import/assign metadas to an entity?
Created 05-13-2016 03:16 PM
@Manoj Dhake - Depending on how Atlas was installed, you may need to configure the Atlas post execution Hive hook (see: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/configu.... Once this is completed, Atlas will receive notifications from hive for all queries & DDL statements executed resulting in entity creations in Atlas which can be subsequently searched and viewed through the UI.
To import all existing Hive databases, tables, views etc., you can execute the hive-bridge which will perform an import of all of the existing data in the catalog ($ATLAS_HOME/bin/import-hive.sh). This is typically a one time operation.
Once the above steps are completed, you will be able to search for entities in Atlas using the Atlas UI.
Atlas 0.5 (included in HDP-2.3/2.4 provides integration with Hive alone. Atlas 0.7, to be released with HDP-2.5, includes integrations with a broader set of services, including Sqoop, Falcon, Storm & improved Hive integration as well as a slew of other features such as HA, Ranger integration, security, UI improvements, Business Taxonomy etc.
Created 05-13-2016 03:16 PM
@Manoj Dhake - Depending on how Atlas was installed, you may need to configure the Atlas post execution Hive hook (see: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/configu.... Once this is completed, Atlas will receive notifications from hive for all queries & DDL statements executed resulting in entity creations in Atlas which can be subsequently searched and viewed through the UI.
To import all existing Hive databases, tables, views etc., you can execute the hive-bridge which will perform an import of all of the existing data in the catalog ($ATLAS_HOME/bin/import-hive.sh). This is typically a one time operation.
Once the above steps are completed, you will be able to search for entities in Atlas using the Atlas UI.
Atlas 0.5 (included in HDP-2.3/2.4 provides integration with Hive alone. Atlas 0.7, to be released with HDP-2.5, includes integrations with a broader set of services, including Sqoop, Falcon, Storm & improved Hive integration as well as a slew of other features such as HA, Ranger integration, security, UI improvements, Business Taxonomy etc.
Created 05-14-2016 04:21 AM
Thank you Erik,