Created 06-24-2016 02:15 AM
Question 1:
According the official guide:http://atlas.apache.org/, some descriptions were shown as following:
I am wondering how to implement the automate capture of relationships between data sets?
In order to define taxonomy annotations for data, we must use add Tag to data, right?
~
Question 2:
How many ways to add Tag to data, except through the Atlas Web UI in the browser ?
Created 06-24-2016 08:31 PM
The following labs demonstrate some of the built in hooks that Atlas has with components of HDP.
http://hortonworks.com/hadoop-tutorial/tag-based-policies-atlas-ranger/
http://hortonworks.com/hadoop-tutorial/cross-component-lineage-apache-atlas/
Check out this repo for an example of a Nifi Reporting task using the Atlas Java API to capture Nifi provenance in Atlas.
https://community.hortonworks.com/content/repo/39432/nifi-atlas-lineage-reporter.html
You can use the same approach to integrate any tool that give you the ability to integrate Java code or call out to a REST API to integrate with Atlas.
http://atlas.incubator.apache.org/0.6.0-incubating/api/rest.html
Check out this thread for a detailed example of how to use a JSON document description of a tag (trait), to register the tag via the Atlas REST API, Add the tag via the UI (this can be done via the REST API as well), and then use the REST API to see the entity with the tag attached as JSON.
Also this one for an example of how to see entities and hive lineage information via the REST API.
Created 06-24-2016 08:31 PM
The following labs demonstrate some of the built in hooks that Atlas has with components of HDP.
http://hortonworks.com/hadoop-tutorial/tag-based-policies-atlas-ranger/
http://hortonworks.com/hadoop-tutorial/cross-component-lineage-apache-atlas/
Check out this repo for an example of a Nifi Reporting task using the Atlas Java API to capture Nifi provenance in Atlas.
https://community.hortonworks.com/content/repo/39432/nifi-atlas-lineage-reporter.html
You can use the same approach to integrate any tool that give you the ability to integrate Java code or call out to a REST API to integrate with Atlas.
http://atlas.incubator.apache.org/0.6.0-incubating/api/rest.html
Check out this thread for a detailed example of how to use a JSON document description of a tag (trait), to register the tag via the Atlas REST API, Add the tag via the UI (this can be done via the REST API as well), and then use the REST API to see the entity with the tag attached as JSON.
Also this one for an example of how to see entities and hive lineage information via the REST API.