Support Questions
Find answers, ask questions, and share your expertise

How to use the function of data classification of Atlas?

Solved Go to solution

How to use the function of data classification of Atlas?

Explorer

Question 1:

According the official guide:http://atlas.apache.org/, some descriptions were shown as following:

Data Classification

  • Import or define taxonomy business-oriented annotations for data
  • Define, annotate, and automate capture of relationships between data sets and underlying elements including source, target, and derivation processes

I am wondering how to implement the automate capture of relationships between data sets?

In order to define taxonomy annotations for data, we must use add Tag to data, right?

~

Question 2:

How many ways to add Tag to data, except through the Atlas Web UI in the browser ?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to use the function of data classification of Atlas?

Guru

@Ethan Hsieh

The following labs demonstrate some of the built in hooks that Atlas has with components of HDP.

http://hortonworks.com/hadoop-tutorial/tag-based-policies-atlas-ranger/

http://hortonworks.com/hadoop-tutorial/cross-component-lineage-apache-atlas/

Check out this repo for an example of a Nifi Reporting task using the Atlas Java API to capture Nifi provenance in Atlas.

https://community.hortonworks.com/content/repo/39432/nifi-atlas-lineage-reporter.html

You can use the same approach to integrate any tool that give you the ability to integrate Java code or call out to a REST API to integrate with Atlas.

http://atlas.incubator.apache.org/0.6.0-incubating/api/rest.html

Check out this thread for a detailed example of how to use a JSON document description of a tag (trait), to register the tag via the Atlas REST API, Add the tag via the UI (this can be done via the REST API as well), and then use the REST API to see the entity with the tag attached as JSON.

https://community.hortonworks.com/questions/33501/how-to-create-attribute-sets-and-collections-using...

Also this one for an example of how to see entities and hive lineage information via the REST API.

https://community.hortonworks.com/questions/38380/how-can-we-get-hive-lineage-data-using-rest-api-in...

View solution in original post

1 REPLY 1

Re: How to use the function of data classification of Atlas?

Guru

@Ethan Hsieh

The following labs demonstrate some of the built in hooks that Atlas has with components of HDP.

http://hortonworks.com/hadoop-tutorial/tag-based-policies-atlas-ranger/

http://hortonworks.com/hadoop-tutorial/cross-component-lineage-apache-atlas/

Check out this repo for an example of a Nifi Reporting task using the Atlas Java API to capture Nifi provenance in Atlas.

https://community.hortonworks.com/content/repo/39432/nifi-atlas-lineage-reporter.html

You can use the same approach to integrate any tool that give you the ability to integrate Java code or call out to a REST API to integrate with Atlas.

http://atlas.incubator.apache.org/0.6.0-incubating/api/rest.html

Check out this thread for a detailed example of how to use a JSON document description of a tag (trait), to register the tag via the Atlas REST API, Add the tag via the UI (this can be done via the REST API as well), and then use the REST API to see the entity with the tag attached as JSON.

https://community.hortonworks.com/questions/33501/how-to-create-attribute-sets-and-collections-using...

Also this one for an example of how to see entities and hive lineage information via the REST API.

https://community.hortonworks.com/questions/38380/how-can-we-get-hive-lineage-data-using-rest-api-in...

View solution in original post