question Re: Apache Atlas lineage graph creation in Archives of Support Questions (Read Only)

Apache Atlas lineage graph creation

radhwene_elhadj — Mon, 05 Dec 2016 20:54:40 GMT

Hi,

I have the atlas technical user guide which speaks about architecture and APIs. However, i want to know if there are specific tutorials or documents which describe how Apache Atlas generate the JSON for the lineage graph and how the storage into HBase works.

Thanks in advance

Re: Apache Atlas lineage graph creation

gkeys — Mon, 05 Dec 2016 21:21:43 GMT

This resource gives you an overview of atlas architecture (section 1.2) and restful apis (section 6) https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_data-governance/content/ch_hdp_data_governance_overview.html

This gives you tutorials http://hortonworks.com/apache/atlas/#tutorials

[UPDATE DEC 9]

Here is an atlas user's guide that provides good details:

http://atlas.incubator.apache.org/AtlasTechnicalUserGuide.pdf

(Not sure if this is what you are referring to in your question)

Re: Apache Atlas lineage graph creation

radhwene_elhadj — Mon, 05 Dec 2016 21:43:30 GMT

Thanks for your answer but this is not really what i need.

I want to know how really Atlas transform entities into graph model using the graph engine and then how it stores this graph into Hbase using Titan.

Let's take an example, when i create entities, i want to know how atlas transform them into graph model. Also, for data lineage graph, i want to know how it is constructed.

Re: Apache Atlas lineage graph creation

gkeys — Tue, 06 Dec 2016 05:05:59 GMT

This has a bit more of what you are looking for: http://www.slideshare.net/hortonworks/data-governance-atlas-7122015

But to get down to the technical details you seek ... you will have to go to the source code: https://github.com/apache/incubator-atlas

Re: Apache Atlas lineage graph creation

gkeys — Sat, 10 Dec 2016 05:14:38 GMT

[UPDATE DEC 9]

Here is an atlas user's guide that provides good details (it is a work in progress):

http://atlas.incubator.apache.org/AtlasTechnicalUserGuide.pdf