Cross component lineage in Apache Atlas

mrizvi — Thu, 28 Jul 2016 04:08:31 GMT

I am using HDP2.5 tech preview Sandbox, created a table in MySQL, and then used Sqoop to transfer the table into Hive. Created one more hive table by using CTAS. Now when I am looking at Atlas Lineage, I can only see hive table operations in the lineage but not MySQL and Sqoop part. Is there something I am missing from the configuration perspective from Atlas, how Atlas manages the metadata from MySQL and Sqoop? Please help

Re: Cross component lineage in Apache Atlas

vvaks — Sat, 30 Jul 2016 08:40:34 GMT

@mrizvi

As you know HDP 2.5 is a tech preview of an HDP version that is approaching release.Thus, the included bits only cover the use cases outlined in the tutorials that come with it.

https://github.com/hortonworks/tutorials/tree/hdp-2.5/tutorials/hortonworks

You can preview this feature using a different Sandbox and tutorial.

http://hortonworks.com/hadoop-tutorial/cross-component-lineage-apache-atlas/

This is an earlier version of Atlas but you can get a feel for how the Cross Component Lineage capability will work in HDP 2.5.

question Re: Cross component lineage in Apache Atlas in Archives of Support Questions (Read Only)

Cross component lineage in Apache Atlas

Re: Cross component lineage in Apache Atlas