Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Cross component lineage in Apache Atlas

Solved Go to solution
Highlighted

Cross component lineage in Apache Atlas

Super Collaborator

I am using HDP2.5 tech preview Sandbox, created a table in MySQL, and then used Sqoop to transfer the table into Hive. Created one more hive table by using CTAS. Now when I am looking at Atlas Lineage, I can only see hive table operations in the lineage but not MySQL and Sqoop part. Is there something I am missing from the configuration perspective from Atlas, how Atlas manages the metadata from MySQL and Sqoop? Please help

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Cross component lineage in Apache Atlas

Guru

@mrizvi

As you know HDP 2.5 is a tech preview of an HDP version that is approaching release.Thus, the included bits only cover the use cases outlined in the tutorials that come with it.

https://github.com/hortonworks/tutorials/tree/hdp-2.5/tutorials/hortonworks

You can preview this feature using a different Sandbox and tutorial.

http://hortonworks.com/hadoop-tutorial/cross-component-lineage-apache-atlas/

This is an earlier version of Atlas but you can get a feel for how the Cross Component Lineage capability will work in HDP 2.5.

1 REPLY 1

Re: Cross component lineage in Apache Atlas

Guru

@mrizvi

As you know HDP 2.5 is a tech preview of an HDP version that is approaching release.Thus, the included bits only cover the use cases outlined in the tutorials that come with it.

https://github.com/hortonworks/tutorials/tree/hdp-2.5/tutorials/hortonworks

You can preview this feature using a different Sandbox and tutorial.

http://hortonworks.com/hadoop-tutorial/cross-component-lineage-apache-atlas/

This is an earlier version of Atlas but you can get a feel for how the Cross Component Lineage capability will work in HDP 2.5.