Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Column entities mysql with Apache Atlas


Column entities mysql with Apache Atlas

Super Collaborator

How could I linage the mysql column with apache atlas when I import the data with Sqoop to Hive?

I can see just the source table from MYSQL.



Re: Column entities mysql with Apache Atlas


@Roberto Sancho

Data lineage is defined as a data life cycle that conveys data origin and where data moves over time. In Apache Hive, if I create a table (TableA) and then insert data (from another table TableB), the data lineage will display TableA as the target and Table B as the source/origin. These two tables are linked together by a process "insert into Table..", allowing a user to understand the data life cycle. In a Hadoop ecosystem, Apache Atlas contains the data lineage for various systems like Apache Hive, Apache Falcon and Apache Sqoop.

Don't have an account?
Coming from Hortonworks? Activate your account here