Support Questions
Find answers, ask questions, and share your expertise

Column entities mysql with Apache Atlas

Super Collaborator

How could I linage the mysql column with apache atlas when I import the data with Sqoop to Hive?

I can see just the source table from MYSQL.




@Roberto Sancho

Data lineage is defined as a data life cycle that conveys data origin and where data moves over time. In Apache Hive, if I create a table (TableA) and then insert data (from another table TableB), the data lineage will display TableA as the target and Table B as the source/origin. These two tables are linked together by a process "insert into Table..", allowing a user to understand the data life cycle. In a Hadoop ecosystem, Apache Atlas contains the data lineage for various systems like Apache Hive, Apache Falcon and Apache Sqoop.

; ;