Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to create Table as an Entity and column of that Table is also a entities to create linage?

Solved Go to solution
Highlighted

How to create Table as an Entity and column of that Table is also a entities to create linage?

New Contributor

I am new to Apache atlas and I want to create Table and column level linage. I understood that linage can be created with the entity only using process. For a test purpose I have created custom types and entities under that type.

Now I want to show linage for Table and column relations. For Example. -
Table 1. Employee

Columns : Employee_ID, Employee_Name, Employee_Address

Table 2: Department

Columns: Employee_ID, Department_Name, Department_Code

I want to create Employee Table as an Entity and Columns of Employee Table as an Entities too. but columns will go as an attribute of Employee Table entity so i can create linage between Tables and Columns using Process. Same for the Department table.

Once it is created then I can create linage for Employee---->Process---->Department and also
Employee.Employee_ID----->Process---->Department.Department_Name

Please advice. Is it possible?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to create Table as an Entity and column of that Table is also a entities to create linage?

Expert Contributor
@Priyank Rupera

Please take a look at https://github.com/apache/atlas/blob/master/addons/models/1000-Hadoop/1030-hive_model.json on how Hive is modeled in Atlas and based on that you can model your own type . hive_column is added as an attribute to hive_table type : https://github.com/apache/atlas/blob/master/addons/models/1000-Hadoop/1030-hive_model.json#L254-#L26... where hive_column is a type and entities can be created of hive_column type.

2 REPLIES 2

Re: How to create Table as an Entity and column of that Table is also a entities to create linage?

Expert Contributor
@Priyank Rupera

Please take a look at https://github.com/apache/atlas/blob/master/addons/models/1000-Hadoop/1030-hive_model.json on how Hive is modeled in Atlas and based on that you can model your own type . hive_column is added as an attribute to hive_table type : https://github.com/apache/atlas/blob/master/addons/models/1000-Hadoop/1030-hive_model.json#L254-#L26... where hive_column is a type and entities can be created of hive_column type.

Re: How to create Table as an Entity and column of that Table is also a entities to create linage?

New Contributor

@Sharmadha Sainath

Thanks for the guidance.. it works for me.