Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

How to create Table as an Entity and column of that Table is also a entities to create linage?

avatar
New Contributor

I am new to Apache atlas and I want to create Table and column level linage. I understood that linage can be created with the entity only using process. For a test purpose I have created custom types and entities under that type.

Now I want to show linage for Table and column relations. For Example. -
Table 1. Employee

Columns : Employee_ID, Employee_Name, Employee_Address

Table 2: Department

Columns: Employee_ID, Department_Name, Department_Code

I want to create Employee Table as an Entity and Columns of Employee Table as an Entities too. but columns will go as an attribute of Employee Table entity so i can create linage between Tables and Columns using Process. Same for the Department table.

Once it is created then I can create linage for Employee---->Process---->Department and also
Employee.Employee_ID----->Process---->Department.Department_Name

Please advice. Is it possible?

1 ACCEPTED SOLUTION

avatar
Super Collaborator
@Priyank Rupera

Please take a look at https://github.com/apache/atlas/blob/master/addons/models/1000-Hadoop/1030-hive_model.json on how Hive is modeled in Atlas and based on that you can model your own type . hive_column is added as an attribute to hive_table type : https://github.com/apache/atlas/blob/master/addons/models/1000-Hadoop/1030-hive_model.json#L254-#L26... where hive_column is a type and entities can be created of hive_column type.

View solution in original post

2 REPLIES 2

avatar
Super Collaborator
@Priyank Rupera

Please take a look at https://github.com/apache/atlas/blob/master/addons/models/1000-Hadoop/1030-hive_model.json on how Hive is modeled in Atlas and based on that you can model your own type . hive_column is added as an attribute to hive_table type : https://github.com/apache/atlas/blob/master/addons/models/1000-Hadoop/1030-hive_model.json#L254-#L26... where hive_column is a type and entities can be created of hive_column type.

avatar
New Contributor

@Sharmadha Sainath

Thanks for the guidance.. it works for me.