question Re: How to create Table as an Entity and column of that Table is also a entities to create linage? in Support Questions

How to create Table as an Entity and column of that Table is also a entities to create linage?

alerts1991 — Mon, 11 Feb 2019 04:50:14 GMT

I am new to Apache atlas and I want to create Table and column level linage. I understood that linage can be created with the entity only using process. For a test purpose I have created custom types and entities under that type.

Now I want to show linage for Table and column relations. For Example. -
Table 1. Employee

Columns : Employee_ID, Employee_Name, Employee_Address

Table 2: Department

Columns: Employee_ID, Department_Name, Department_Code

I want to create Employee Table as an Entity and Columns of Employee Table as an Entities too. but columns will go as an attribute of Employee Table entity so i can create linage between Tables and Columns using Process. Same for the Department table.

Once it is created then I can create linage for Employee---->Process---->Department and also
Employee.Employee_ID----->Process---->Department.Department_Name

Please advice. Is it possible?

Re: How to create Table as an Entity and column of that Table is also a entities to create linage?

ssainath — Mon, 11 Feb 2019 21:04:00 GMT

@Priyank Rupera

Please take a look at https://github.com/apache/atlas/blob/master/addons/models/1000-Hadoop/1030-hive_model.json on how Hive is modeled in Atlas and based on that you can model your own type . hive_column is added as an attribute to hive_table type : https://github.com/apache/atlas/blob/master/addons/models/1000-Hadoop/1030-hive_model.json#L254-#L266 where hive_column is a type and entities can be created of hive_column type.

Re: How to create Table as an Entity and column of that Table is also a entities to create linage?

alerts1991 — Tue, 12 Feb 2019 00:59:33 GMT

@Sharmadha Sainath

Thanks for the guidance.. it works for me.