Support Questions
Find answers, ask questions, and share your expertise

Hive insert query not showed in Atlas Data Lineage .can anyone help how to bring insert operation into lineage info on Atlas UI

Highlighted

Hive insert query not showed in Atlas Data Lineage .can anyone help how to bring insert operation into lineage info on Atlas UI

Explorer
 
4 REPLIES 4
Highlighted

Re: Hive insert query not showed in Atlas Data Lineage .can anyone help how to bring insert operation into lineage info on Atlas UI

Expert Contributor

@PARIVALLAL R What is the hive query you tried ? Atlas captures only metadata of the table and not the data populated in the tables.

Re: Hive insert query not showed in Atlas Data Lineage .can anyone help how to bring insert operation into lineage info on Atlas UI

Explorer

i created table and inserted few records.for this am not getting any lineage info.

Highlighted

Re: Hive insert query not showed in Atlas Data Lineage .can anyone help how to bring insert operation into lineage info on Atlas UI

Expert Contributor

Atlas captures only Metadata . Metadata of a table is data about the table . Records added in the table are not captured. For example - when a table is created or altered (new columns added / dropped) , it is captured. Not when records are added to table.

Highlighted

Re: Hive insert query not showed in Atlas Data Lineage .can anyone help how to bring insert operation into lineage info on Atlas UI

Contributor

@PARIVALLAL R create table should work meaning it will create metadata in atlas, however it will not generate lineage. Further, operation on this table like alter table or CTAS queries will result in lineage. Atlas also at this point does not capture metadata created by insert operation .Visualization for the insert queries is on the roadmap.