Did not find much documentation on atlas Lineage and Impact, according to this ppt Apache Atlas: Governance for your Data, seems Lineage is the source of the process, while impact is the destination of the process, am I understanding the concepts right ? ... View more

Hi, guys: I checked the latest Atlas 0.9, there are HBase types defined already, but there is no HBase bridge and HDFS bridge done yet, since we have developed our own HBase bridge and HDFS bridge, is it possible for us to submit our HBase bridge and HDFS bridge code into the latest Atlas code? Qinglin ... View more

Hi, Guys: I am trying to using atlas to capture a lineage between the hive external table and hive ordinary table so as to make a lineage between the hive table and hbase table. Here is the code I run in hive: create table dddd(key string ,id bigint ,aname string ,bname string ,cname string)STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'WITH SERDEPROPERTIES("hbase.columns.mapping" = ":key,info:id,info:aname,info:bname,info:cname")TBLPROPERTIES("hbase.table.name" = "dddd"); insert into table datalake_demo.dddd select a.id as key, a.id, a.aname ,b.bname,c.cname from datalake_demo.a,datalake_demo.b,datalake_demo.c where d = b.id and b.id = c.id; But the hive hook did not create a lineage between hive ordinary tables a, b and c with the hive external table d, I check the code and found there is no "insert into" option in hive hook to generate lineage So my question is do you guys know how can I generate a lineage between hive external table and ordinary tables? I am using atlas 0.7-incubating Thanks so much for your help~ Qinglin ... View more

Hi guys, I am working on writing a hdfs hook, yet I am not quite understand what does unlink event do, I found on this presentation that the delete log would be captured as a unlink event, but when I run a hadoop fs -rm /h.txt command, the unlink event is not captured? So what kind of hdfs commands would capture this unlink event ? ... View more