Did not find much documentation on atlas Lineage and Impact, according to this ppt Apache Atlas: Governance for your Data, seems Lineage is the source of the process, while impact is the destination of the process, am I understanding the concepts right ? ... View more

Hi, guys: I checked the latest Atlas 0.9, there are HBase types defined already, but there is no HBase bridge and HDFS bridge done yet, since we have developed our own HBase bridge and HDFS bridge, is it possible for us to submit our HBase bridge and HDFS bridge code into the latest Atlas code? Qinglin ... View more

Hi, Guys: I am trying to using atlas to capture a lineage between the hive external table and hive ordinary table so as to make a lineage between the hive table and hbase table. Here is the code I run in hive: create table dddd(key string ,id bigint ,aname string ,bname string ,cname string)STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'WITH SERDEPROPERTIES("hbase.columns.mapping" = ":key,info:id,info:aname,info:bname,info:cname")TBLPROPERTIES("hbase.table.name" = "dddd"); insert into table datalake_demo.dddd select a.id as key, a.id, a.aname ,b.bname,c.cname from datalake_demo.a,datalake_demo.b,datalake_demo.c where d = b.id and b.id = c.id; But the hive hook did not create a lineage between hive ordinary tables a, b and c with the hive external table d, I check the code and found there is no "insert into" option in hive hook to generate lineage So my question is do you guys know how can I generate a lineage between hive external table and ordinary tables? I am using atlas 0.7-incubating Thanks so much for your help~ Qinglin ... View more

Hi guys, I am working on writing a hdfs hook, yet I am not quite understand what does unlink event do, I found on this presentation that the delete log would be captured as a unlink event, but when I run a hadoop fs -rm /h.txt command, the unlink event is not captured? So what kind of hdfs commands would capture this unlink event ? ... View more

Hi Guys, I am writing a hdfs hook works with the apache atlas, but the atlas hdfs_path type requires the name of the hdfs file, I am currently working with the inotify api but cannot find a way to capture the name of the created file, do you guys have any idea about this? ... View more

I noticed atlas has put hdfs-path type in the 0.7 version, what does hdfs-path do in hdfs metadata, and if I want to create a hdfs bridge/hook myself, do I need to create additional types in atlas? ... View more

Hi, guys, I am tryign to write a autotest shell script killing the hmasters in HA mode, do you know how can I get the backup hmaster host address by using the command? I can manully find it in the ambari UI, but can not locate it by using the command ... View more

I am trying to write a zookeeper watcher to monitor hbase column family and hbase column modification. I know Hbase table is saved as a znode under the /table znode, but I did not get much info about how do zookeeper save the metadata of hbase column family and hbase column, so How can I get notified when there is any modification in hbase column family or hbase columns ? ... View more

Hi guys, I 've got another question for Atlas, I finally installed and got Atlas 0.7 run on my server, but when I tried to post new types to Atlas, it got a 401 which is Full authentication is required to access this resource, do you know what should I do to get the admission to access the api? Qinglin ... View more

Hi Guys, I just upgraded my atlas from 0.6 to 0.7, it went all good except after starting the atlas-server. I tried to open the web UI of atlas, the login page shows, yet after logging in, the page keep loading and nothing actually shows, does anyone also met this problem, I checked the log but there is no error or warning reported in the logs/application.log, so I wonder what causes this problem? Qinglin ... View more