Member since
10-14-2016
36
Posts
3
Kudos Received
0
Solutions
06-16-2017
06:25 AM
@Graham Martin Thanks for your reply, I thihk I haved already define the Tag Service and add it to the hive policy In the tag service I give user "admin" the permission to select all the tables/columns under the tag "Hive", and in Hive Policy I disable the user "admin" 's permission to select of all tables, so if the tag service works, "admin" should have the permission to visit all tables under the tag "Hive", but currently it is not working. Am I missing something here?
... View more
06-15-2017
01:32 AM
Sure, thanks for the answer, Garelnabi ^^
... View more
06-04-2017
05:26 PM
@Qinglin Xia, There is jira filed for it, can you followup on this JIRA ? https://issues.apache.org/jira/browse/ATLAS-1805 cc: @Ramesh Mani
... View more
05-23-2017
02:59 PM
1 Kudo
@Qinglin Xia What is the version of Atlas and HDP ?? I encountered the same issue on 2.5.0.0 but see this output with 2.5.3 on how to reproduce lineage. Make sure that the Ranger Plugins for Atlas ,hbase,hive,hdfs,kafka have been enable with corresponding Ranger Policies !! see the Additional Requirements for Atlas with Ranger and Kerberos Have a look at the attached document running Atlas in a kerberized the only difference if your environment is not kerberiszed s not to run the kinit:-)
... View more
03-29-2017
06:19 AM
Finally got it, the delete op in hdfs should correspond to the rename event, coz hdfs would move the removed files/dirs to the trash file first
... View more
03-29-2017
02:39 AM
Thanks for your reply, I just realize this is a stupid question lol
... View more
01-10-2017
12:57 PM
1 Kudo
hdfs_path refers to any hdfs location (file,directory,symlink etc.,). Since hdfs_path is already registered in Atlas, you can write a hook in hdfs to capture metadata change events and construct the json as per hdfs_path type definition and POST it to Atlas. Also , you can create your own custom type and register it. Since you are writing own hook libraries for hdfs , your hook library can construct the json to use the existing type system in 0.7 or your custom type you registered.
... View more
12-30-2016
03:26 AM
Thanks, I used this url to get the backup masters http://fsmanager:8080/api/v1/clusters/${cluster_name}/components/HBASE_MASTER?host_components/metrics/hbase/master/IsActiveMaster=false&fields=host_components/HostRoles/host_name
... View more
12-01-2016
08:18 AM
Thanks I think that solves my problem, I used to use the Zookeeper watcher but it can only get the hbase table modification.
... View more
11-24-2016
02:05 PM
good to hear. btw. it is good practice to accept the answer so that is marked as resolved in the overview
... View more