- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Is hdfs metadata type already defined in atlas 0.7?
- Labels:
-
Apache Atlas
-
Apache Hadoop
Created ‎01-09-2017 08:36 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I noticed atlas has put hdfs-path type in the 0.7 version, what does hdfs-path do in hdfs metadata, and if I want to create a hdfs bridge/hook myself, do I need to create additional types in atlas?
Created ‎01-10-2017 12:57 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
hdfs_path refers to any hdfs location (file,directory,symlink etc.,). Since hdfs_path is already registered in Atlas, you can write a hook in hdfs to capture metadata change events and construct the json as per hdfs_path type definition and POST it to Atlas.
Also , you can create your own custom type and register it.
Since you are writing own hook libraries for hdfs , your hook library can construct the json to use the existing type system in 0.7 or your custom type you registered.
Created ‎01-10-2017 12:57 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
hdfs_path refers to any hdfs location (file,directory,symlink etc.,). Since hdfs_path is already registered in Atlas, you can write a hook in hdfs to capture metadata change events and construct the json as per hdfs_path type definition and POST it to Atlas.
Also , you can create your own custom type and register it.
Since you are writing own hook libraries for hdfs , your hook library can construct the json to use the existing type system in 0.7 or your custom type you registered.
