Member since
01-31-2016
96
Posts
92
Kudos Received
20
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2673 | 02-11-2019 01:04 PM | |
3226 | 12-06-2018 01:19 PM | |
1862 | 08-23-2018 06:22 AM | |
1722 | 08-09-2018 11:29 AM | |
2456 | 03-29-2018 04:55 PM |
01-10-2017
12:57 PM
1 Kudo
hdfs_path refers to any hdfs location (file,directory,symlink etc.,). Since hdfs_path is already registered in Atlas, you can write a hook in hdfs to capture metadata change events and construct the json as per hdfs_path type definition and POST it to Atlas. Also , you can create your own custom type and register it. Since you are writing own hook libraries for hdfs , your hook library can construct the json to use the existing type system in 0.7 or your custom type you registered.
... View more
01-10-2017
12:04 PM
1 Kudo
Hi @Jigar Chhadwa , provide createtag.txt as @createtag.txt . In your case,curl command took "createtag.txt" itself as the json instead of the content in the file. Example : curl --user "admin:admin" -H "Content-Type: application/json" -d @createtag.txt -X POST "http://ServerName:Port/api/atlas/types"
... View more
01-06-2017
01:14 PM
1 Kudo
Is there CLI support to read last N messages from Kafka topic or to read message at a particular offset ? The log file generated for the topic has unrecognizable characters .When I tried to tail last message from the file , it listed many messages. Or is it possible to read messages sent to topic in the specified time range ? The only work around I found is to grep UTF-8 characters into a file : cat 00000000000000000000.log | strings -n 8 > kafka_topic.txt
... View more
Labels:
- Labels:
-
Apache Kafka
12-09-2016
11:07 AM
1 Kudo
HBase is the preferred metadata store for Atlas as of now. BerkeleyDB can also be used.
... View more
12-09-2016
10:02 AM
1 Kudo
Atlas captures Hive and falcon metadata once Hive and falcon are configured with Atlas hook. Regarding hive,all entity operations are captured by Atlas (create,drop,alter etc). For falcon, Atlas captures only submit falcon entity as of now. When you delete a falcon entity , the falcon hook doesn't send any notification to Atlas. For more technical details please refer http://atlas.incubator.apache.org/Bridge-Falcon.html
... View more
11-28-2016
05:34 PM
1 Kudo
@Bilal The XML and text files you mentioned would be in ATLAS_HOME/conf/solr folder. You may copy the complete directory to Solr instance and use the directory while creating indices. For example , once you copy the ATLAS_HOME/conf/solr directory to SOLR_HOME/solr , you may do $SOLR_BIN/solr create -c vertex_index -d SOLR_HOME/solr -shards #numShards -replicationFactor #replicationFactor
... View more
11-22-2016
11:17 AM
2 Kudos
Please apply the patch in the JIRA .That should fix it.
... View more
11-22-2016
10:33 AM
1 Kudo
Are you seeing issue similar to the one in the JIRA ? https://issues.apache.org/jira/browse/ATLAS-1199
... View more
11-22-2016
10:26 AM
1 Kudo
Couple of things to try : 1. Can you clear browser cache and reload the page ? Or you can open the same page in Chrome's Incognito mode . Reason is .js files might have got loaded from the previous versions. If the above doesn't work : 2.Can you check the Network tab in developer tools in your browser and check if there are any errors ?
... View more
11-02-2016
12:38 PM
1 Kudo
Once Atlas has ingested data , say hive table, one can use Atlas to specify security policies on it through Ranger. How does Ranger know which entities to apply policies on ? By using "tags" .An entity(hive table for example) can be tagged . This tag appears in Ranger and you can enforce policies on entities tagged with that tag. Please refer http://hortonworks.com/hadoop-tutorial/tag-based-policies-atlas-ranger/
... View more
- « Previous
- Next »