Member since
09-11-2015
269
Posts
281
Kudos Received
55
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1881 | 03-15-2017 07:12 AM | |
972 | 03-14-2017 07:08 PM | |
1158 | 03-14-2017 03:36 PM | |
1022 | 02-28-2017 04:32 PM | |
787 | 02-28-2017 10:02 AM |
03-28-2018
03:57 AM
1 Kudo
Currently there is no Atlas hook for HBase, HDFS, or Kafka. For these components, you must manually create entities in Atlas. You can then associate tags with these entities and control access using Ranger tag-based policies.
On the Atlas web UI Search page, click the create new entity link at the top of the page. On the Create Entity pop-up, select an entity type. Enter the required information for the new entity. Click All to display both required and non-required information. Click Create to create the new entity. The entity is created and returned in search results for the applicable entity type. You can now associate tags with the new entity and control access to the entity with Ranger tag-based policies. The above example illustrates manually creating an entity for HDFS_PATH only. This can be extended to KAFKA and HBASE entities.
... View more
Labels:
07-07-2017
04:44 AM
1 Kudo
@manoj kumar Before installing atlas manually, did you add the remote repositories to your cluster? https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_installing_manually_book/content/config-remote-repositories.html After adding the remote repositories, you can install using the below link https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_installing_manually_book/content/installing_atlas.html Please note the above links are with respect to HDP-2.4.2 release. If you want to build and install Atlas from scratch, please follow below link: http://atlas.incubator.apache.org/InstallationSteps.html
... View more
06-20-2017
08:53 AM
1 Kudo
@subash sharma AFAIK, there is no REST API to fetch untagged assets. You might want to consider writing small piece of code to filter untagged assets around REST API which returns all assets of specific type, in this case hive_column. Hope this helps.
... View more
06-15-2017
02:30 PM
1 Kudo
@Qinglin Xia As @Graham Martin pointed out, please check if you have defined tag service for the Hive/Hbase. Unless tag service is defined, tagsync will not work. Please follow below tutorial, which has detailed steps on the same. https://hortonworks.com/tutorial/tag-based-policies-with-apache-ranger-and-apache-atlas/
... View more
05-31-2017
05:48 AM
1 Kudo
@Dinesh Das As @Eyad Garelnabi pointed out, there is no out-of-box integration with mysql. But you can come up with your mysql model in atlas and create your own entities.
... View more
05-23-2017
10:29 AM
You can delete solr core if no longer want to store indexes.
... View more
05-18-2017
05:37 AM
1 Kudo
Pls. share your atlas-application.properties here.
... View more
05-16-2017
04:35 PM
3 Kudos
@Shafi Ahmad The issue is due to wrong value provided for this "atlas.kafka.zookeeper.connect" property. The exception you are showing in your question is clearly saying that, MalformedURLException: For input string: "2181, localhost:2181,localhost:2181". So, fixing this property value should get your atlas up and running. Let me know if it works.
... View more
04-08-2017
07:43 PM
2 Kudos
@Sebastien WAFFLART
Atlas uses titan as graphDB and titan in-turn uses apache tinkerpop for graph computing framework to query and store graph databases. The issue is coming from tinkerpop configuration where the default buffersize for the query response is configured to 4096. If the response for the query is greater than 4096 bytes then it results in `KryoException` errors that complain of "Buffer too small". This issue can be fixed by configuring the buffer size value to desirable number, which is available in >= tinkerpop-3.0.2-incubating version. You can find more information about this issue at TINKERPOP-817 and documentation here. In HDP-2.5 release, atlas uses tinkerpop version 2.6.0 and hence it manifests.. I have created bug to track and fix this in atlas. (https://issues.apache.org/jira/browse/ATLAS-1725). Thanks for bringing this to our notice.
... View more
04-02-2017
09:37 AM
1 Kudo
@Francisco Pires Sqoop import to hive is supported by Atlas today. Sqoop import to hbase is not supported. Refer here for more details on sqoop bridge: http://atlas.incubator.apache.org/0.7.0-incubating/Bridge-Sqoop.html
... View more