Member since
07-25-2018
174
Posts
29
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
5441 | 03-19-2020 03:18 AM | |
3470 | 01-31-2020 01:08 AM | |
1350 | 01-30-2020 05:45 AM | |
2605 | 06-01-2016 12:56 PM | |
3096 | 05-23-2016 08:46 AM |
07-21-2016
12:38 PM
Thank you Vadim, Do you know how to delete tag which are present on Atlas UI using REST API.
... View more
07-26-2016
07:06 PM
@Russell AndersonSorry it took a while to respond, I have not been back to this question ina while. Could you ask the questions in a separate thread so that the answer is easier to find for others? I will do my best to answer.
... View more
06-13-2016
06:47 AM
Hi guys, I was running waterline jobs such as(profile job,tag job,lineage job) but while running that map-reduce code I was getting exceptions "Permission Denied error" on some waterline data directory so I resolved them by using sudo -u waterlinedata hadoop fs -chmod 777 <directory name> and everything is worked fine.
... View more
07-04-2016
03:51 AM
@Russell Anderson Could you ask your question as a new question and in more detail? I want to make sure that the question and answer is easily searchable.
... View more
03-01-2017
06:18 PM
1 Kudo
@ Manoj Dhake : To be able to create ur own DB/tables as a user say user1, you will first need an access policy in Ranger for user1 with create permission atleast. I am guessing you know this part. Then you need to tag your Hive resources through Atlas UI. For that you would need an Atlas Ranger policy which will give appropriate permissions to the user used for tagging . Once your resources are tagged, you can create a tag based policy in Ranger depending on your need. Like, if you want user2 to be restricted from seeing any table, say table2 tagged with PII (Table level tag), you create a tag policy with Tag=PII, Under DENY CONDITIONS, put user=user2, and for Component Permissions, select Hive and the Hive operations the user should not be able to perform on the table. Then add the tag service name in Hive Service by editing Hive service and using field: 'Select Tag Service'. Now when you try to do any operation on table2 as user2, you will be denied access, even if there is an access policy granting all permissions to user2 on table2. OR IF you want user2 access to ONLY tagged resources like table2, table3 tagged with 'user' tag, then make sure there is no access based policy for user2 or any of its groups and create a tag based policy with tag='user', in Allow conditions, put user='user2', and for Component Permissions, select Hive and the Hive operations the user should be able to perform on resources tagged with 'user' tag. Hope this helps. The above 2 examples are typical usages of tag based policies. Pls vote up if you find the answer useful.
... View more
06-17-2016
06:10 PM
@Manoj Dhake The tag is a marker that Ranger tag based policies use. Before tags, you would have to create a policy that specifically mentioned the fields, tables, ect that you wanted to secure. With tags, you create a marker on that field or table or other supported entities that mark those entities as targets for the policy. Atlas stores all of entities in manages as graph entities within a graph data base component called Titan. Titan requires a backend data store so you can choose tools like BerkleyDB, HBase, ect. Titan also needs an indexing engine to support search. You can choose from Solr or Elastic Search. Ranger has plugins that allow it to interact with many HDP components: HDFS Yarn Hive Hbase Storm Kafka Knox Using the Hive plugin, Ranger can intercept a request against a Hive table based on the schema, apply any relevant security policies, and when applicable, cause Hive to throw a security exception. Check out this link for more details: http://hortonworks.com/hadoop-tutorial/manage-security-policy-hive-hbase-knox-ranger/
... View more
09-29-2017
06:30 AM
i don't think that hive does pruning on the table at left side during join, even if you provide the predicate in ON clause. That works in sql but not in hive. i am using hive 1.2. you can check this fact by using "explain <query>" . it is better to have the table pruned using sub query , and then join it with another table. let me know your thoughts.
... View more
06-01-2016
12:56 PM
Hello Guys, The error is has been solved ,I have solved it by adding additional statement in hive script along with above query as statement:- add jar
hdfs://<hostname>:8020//user/oozie/share/lib/lib_20160503082834/hive/json-serde-1.3.8-SNAPSHOT-jar-with-dependencies.jar;
... View more
06-01-2016
01:51 AM
@Manoj Dhake If you use table feed, you have to define partition. For your case where you don't want to specify partition, you can use process with hive engine: https://falcon.apache.org/0.4-incubating/docs/EntitySpecification.html#Hive
... View more
- « Previous
- Next »