Member since
12-19-2016
149
Posts
15
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3941 | 04-04-2017 03:01 PM | |
1717 | 01-17-2017 10:44 AM |
01-31-2017
12:24 PM
Need help on user and its access in HDFS. In HDP2.5 , while working on HDFS authorization with Apache Ranger, I found , am unable to change file permission as a root user. Can someone please help what would be the user and its default access credentials. [root@sandbox ~]# hdfs dfs -ls /user
Found 16 items
drwxr-xr-x - admin hdfs 0 2017-01-11 08:28 /user/admin
drwxrwx--- - ambari-qa hdfs 0 2016-10-25 07:47 /user/ambari-qa
drwxr-xr-x - amy_ds hdfs 0 2016-10-25 08:02 /user/amy_ds
drwxr-xr-x - hbase hdfs 0 2016-10-25 07:48 /user/hbase
drwxr-xr-x - hcat hdfs 0 2016-10-25 07:51 /user/hcat
drwxr-xr-x - hive hdfs 0 2017-01-19 13:25 /user/hive
drwxr-xr-x - holger_gov hdfs 0 2016-10-25 08:03 /user/holger_gov
drwxrwxr-x - livy hdfs 0 2016-10-25 07:49 /user/livy
drwxr-xr-x - maria_dev hdfs 0 2017-01-05 14:35 /user/maria_dev
drwxrwxr-x - oozie hdfs 0 2016-10-25 07:52 /user/oozie
drwxr-xr-x - raj_ops hdfs 0 2017-01-11 08:29 /user/raj_ops
drwx------ - root hdfs 0 2017-01-19 10:34 /user/root
drwxrwxr-x - spark hdfs 0 2016-10-25 07:48 /user/spark
drwxr-xr-x - vz_all hdfs 0 2017-01-12 10:58 /user/vz_all
drwxr-xr-x - vz_vdsi hdfs 0 2017-01-19 14:18 /user/vz_vdsi
drwxr-xr-x - zeppelin hdfs 0 2016-10-25 07:50 /user/zeppelin [root@sandbox ~]# hdfs dfs -chmod -R 700 /user/hive
17/01/31 12:11:18 WARN retry.RetryInvocationHandler: Exception while invoking ClientNamenodeProtocolTranslatorPB.setPermission over null. Not retrying because try once and fail.
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied. user=root is not the owner of inode=hive
at org.apache.hadoop.fs.FsShell.main(FsShell.java:350)
chmod: changing permissions of '/user/hive': Permission denied. user=root is not the owner of inode=hive
[root@sandbox ~]# exit am trying to follow instructions mentioned in below URL. http://hortonworks.com/blog/best-practices-in-hdfs-authorization-with-apache-ranger/
... View more
Labels:
01-24-2017
02:54 PM
@Sagar Shimpi while following Best practices in hdfs authorization, am getting root is not the owner for hive inode. can you please help me after changing the uamsk value, what will be my next step in HDP 2.5.
... View more
01-24-2017
02:29 PM
@Terry Stebbens Thanksa lot again for all ur help . In HDP sandbox 2.5 , while testing ranger functionalities, I got I need hive user access.but am not sure what is default hive user credentials. Can yo help me in this please. I am trying to achieve BEST PRACTICES FOR HDFS AUTHORIZATION Having a federated authorization model may create a challenge for security administrators looking to plan a security model for HDFS. After Apache Ranger and Hadoop have been installed, we recommend administrators to implement the following steps:
Change HDFS umask to 077 Identify directory which can be managed by Ranger policies Identify the directories that can be managed by Ranger policies We recommend that permission for application data folders (/apps/hive, /apps/Hbase) as well as any custom data folders be managed through Apache Ranger. The HDFS native permissions for these directories need to be restrictive. This can be done through changing permissions in HDFS using chmod. Example: $ hdfs dfs -chmod -R 000 /apps/hive $ hdfs dfs -chown -R hdfs:hdfs /apps/hive $ hdfs dfs -ls /apps/hive Found 1 items d——— – hdfs hdfs 0 2015-11-30 08:01 /apps/hive/warehouse After changing umask value 077. Its not allow me to do any operation as root user. its looking for hive user. can u guide me please Error: at org.apache.hadoop.fs.shell.Command.run(Command.java:165)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:297)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:350)
chmod: changing permissions of '/apps/hive': Permission denied. user=root is not the owner of inode=hive
http://hortonworks.com/blog/best-practices-in-hdfs-authorization-with-apache-ranger/
... View more
01-20-2017
01:06 PM
@Terry Stebbens Thank you so much for this details explanations. I am using HDP sandbox 2.5 and there LDAP is not setup with Ambari/OS. Am able to sync betn Ranger/Ambari. Is there anything can be done to tweak the configuration of sandbox 2.5 to use LDAP.
... View more
01-20-2017
11:59 AM
1 Kudo
I would like to create an user and put a Ranger policy on it to restricts a HDFS directory and I also would like to test it in " File View" from Amabari. Do I need to create user on both Ambari and ranger with same name/same passwd ? am unable to "su" to the new user ( created via amabari ) in unix cmd prompt. I am using HDP2.5
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Ranger
01-20-2017
10:14 AM
Can someone help me to get complete article on Ranger on HDFS. Would like to implement all possible functionalities of Ranger on my HDFS.
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Ranger
01-17-2017
10:44 AM
@melek Thank you , I got the solutions from the learning ropes of Horton works.
... View more
01-16-2017
08:33 AM
@Ramesh Mani Yes am able to do audit in ranger and am using HDP 2.5
... View more
01-16-2017
08:32 AM
@svenkat Am trying to create a policy in ranger for restricting certain rows of a hive table, I found the policy is working well with hive view. But when am checking the same in hive CLI ( hive command prompt ) , seems the policy is not working I can able to see the restricted data and same scenario for beeline CLI as well.
... View more