@Abhishek Reddy Chamakura Could you run these 4 commands on the Ambari server, is there a specific reason that you are installing an old HDP 2.3 version when you have HDP 2.6 # yum erase ambari-server # yum clean all # yum repolist # yum install -y ambari-server Please revert ... View more

@Mudassar Hussain Assuming no Kerberos but you want your user to access the HDP cluster ,usually, the local users are on the edgenode. To apply HDFS ACL the local user should have a home in hdfs Create a local user on edge node here my user toto doesn't belong to any group for demo purposes. # useradd toto Before you can implement HDFS acl's you MUST add the below property in hdfs-site.xml or custom-hdfs-site in the namenode the default value is false, then restart the all the stale configs dfs.namenode.acls.enabled=true As the HDFS user create a directory acldemo in toto user home in HDFS $ hdfs dfs -mkdir /user/toto/acldemo As HDFS user change the ownership $hdfs dfs -chown toto:hdfs /user/toto/acldemo created 3 dummy files and copied then to hdfs $ hdfs dfs -put test2.txt test3.json test.txt /user/toto/acldemo Validate the copy process $ hdfs dfs -ls /user/toto/acldemo -rw-r--r-- 3 hdfs hdfs 0 2017-12-12 13:38 /user/toto/acldemo/test.txt -rw-r--r-- 3 hdfs hdfs 0 2017-12-12 13:38 /user/toto/acldemo/test2.txt -rw-r--r-- 3 hdfs hdfs 0 2017-12-12 13:38 /user/toto/acldemo/test3.json Set ACL on the directory acldemo for different users namely toto,hive,kafka to see all the subcommands type hdfs dfs and hit ENTER user toto has RWX $ hdfs dfs -setfacl -m user:toto:--- /user/toto/acldemo User hive has Read Write $ hdfs dfs -setfacl -m user:hive:rwx /user/toto/acldemo User Kafka has only READ $ hdfs dfs -setfacl -m user:kafka:r-x /user/toto/acldemo To check the current ACL's $ hdfs dfs -getfacl /user/toto/acldemo # file: /user/toto/acldemo # owner: toto # group: hdfs user::rwx user:hive:rwx user:kafka:r-x user:toto:--- group::r-x mask::rwx other::r-x Now to check whether the permissions work For user Kafka he can read but NOT copy any files to [kafka@host]$ hdfs dfs -put kafak.txt /user/toto/acldemo put: Permission denied: user=kafka, access=WRITE, inode="/user/toto/acldemo/kafak.txt._COPYING_":toto:hdfs:drwxrwxr-x [kafka@host ~]$ hdfs dfs -cat /user/toto/acldemo/test.txt If you can read me then you have the correct permisions User toto has no permissions !! [toto@host]$ hdfs dfs -cat /user/toto/acldemo/test.txt cat: Permission denied: user=toto, access=EXECUTE, inode="/user/toto/acldemo/test.txt":toto:hdfs:drwxrwxr-x For user hive exit code 0 "success" because it can read the contents of the text.txt file in hdfs [hive@host]$ hdfs dfs -cat /user/toto/acldemo/test.txt If you can read me then you have the correct permisions To know whether a directory has ACL's notice the + sign on the last bit $ hdfs dfs -ls /user/toto/ Found 1 items drwxrwxr-x+ - hdfs hdfs 0 2017-12-12 14:15 /user/toto/acldemo Hope that helps ... View more

@Mark Nguyen Unfortunately, if you cluster is managed by Ambari you can't independently upgrade the components. It will be a nightmare if you plan to upgrade in future. HDP stack are rigorously tested and certified together as a bundle. Ambari currently only supports upgrading the entire HDP stack together. However, we are planning patch upgrades might be available in 3.0 which will allow a single component upgrade of the stack. Hope that answers your question. ... View more