@prashanth ramesh did you add fs.s3a.access.key and fs.s3a.secret.key to custom hive-site also? Noticed a similar post here; https://stackoverflow.com/questions/50710582/write-to-s3-from-hive-fails ... View more

Is the fs.s3a.impl property set up also? Noticed it wasn't mentioned on the docu you linked. Also can we verify that there are no typos inside the jceks file? ... View more

Hi @Junfeng Chen The namenode still has to be able to map the user to the group either locally (/etc/passwd) or from AD/LDAP. Keep in mind ranger is for authorization, not authentication. Did you verify that the OS of your namenode is able to resolve the user and the groups of the user? ... View more

If you log in to the CB Web UI, there should be a button to reset the password at the login. Screenshot of that is visible on this guide just after "8. Log in with the administrator email address and password created in the first step of the Azure wizard." ; https://community.hortonworks.com/articles/122086/get-started-with-cloudbreak-on-the-azure-marketpla.html ... View more

Hi @Junfeng Chen Is your namenode able to resolve the same group/user mapping? Is your test_group01 an internal or external group in ranger? Did you create the group on the OS end and add the user there? Below is an example of the behaviour with an external group, which exists only on my rangerhost; [root@RANGERHOST]# groupadd test_group01 [root@RANGERHOST]# useradd test01 [root@RANGERHOST]# usermod -a -G test_group01 test01 [hdfs@RANGERHOST]$ hdfs dfs -mkdir /testpath [hdfs@RANGERHOST]$ hdfs dfs -chmod 000 /testpath followed by -> add new policy in ranger web UI using ONLY test_group01 this you might expect to work, but I'd see; [test01@RANGERHOST]$ hdfs dfs -ls /testpath ls: Permission denied: user=test01, access=READ_EXECUTE, inode="/testpath":hdfs:hdfs:d--------- After adding the local group and member to the NameNode; [root@NN]# groupadd test_group01 [root@NN]# useradd test01 [root@NN]# usermod -a -G test_group01 test01 It's working now; [test01@RANGERHOST]$ hdfs dfs -put testfile /testpath [test01@RANGERHOST]$ hdfs dfs -ls /testpath Found 1 items -rw-r--r-- 3 test01 hdfs 0 2018-08-15 09:04 /testpath/testfile ... View more

There are a variety of options for memory. I just tried the same for my cluster and using for example fields=metrics/memory/Use._avg[1534235091,1534235391,15] worked well. Further options quoted from the source code; /clusters/{clusterName}/?fields=metrics/memory/Buffer._avg[{fromSeconds},{toSeconds},{stepSeconds}],metrics/memory/Cache._avg[{fromSeconds},{toSeconds},{stepSeconds}],metrics/memory/Share._avg[{fromSeconds},{toSeconds},{stepSeconds}],metrics/memory/Swap._avg[{fromSeconds},{toSeconds},{stepSeconds}], metrics/memory/Total._avg[{fromSeconds},{toSeconds},{stepSeconds}], metrics/memory/Use._avg[{fromSeconds},{toSeconds},{stepSeconds}]', ... View more

If your hive table is in ORC format, you can give this a try; https://orc.apache.org/docs/java-tools.html ... View more