Member since
11-21-2017
6
Posts
1
Kudos Received
0
Solutions
11-22-2017
10:53 AM
Another question: When someone adds a new metadata directory for Hive (other than /apps/hive/warehouse), does it have to be added somewhere in the Hive configs in Ambari? How does Hive understand that it can also find tables there? Does it make sense to have something like this in case both directories are used: hive.metastore.warehouse.dir = /apps/hive/warehouse, /projects/
... View more
11-22-2017
10:25 AM
@Aditya Sirna I do not have Ranger policies set for that folder. I am only using POSIX on it. I cannot see anything in the audit logs that shows what changes the permissions back to 700 instead of mine which were 755. it even resets back the owner if I change it from hawpm. The underlying directories /projects/hawpm/* however have 755 permissions set which is the default set from the umask 022 in Ambari. I really find it strange that this parent directory keeps reverting back the permissions. Cheers, Naif
... View more
11-22-2017
09:54 AM
Is it possible to lock the directory /projects/hawpm that nothing can change its permissions until it's unlocked again?
... View more
11-21-2017
01:44 PM
Hi @Jay Kumar SenSharma, Thank you for the quick reply. I have checked the logs as you proposed but unfortunately, I only see the permission changes I have made but not what reverted them. Could it be that there is a certain configuration causing this?
... View more
11-21-2017
01:05 PM
Is there also a way I can check what reverted those changes? I cannot find anything in the name node logs.
... View more
11-21-2017
12:58 PM
1 Kudo
The users of our cluster have requested us to create an HDFS directory for them to store their hive tables under /projects/hawpm in HDFS. So i have given their directory 755 permissions using hdfs dfs -chmod, since they use Tableau with the native Hadoop Hive connection to extract their data. which works. However, after almost an hour the permissions are set back to 700 automatically and any changes of ownership to the directory are also being reverted. I do not have sticky bits enabled on this directory. What could be causing my permissions to get reverted like this? Please note that this directory given does not replace the Hive metadata directory /apps/hive/warehouse which is also being used. drwx------ - hawpm hawpm 0 2017-10-25 09:29 /projects/hawpm
... View more
Labels:
- Labels:
-
Apache Hadoop