during insert overwrite partition Impala rewrites the entire directory and changes the default permissions and mask for the HDFS directory. The group right of the parent directory (table) is RWX and the partition directory is RWX. After the rewrite the permissions changes on the partition directory to R-X.
Is there any way to configure Impala to use:
1. pre-defined permissions (tell Impala to create always rwx rwx --- )
2. or to inherit the PARENT directory permissions?
PS> The same insert in Hive honors the permissions of the parent,and copies the default rights and ACLs.
I don't think (1) is possible but you can set "--insert_inherit_permissions=true" for (2). Can you give that a try?
Thanks for the hint, but I dont think it will work because I am doing insert overwrite partition and not insert into:
But I will try it today, and let you know,
Oh, I didn't know that. May be a bug like Skye mentioned in the other thread. Thanks for looking it up.
You set it via cloudera manager, Impala Daemon Command Line Argument Advanced Configuration Snippet (Safety Valve).
But it will not work if you issue insert overwrite.