Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Permissions for file generated by insert query

Permissions for file generated by insert query

Contributor
Environment CDH 5.12

When running INSERT query on the table all files are always owned by user impala i.e. 744, all for impala read for everyone else . We have externally running compaction process which needs to read/write/replace this files. Is there a way to change this default behavior to have the file permission different than 744 ? I'd prefer if it's 764 ( group read/write ) so we can add the user to the same group as Impala who run the compaction process

 

I tried change Impala Daemon Environment Advanced Configuration Snippet (Safety Valve) property and added

--insert_inherit_permissions=true

 

The upstream directory was 774 but files created were still 744. So other users can not write/edit those files.

2 REPLIES 2

Re: Permissions for file generated by insert query

Guru
I have done a quick test, it works for me.

Have you confirmed in Impala daemon log that flag --insert_inherit_permissions is indeed "true"?

Do you have sentry enabled for Impala?

Re: Permissions for file generated by insert query

Contributor

Oh ...I might have missed something. Just wanted to make sure I am not missing anything.

 

1. Add --insert_inherit_permissions=true for impalad safety valve

2. Set partition directory permission to 764 ( or whatever required ? )

3. Insert into partition directory

4. Check file permission ; it should be same as folder ? 764 ?