Reply
Explorer
Posts: 26
Registered: ‎09-25-2016

Permissions for file generated by insert query

Environment CDH 5.12

When running INSERT query on the table all files are always owned by user impala i.e. 744, all for impala read for everyone else . We have externally running compaction process which needs to read/write/replace this files. Is there a way to change this default behavior to have the file permission different than 744 ? I'd prefer if it's 764 ( group read/write ) so we can add the user to the same group as Impala who run the compaction process

 

I tried change Impala Daemon Environment Advanced Configuration Snippet (Safety Valve) property and added

--insert_inherit_permissions=true

 

The upstream directory was 774 but files created were still 744. So other users can not write/edit those files.

Cloudera Employee
Posts: 219
Registered: ‎03-23-2015

Re: Permissions for file generated by insert query

I have done a quick test, it works for me.

Have you confirmed in Impala daemon log that flag --insert_inherit_permissions is indeed "true"?

Do you have sentry enabled for Impala?
Explorer
Posts: 26
Registered: ‎09-25-2016

Re: Permissions for file generated by insert query

Oh ...I might have missed something. Just wanted to make sure I am not missing anything.

 

1. Add --insert_inherit_permissions=true for impalad safety valve

2. Set partition directory permission to 764 ( or whatever required ? )

3. Insert into partition directory

4. Check file permission ; it should be same as folder ? 764 ?

 

Announcements