Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

drop partition does not honor HDFS posix

drop partition does not honor HDFS posix

Master Collaborator


 I have an kerberos enabled cluster with sentry, and a test user who has read+write rights on the default database.

I created a table with partitions, and tried to "protect" them by removing hdfs access rights on directory level.


create table ch_tab ( i int, s string ) partitioned by ( p int );

insert into ch_tab partition ( p ) select 1, "test", 1000;

insert into ch_tab partition ( p ) select 2, "test2", 1001;


Now I removed all write access rights from the partiton 1000.

I log in as a hdfs user:

kinit -k -t hdfs.keytab hdfs

hdfs dfs -chmod 550 /user/hive/warehouse/ch_tab/p=1000


Now going back to Impala (logged as a test user) I expected that this query will fail:


alter table ch_tab drop partition ( p =1000 );


But Impala just simply ignored the posix permissions and deleted the partition directory!

Any ideas why? Or other way, how to prevent accidental drop or delete of the table, but keeping it still for read available?