Reply
New Contributor
Posts: 3
Registered: ‎03-30-2017

Hive skip trash while doing insert overwrite on an external table

I am trying to skip the trash while doing insert overwrite on an external table from hive.

 

Tried using :

 

SET hive.warehouse.data.skiptrash=true;

 

ALTER TABLE TABLE_NAME DROP IF EXISTS partition(partition_value) PURGE;

 

Is there any alternative command from HIVE other than a hard delete on HDFS?

Champion
Posts: 220
Registered: ‎05-16-2016

Re: Hive skip trash while doing insert overwrite on an external table

[ Edited ]

the other way around is to use em in  Table properties , i belive it holds true for managed table . 

not sure for external table , please try it let me know if you can . 

 

TBLPROPERTIES ("auto.purge"="true") or ("auto.purge"="false") in release 1.2.0

 

New Contributor
Posts: 3
Registered: ‎03-30-2017

Re: Hive skip trash while doing insert overwrite on an external table

Yes, this does not work even for managed tables, there is some bug logged.

Highlighted
Champion
Posts: 220
Registered: ‎05-16-2016

Re: Hive skip trash while doing insert overwrite on an external table

i belive you are pointing this

HIVE-9118

its been fixed .

 hive  1.2.0 
Announcements
New Solutions