Reply
New Contributor
Posts: 3
Registered: ‎03-30-2017

Hive skip trash while doing insert overwrite on an external table

I am trying to skip the trash while doing insert overwrite on an external table from hive.

 

Tried using :

 

SET hive.warehouse.data.skiptrash=true;

 

ALTER TABLE TABLE_NAME DROP IF EXISTS partition(partition_value) PURGE;

 

Is there any alternative command from HIVE other than a hard delete on HDFS?

Champion
Posts: 714
Registered: ‎05-16-2016

Re: Hive skip trash while doing insert overwrite on an external table

[ Edited ]

the other way around is to use em in  Table properties , i belive it holds true for managed table . 

not sure for external table , please try it let me know if you can . 

 

TBLPROPERTIES ("auto.purge"="true") or ("auto.purge"="false") in release 1.2.0

 

New Contributor
Posts: 3
Registered: ‎03-30-2017

Re: Hive skip trash while doing insert overwrite on an external table

Yes, this does not work even for managed tables, there is some bug logged.

Champion
Posts: 714
Registered: ‎05-16-2016

Re: Hive skip trash while doing insert overwrite on an external table

i belive you are pointing this

HIVE-9118

its been fixed .

 hive  1.2.0 
Explorer
Posts: 8
Registered: ‎02-19-2018

Re: Hive skip trash while doing insert overwrite on an external table

Am I right in reading the 5.13.3 and 5.14.2 tarball components? They both use Hive 1.1.0 and not Hive 1.2.0

 

I have a very similar problem - I want to switch off hive using the trash for certain tables

Announcements