Support Questions

Find answers, ask questions, and share your expertise

Hive skip trash while doing insert overwrite on an external table

avatar
New Contributor

I am trying to skip the trash while doing insert overwrite on an external table from hive.

 

Tried using :

 

SET hive.warehouse.data.skiptrash=true;

 

ALTER TABLE TABLE_NAME DROP IF EXISTS partition(partition_value) PURGE;

 

Is there any alternative command from HIVE other than a hard delete on HDFS?

5 REPLIES 5

avatar
Champion

the other way around is to use em in  Table properties , i belive it holds true for managed table . 

not sure for external table , please try it let me know if you can . 

 

TBLPROPERTIES ("auto.purge"="true") or ("auto.purge"="false") in release 1.2.0

 

avatar
New Contributor

Yes, this does not work even for managed tables, there is some bug logged.

avatar
Champion

i belive you are pointing this

HIVE-9118

its been fixed .

 hive  1.2.0 

avatar
Explorer

Am I right in reading the 5.13.3 and 5.14.2 tarball components? They both use Hive 1.1.0 and not Hive 1.2.0

 

I have a very similar problem - I want to switch off hive using the trash for certain tables

avatar
Explorer

Is ther any solution for this issue. I am facing same issue. Table is holding very huge data and while doing insert overwrite , files are getting placed in my user directory, /user/anjali/.Trash, causing hive action in oozie to fail after 1.5 hr long run. Please help. The table is external and ev even I changed it to internal table, auto purge = true is not working.