Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Hive skip trash while doing insert overwrite on an external table

avatar
New Contributor

I am trying to skip the trash while doing insert overwrite on an external table from hive.

 

Tried using :

 

SET hive.warehouse.data.skiptrash=true;

 

ALTER TABLE TABLE_NAME DROP IF EXISTS partition(partition_value) PURGE;

 

Is there any alternative command from HIVE other than a hard delete on HDFS?

5 REPLIES 5

avatar
Champion

the other way around is to use em in  Table properties , i belive it holds true for managed table . 

not sure for external table , please try it let me know if you can . 

 

TBLPROPERTIES ("auto.purge"="true") or ("auto.purge"="false") in release 1.2.0

 

avatar
New Contributor

Yes, this does not work even for managed tables, there is some bug logged.

avatar
Champion

i belive you are pointing this

HIVE-9118

its been fixed .

 hive  1.2.0 

avatar
Explorer

Am I right in reading the 5.13.3 and 5.14.2 tarball components? They both use Hive 1.1.0 and not Hive 1.2.0

 

I have a very similar problem - I want to switch off hive using the trash for certain tables

avatar
Explorer

Is ther any solution for this issue. I am facing same issue. Table is holding very huge data and while doing insert overwrite , files are getting placed in my user directory, /user/anjali/.Trash, causing hive action in oozie to fail after 1.5 hr long run. Please help. The table is external and ev even I changed it to internal table, auto purge = true is not working.