Reply
New Contributor
Posts: 1
Registered: ‎10-03-2018

Impala truncate doesn't move to HDFS trashcan

[ Edited ]

In documentation on impala truncate command (https://www.cloudera.com/documentation/enterprise/latest/topics/impala_truncate_table.html) it is said that trucate moves files to hdfs trashcan.
My tests shows that truncate deletes files without moving to hdfs trashcan.
I suppose truncate is handled by method "truncateTable" in class "org.apache.impala.service.CatalogOpExecutor", it deletes files without moving to trashcan.

The error is in documentation or i've misconfigured impala?
P.S. Deleting without moving to trashcan is best option, hope documentation would be fixed)

Master
Posts: 377
Registered: ‎07-01-2015

Re: Impala truncate doesn't move to HDFS trashcan

My long term observation is exactly the same, Impala removes the files without moving them into trashcan. Somewhere I read that the move to the trashcan is just a specific feature of shell commands, to prevent accidental delete. Otherwise all the "service" triggered deletes to the NameNode are without this safety net.
Cloudera Employee
Posts: 368
Registered: ‎07-29-2015

Re: Impala truncate doesn't move to HDFS trashcan

I filed a docs JIRA to track this: https://issues.apache.org/jira/browse/IMPALA-7654

 

Thanks for bringing this to our attention.

Announcements