Created on 05-20-2020 10:33 AM - edited 05-20-2020 10:41 AM
Hello guys!
I hope your day is going well.
Something really weird (at least for me) is happening when I drop a table in Hive.
1.- A table called "Test" is created by a sqoop import job using "--create-hcatalog-table". See the full job below.
Created 05-28-2020 08:46 PM
HI @Heri,
Here I just wanna add some points. You can use PURGE option to delete data file as well along with partition metadata but it works only in Internal/ Managed tables
ALTER TABLE table_name DROP [IF EXISTS] PARTITION partition_spec PURGE;
But for External tables have a two-step process to alter table drop partition + removing file
ALTER TABLE table_name DROP [IF EXISTS] PARTITION partition_spec;
hdfs dfs -rm -r <partition file path>
I hope this gives some insights here. cc @aakulov
Created 06-06-2020 02:28 PM
Finally,
Our DBA Team re-created the database correctly this time, and we no longer have this issue. We believe that the root cause was that the directory in the HDFS had an uppercase typo.
Created 06-06-2020 09:15 PM
Glad to hear that you have finally found the root cause of this issue. Thanks for sharing @Heri