I hope your day is going well.
Something really weird (at least for me) is happening when I drop a table in Hive.
1.- A table called "Test" is created by a sqoop import job using "--create-hcatalog-table". See the full job below.
Here I just wanna add some points. You can use PURGE option to delete data file as well along with partition metadata but it works only in Internal/ Managed tables
ALTER TABLE table_name DROP [IF EXISTS] PARTITION partition_spec PURGE;
But for External tables have a two-step process to alter table drop partition + removing file
ALTER TABLE table_name DROP [IF EXISTS] PARTITION partition_spec;
hdfs dfs -rm -r <partition file path>
I hope this gives some insights here. cc @aakulov
Our DBA Team re-created the database correctly this time, and we no longer have this issue. We believe that the root cause was that the directory in the HDFS had an uppercase typo.