Currently i am working on HIVE tables and facing issue with hive partitions ,we have script to drop partitions if exist based on dynamic values and add the new partitions based on new data comes.
i have uploaded two files with same partitions with different data in gap of 1 hours, both files are processed successfully and logs showing that partitions are adding drooped properly, but while checking the data in table, data was not there.
After some time i have load same files same which i have uploaded last and partitions are properly placed and i could able to see the data in hive.
Please help us here how to resolve this issue ? what might be root cause of this issue, we are facing this issue recursively.
I am not sure what happens here but i just resolved my issue by placing "if else" case if partitions are zero then again it will automatically load the last file again , i know that this is not proper solution but for temporally i enable, i am still working on this with export