Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

HIVE partitions adding not working as expected..partitions showing empty

avatar
Expert Contributor

Hi Team, i am facing this issue recursively.

Currently i am working on HIVE tables and facing issue with hive partitions ,we have script to drop partitions if exist based on dynamic values and add the new partitions based on new data comes.

i have uploaded two files with same partitions with different data in gap of 1 hours, both files are processed successfully and logs showing that partitions are adding drooped properly, but while checking the data in table, data was not there.

After some time i have load same files same which i have uploaded last and partitions are properly placed and i could able to see the data in hive.

Please help us here how to resolve this issue ? what might be root cause of this issue, we are facing this issue recursively.

10 REPLIES 10

avatar
Expert Contributor

@Naga Yamini Polepeddi

I am not sure what happens here but i just resolved my issue by placing "if else" case if partitions are zero then again it will automatically load the last file again , i know that this is not proper solution but for temporally i enable, i am still working on this with export