Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Hive staging directory not getting cleaned up

avatar
Expert Contributor

In CDH 5.8.0 with spark-sql insert of data there are many .hive-staging directories getting piled up and not getting deleted or removed while the insert of data is completed successfully.

 

Please let me know the reason for such behaviour and how should i get away with .hive-staging directory, is there any property we need to set ?

11 REPLIES 11

avatar

Have the same problem,CDH 5.4.7.After streaming job with HiveContext

avatar
New Contributor

One more post that cloudera dont give a **bleep** for solution.