Created on 08-15-2016 02:04 PM - edited 09-16-2022 03:34 AM
In CDH 5.8.0 with spark-sql insert of data there are many .hive-staging directories getting piled up and not getting deleted or removed while the insert of data is completed successfully.
Please let me know the reason for such behaviour and how should i get away with .hive-staging directory, is there any property we need to set ?