Created 11-07-2018 06:12 PM
I need a policy in Ranger or some other component which would delete my data automatically after a set period. How can I do that in Ranger ? I didn't see any examples where I could define a way to delete content from HDFS path automatically.
Created 11-08-2018 08:50 AM
Ranger cannot perform this tasks.
Apache Falcon is the one which can do work (however Falcon is deprecated as of HDP2.6.5 and DLM has these features now):
Ref: https://falcon.apache.org/FalconDocumentation.html#Retention
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_data-movement-and-integration/content/ch...
Hope this helps.
Created 11-09-2018 03:53 PM
Thanks for the answer that helps