Support Questions
Find answers, ask questions, and share your expertise

Is there a property to enable the purging of the local logs when log aggregation is enabled in Yarn

Is there a property to enable the purging of the local logs when log aggregation is enabled in Yarn

 
2 REPLIES 2

Re: Is there a property to enable the purging of the local logs when log aggregation is enabled in Yarn

Super Mentor

@Raju

  • yarn.log-aggregation.retain-seconds: How long to wait before deleting aggregated-logs, -1 or a negative number disables the deletion of aggregated-logs. One needs to be careful and not set this to a too small a value so as to not burden the distributed file-system.

Re: Is there a property to enable the purging of the local logs when log aggregation is enabled in Yarn

Rising Star

The yarn.nodemanager.delete.debug-delay-sec property controls how soon the NM will delete the local logs after the application finishes.