Created 06-27-2016 09:25 AM
Is it ok to run purge scripts on WF_JOBS & COORD_JOBS tables that are in oozie Database configured in MySQL?
Will the purge scripts remove the running workflows and coordinators?
Created 06-27-2016 11:07 AM
Oozie has feature to purge older jobs from database. by default it's 30 days. Actions related to long running coordinators do not purged until co-ordinator completes, ( example - if you have coordinator running for 6 months, then all the related workflows will be there in database for 6 months )
Will the purge scripts remove the running workflows and coordinators?
Ans - No it will not.
Below are the respective properties and their default values.
Useful link - http://stackoverflow.com/questions/31946225/oozie-not-cleaning-up-old-jobs-from-oozie-database
oozie.service.PurgeService.older.than | 30 | Completed workflow jobs older than this value, in days, will be purged by the PurgeService. |
oozie.service.PurgeService.coord.older.than | 7 | Completed coordinator jobs older than this value, in days, will be purged by the PurgeService. |
oozie.service.PurgeService.bundle.older.than | 7 | Completed bundle jobs older than this value, in days, will be purged by the PurgeService. |
oozie.service.PurgeService.purge.old.coord.action | false | Whether to purge completed workflows and their corresponding coordinator actions of long running coordinator jobs if the completed workflow jobs are older than the value specified in oozie.service.PurgeService.older.than. |
oozie.service.PurgeService.purge.limit | 100 | Completed Actions purge - limit each purge to this value |
oozie.service.PurgeService.purge.interval | 3600 | Interval at which the purge service will run, in seconds. |
Created 06-27-2016 09:26 AM
Created 06-27-2016 11:07 AM
Oozie has feature to purge older jobs from database. by default it's 30 days. Actions related to long running coordinators do not purged until co-ordinator completes, ( example - if you have coordinator running for 6 months, then all the related workflows will be there in database for 6 months )
Will the purge scripts remove the running workflows and coordinators?
Ans - No it will not.
Below are the respective properties and their default values.
Useful link - http://stackoverflow.com/questions/31946225/oozie-not-cleaning-up-old-jobs-from-oozie-database
oozie.service.PurgeService.older.than | 30 | Completed workflow jobs older than this value, in days, will be purged by the PurgeService. |
oozie.service.PurgeService.coord.older.than | 7 | Completed coordinator jobs older than this value, in days, will be purged by the PurgeService. |
oozie.service.PurgeService.bundle.older.than | 7 | Completed bundle jobs older than this value, in days, will be purged by the PurgeService. |
oozie.service.PurgeService.purge.old.coord.action | false | Whether to purge completed workflows and their corresponding coordinator actions of long running coordinator jobs if the completed workflow jobs are older than the value specified in oozie.service.PurgeService.older.than. |
oozie.service.PurgeService.purge.limit | 100 | Completed Actions purge - limit each purge to this value |
oozie.service.PurgeService.purge.interval | 3600 | Interval at which the purge service will run, in seconds. |