Support Questions

Find answers, ask questions, and share your expertise

Oozie purge script

avatar
Super Guru

Is it ok to run purge scripts on WF_JOBS & COORD_JOBS tables that are in oozie Database configured in MySQL?

Will the purge scripts remove the running workflows and coordinators?

1 ACCEPTED SOLUTION

avatar
Master Guru

@Sagar Shimpi

Oozie has feature to purge older jobs from database. by default it's 30 days. Actions related to long running coordinators do not purged until co-ordinator completes, ( example - if you have coordinator running for 6 months, then all the related workflows will be there in database for 6 months )

Will the purge scripts remove the running workflows and coordinators?

Ans - No it will not.

Below are the respective properties and their default values.

Useful link - http://stackoverflow.com/questions/31946225/oozie-not-cleaning-up-old-jobs-from-oozie-database

oozie.service.PurgeService.older.than30Completed workflow jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.coord.older.than7Completed coordinator jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.bundle.older.than7Completed bundle jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.purge.old.coord.actionfalseWhether to purge completed workflows and their corresponding coordinator actions of long running coordinator jobs if the completed workflow jobs are older than the value specified in oozie.service.PurgeService.older.than.
oozie.service.PurgeService.purge.limit100Completed Actions purge - limit each purge to this value

oozie.service.PurgeService.purge.interval

3600Interval at which the purge service will run, in seconds.

View solution in original post

2 REPLIES 2

avatar
Super Guru

avatar
Master Guru

@Sagar Shimpi

Oozie has feature to purge older jobs from database. by default it's 30 days. Actions related to long running coordinators do not purged until co-ordinator completes, ( example - if you have coordinator running for 6 months, then all the related workflows will be there in database for 6 months )

Will the purge scripts remove the running workflows and coordinators?

Ans - No it will not.

Below are the respective properties and their default values.

Useful link - http://stackoverflow.com/questions/31946225/oozie-not-cleaning-up-old-jobs-from-oozie-database

oozie.service.PurgeService.older.than30Completed workflow jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.coord.older.than7Completed coordinator jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.bundle.older.than7Completed bundle jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.purge.old.coord.actionfalseWhether to purge completed workflows and their corresponding coordinator actions of long running coordinator jobs if the completed workflow jobs are older than the value specified in oozie.service.PurgeService.older.than.
oozie.service.PurgeService.purge.limit100Completed Actions purge - limit each purge to this value

oozie.service.PurgeService.purge.interval

3600Interval at which the purge service will run, in seconds.