Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Oozie purge script

avatar
Super Guru

Is it ok to run purge scripts on WF_JOBS & COORD_JOBS tables that are in oozie Database configured in MySQL?

Will the purge scripts remove the running workflows and coordinators?

1 ACCEPTED SOLUTION

avatar
Master Guru

@Sagar Shimpi

Oozie has feature to purge older jobs from database. by default it's 30 days. Actions related to long running coordinators do not purged until co-ordinator completes, ( example - if you have coordinator running for 6 months, then all the related workflows will be there in database for 6 months )

Will the purge scripts remove the running workflows and coordinators?

Ans - No it will not.

Below are the respective properties and their default values.

Useful link - http://stackoverflow.com/questions/31946225/oozie-not-cleaning-up-old-jobs-from-oozie-database

oozie.service.PurgeService.older.than30Completed workflow jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.coord.older.than7Completed coordinator jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.bundle.older.than7Completed bundle jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.purge.old.coord.actionfalseWhether to purge completed workflows and their corresponding coordinator actions of long running coordinator jobs if the completed workflow jobs are older than the value specified in oozie.service.PurgeService.older.than.
oozie.service.PurgeService.purge.limit100Completed Actions purge - limit each purge to this value

oozie.service.PurgeService.purge.interval

3600Interval at which the purge service will run, in seconds.

View solution in original post

2 REPLIES 2

avatar
Super Guru

avatar
Master Guru

@Sagar Shimpi

Oozie has feature to purge older jobs from database. by default it's 30 days. Actions related to long running coordinators do not purged until co-ordinator completes, ( example - if you have coordinator running for 6 months, then all the related workflows will be there in database for 6 months )

Will the purge scripts remove the running workflows and coordinators?

Ans - No it will not.

Below are the respective properties and their default values.

Useful link - http://stackoverflow.com/questions/31946225/oozie-not-cleaning-up-old-jobs-from-oozie-database

oozie.service.PurgeService.older.than30Completed workflow jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.coord.older.than7Completed coordinator jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.bundle.older.than7Completed bundle jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.purge.old.coord.actionfalseWhether to purge completed workflows and their corresponding coordinator actions of long running coordinator jobs if the completed workflow jobs are older than the value specified in oozie.service.PurgeService.older.than.
oozie.service.PurgeService.purge.limit100Completed Actions purge - limit each purge to this value

oozie.service.PurgeService.purge.interval

3600Interval at which the purge service will run, in seconds.