Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Oozie purge script

avatar
Super Guru

Is it ok to run purge scripts on WF_JOBS & COORD_JOBS tables that are in oozie Database configured in MySQL?

Will the purge scripts remove the running workflows and coordinators?

1 ACCEPTED SOLUTION

avatar
Master Guru

@Sagar Shimpi

Oozie has feature to purge older jobs from database. by default it's 30 days. Actions related to long running coordinators do not purged until co-ordinator completes, ( example - if you have coordinator running for 6 months, then all the related workflows will be there in database for 6 months )

Will the purge scripts remove the running workflows and coordinators?

Ans - No it will not.

Below are the respective properties and their default values.

Useful link - http://stackoverflow.com/questions/31946225/oozie-not-cleaning-up-old-jobs-from-oozie-database

oozie.service.PurgeService.older.than30Completed workflow jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.coord.older.than7Completed coordinator jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.bundle.older.than7Completed bundle jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.purge.old.coord.actionfalseWhether to purge completed workflows and their corresponding coordinator actions of long running coordinator jobs if the completed workflow jobs are older than the value specified in oozie.service.PurgeService.older.than.
oozie.service.PurgeService.purge.limit100Completed Actions purge - limit each purge to this value

oozie.service.PurgeService.purge.interval

3600Interval at which the purge service will run, in seconds.

View solution in original post

2 REPLIES 2

avatar
Super Guru

avatar
Master Guru

@Sagar Shimpi

Oozie has feature to purge older jobs from database. by default it's 30 days. Actions related to long running coordinators do not purged until co-ordinator completes, ( example - if you have coordinator running for 6 months, then all the related workflows will be there in database for 6 months )

Will the purge scripts remove the running workflows and coordinators?

Ans - No it will not.

Below are the respective properties and their default values.

Useful link - http://stackoverflow.com/questions/31946225/oozie-not-cleaning-up-old-jobs-from-oozie-database

oozie.service.PurgeService.older.than30Completed workflow jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.coord.older.than7Completed coordinator jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.bundle.older.than7Completed bundle jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.purge.old.coord.actionfalseWhether to purge completed workflows and their corresponding coordinator actions of long running coordinator jobs if the completed workflow jobs are older than the value specified in oozie.service.PurgeService.older.than.
oozie.service.PurgeService.purge.limit100Completed Actions purge - limit each purge to this value

oozie.service.PurgeService.purge.interval

3600Interval at which the purge service will run, in seconds.