Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Oozie purge script

Solved Go to solution
Highlighted

Oozie purge script

Is it ok to run purge scripts on WF_JOBS & COORD_JOBS tables that are in oozie Database configured in MySQL?

Will the purge scripts remove the running workflows and coordinators?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Oozie purge script

Super Guru

@Sagar Shimpi

Oozie has feature to purge older jobs from database. by default it's 30 days. Actions related to long running coordinators do not purged until co-ordinator completes, ( example - if you have coordinator running for 6 months, then all the related workflows will be there in database for 6 months )

Will the purge scripts remove the running workflows and coordinators?

Ans - No it will not.

Below are the respective properties and their default values.

Useful link - http://stackoverflow.com/questions/31946225/oozie-not-cleaning-up-old-jobs-from-oozie-database

oozie.service.PurgeService.older.than30Completed workflow jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.coord.older.than7Completed coordinator jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.bundle.older.than7Completed bundle jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.purge.old.coord.actionfalseWhether to purge completed workflows and their corresponding coordinator actions of long running coordinator jobs if the completed workflow jobs are older than the value specified in oozie.service.PurgeService.older.than.
oozie.service.PurgeService.purge.limit100Completed Actions purge - limit each purge to this value

oozie.service.PurgeService.purge.interval

3600Interval at which the purge service will run, in seconds.

View solution in original post

2 REPLIES 2
Highlighted

Re: Oozie purge script

Highlighted

Re: Oozie purge script

Super Guru

@Sagar Shimpi

Oozie has feature to purge older jobs from database. by default it's 30 days. Actions related to long running coordinators do not purged until co-ordinator completes, ( example - if you have coordinator running for 6 months, then all the related workflows will be there in database for 6 months )

Will the purge scripts remove the running workflows and coordinators?

Ans - No it will not.

Below are the respective properties and their default values.

Useful link - http://stackoverflow.com/questions/31946225/oozie-not-cleaning-up-old-jobs-from-oozie-database

oozie.service.PurgeService.older.than30Completed workflow jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.coord.older.than7Completed coordinator jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.bundle.older.than7Completed bundle jobs older than this value, in days, will be purged by the PurgeService.
oozie.service.PurgeService.purge.old.coord.actionfalseWhether to purge completed workflows and their corresponding coordinator actions of long running coordinator jobs if the completed workflow jobs are older than the value specified in oozie.service.PurgeService.older.than.
oozie.service.PurgeService.purge.limit100Completed Actions purge - limit each purge to this value

oozie.service.PurgeService.purge.interval

3600Interval at which the purge service will run, in seconds.

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here