question Re: Falcon retention period in Archives of Support Questions (Read Only)

Falcon retention period

bleonhardi — Tue, 26 Jan 2016 19:35:29 GMT

I tried to set falcon retention period on a feed. Expecting it to delete old folders after the specified time period. ( In this case 7 days ). However this does not happen. Anybody knows how to debug that? Where would he write any log information to this? In the oozie falcon action surrounding the workflow or in the falcon server logs?

Or is there anything else I need to do? The process is happening every 15 minutes so he shouldn't have to schedule cleanup tasks.

<clusters>
        <cluster name="xxx" type="source">
            <validity start="2016-01-14T12:45Z" end="2033-01-13T20:00Z"/>
            <retention limit="days(7)" action="delete"/>
        </cluster>
    </clusters>
    <locations>
        <location type="data" path="/xxx/${YEAR}/${MONTH}/${DAY}/${HOUR}/${MINUTE}"/>
    </locations>

Re: Falcon retention period

pavel_benes — Wed, 27 Jan 2016 16:32:40 GMT

Do you have the feed scheduled? The feed needs to be scheduled for retention to work.

Re: Falcon retention period

sramesh — Thu, 28 Jan 2016 03:19:07 GMT

@Benjamin Leonhardi: Can you make sure retention coordinator is generated for the feed scheduled? Debug logs will go to falcon.applicaiton.log.

Re: Falcon retention period

bleonhardi — Fri, 29 Jan 2016 00:50:59 GMT

aaah I didn't know that I only scheduled the process using the feeds. Let me try that

Re: Falcon retention period

bleonhardi — Fri, 29 Jan 2016 00:54:52 GMT

Still didn't work I get now some kerberos errors when trying to schedule the feed but at least I know wht the retention does not work. Thanks.

Re: Falcon retention period

bleonhardi — Fri, 29 Jan 2016 01:06:23 GMT

And a falcon restart fixed that. The retention cleanup now works. Thanks a lot