Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Falcon retention period

Solved Go to solution
Highlighted

Falcon retention period

I tried to set falcon retention period on a feed. Expecting it to delete old folders after the specified time period. ( In this case 7 days ). However this does not happen. Anybody knows how to debug that? Where would he write any log information to this? In the oozie falcon action surrounding the workflow or in the falcon server logs?

Or is there anything else I need to do? The process is happening every 15 minutes so he shouldn't have to schedule cleanup tasks.

<clusters>
        <cluster name="xxx" type="source">
            <validity start="2016-01-14T12:45Z" end="2033-01-13T20:00Z"/>
            <retention limit="days(7)" action="delete"/>
        </cluster>
    </clusters>
    <locations>
        <location type="data" path="/xxx/${YEAR}/${MONTH}/${DAY}/${HOUR}/${MINUTE}"/>
    </locations>
1 ACCEPTED SOLUTION

Accepted Solutions

Re: Falcon retention period

Contributor

Do you have the feed scheduled? The feed needs to be scheduled for retention to work.

View solution in original post

5 REPLIES 5

Re: Falcon retention period

Contributor

Do you have the feed scheduled? The feed needs to be scheduled for retention to work.

View solution in original post

Highlighted

Re: Falcon retention period

aaah I didn't know that I only scheduled the process using the feeds. Let me try that

Highlighted

Re: Falcon retention period

Still didn't work I get now some kerberos errors when trying to schedule the feed but at least I know wht the retention does not work. Thanks.

Highlighted

Re: Falcon retention period

And a falcon restart fixed that. The retention cleanup now works. Thanks a lot

Highlighted

Re: Falcon retention period

@Benjamin Leonhardi: Can you make sure retention coordinator is generated for the feed scheduled? Debug logs will go to falcon.applicaiton.log.

Don't have an account?
Coming from Hortonworks? Activate your account here