Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How can we change data path pattern in falcon

How can we change data path pattern in falcon

New Contributor

Hi@Artem Ervits . Could you please check below and help

In our environment we are using falcon to delete the hdfs data against retention. But location of data path should be in year-month-date format but the problem is before year-month-day pattern there are numbers which always changing. So is there any way we can give that as variable in data path for falocn. FYi...

2017-08-28 09:58 /test/998

2017-08-24 22:26 /test/999

and if you see inside this number time stamp folders are there as below

2017-08-24 10:23 /test/999/2017-08-23

2017-08-24 10:23 /test/999/2017-08-24

1 REPLY 1
Highlighted

Re: How can we change data path pattern in falcon

Mentor

@Amit Panda take a look at feature of Oozie called dataset, it should help you in defining retention on your dataset https://oozie.apache.org/docs/4.3.0/CoordinatorFunctionalSpec.html#a5._Dataset

Don't have an account?
Coming from Hortonworks? Activate your account here