Support Questions
Find answers, ask questions, and share your expertise

How can we change data path pattern in falcon

Highlighted

How can we change data path pattern in falcon

Hi@Artem Ervits . Could you please check below and help

In our environment we are using falcon to delete the hdfs data against retention. But location of data path should be in year-month-date format but the problem is before year-month-day pattern there are numbers which always changing. So is there any way we can give that as variable in data path for falocn. FYi...

2017-08-28 09:58 /test/998

2017-08-24 22:26 /test/999

and if you see inside this number time stamp folders are there as below

2017-08-24 10:23 /test/999/2017-08-23

2017-08-24 10:23 /test/999/2017-08-24

1 REPLY 1

Re: How can we change data path pattern in falcon

Mentor

@Amit Panda take a look at feature of Oozie called dataset, it should help you in defining retention on your dataset https://oozie.apache.org/docs/4.3.0/CoordinatorFunctionalSpec.html#a5._Dataset