Support Questions
Find answers, ask questions, and share your expertise

create Falcon hdfs feed with custom partitions.

I have a following directory hierarchy in hdfs

/foo/bar/fruits/<fruit name>/<fruit color>/orders.<year><month><day>.log.csv.<compression>

the values for <fruit name> are like apple, banana, strawberry etc.

<fruit color> values are like red, green, yellow, brown etc.

and <compression> is either gz or lz4.

Is there a way I can represent this fruits directory as one falcon feed so that I can maintain a feed retention of 1 month for all fruits ?

I want to avoid creating individual feeds per fruit per color.

0 REPLIES 0