On Nifi Is it possible using PutHdfs Processor to configure so that files are written to day wise folder ,rolling to new day folder everyday

[#1]

For Ex:

USing getKafka -to read the stream

PutHDFS to write to HDFS

Can it be configured in the processor to create new folders when a new day starts and write the kafka topic data to that folder.

Basically to maintain day wise folders in HDFS using putHDFS processor in nifi.

[#2 · Accepted solution]

Hi @manisha jain, yep it is possible with PutHDFS processor.
in puthdfs processor keep directory property as

/user/kafka/${now():format("yyyy-MM-dd")}

Expression:-
${now():format("yyyy-MM-dd")}
above expression now will be the current timestamp and extracts only the date and creates the directory with the date dynamically and and stores all the flow files that are generated with same date will be stored into the same directory.

PutHDFS properties:-

[#3]

Thanks @Yash i have used the same approach,it works.