Fetchfile processor in nifi

[#1]

For handling parallel sessions in fetchfile processor i increased the run schedule and concurrent tasks in fetchfile processor..there would be around 3k files which needs to be handled parallely..and there would be files of large size(around 1 gb)..So if we increase the run schedule..then it would take more time to execute..is there any way to tackle that?

[#2]

@Gillu Varghese

"Run Schedule" does not determines the execution time of a processor. Rather it is for scheduling purpose. For example, following settings will result in the execution of your processor every 10 sec.

And every time your processor run, it shall pick up all the files in the mentioned directory.

The run schedule has nothing to do with the efficiency of your flow. Use it for scheduling your flow accordingly. Setting the number of "Concurrent tasks" will result in multiple threads taking care of data retrieval for you and you should be fine.

[#3]

@Rahul Soni

Thanks for the information.it was really helpful.

[#4]

@Gillu Varghese Please mark the answer as accepted if it solved your query!