@Vinylal, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.   ... View more

Hi @MattWho , I did lot of investigation on the same but was not sure merge record can do that. Thanks a lot for your help. ... View more

@F_Amini  @Green_ Is absolutely correct here.  You should be careful when increasing concurrent tasks as just blindly increasing it everywhere can have the opposite effect on throughput.  I recommend stopping setting the concurrent tasks back to 1 or maybe 2 on all the processor where you have adjusted away from the default of 1 concurrent task. Then take a look at the processor further downstream in your dataflow where it has a red input connection but black (no backpressure) outbound connections.  This processor s @Green_ mentioned is the processor causing all your upstream backlog.  Your'll want to monitor your CPU usage as you make small incremental adjustments to this processors concurrent tasks until you see the upstream backlog start to come down.   If while monitoring CPU, you see it spike pretty consistently at 100% usage across all your cores, then your dataflow has pretty much reached the max throughput it can handle for yoru specific dataflow design.  At this point you need to look at other options like setting up a NiFi cluster where this work load can be spread across multiple servers or designing your datafow differently with different processors to accomplish same use case that may have a lesser impact on CPU (not always a possibility).  Thanks, Matt ... View more

@Sinchan Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks ... View more

@grb Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks ... View more

@dreaminz Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks   ... View more

@Jacccs   Was the nifi-app.log created?  If so, what was observed in that log? Please share the exact versions of NiFi you used. Have you tried using a Java JDK instead of Java JRE? Thanks, Matt ... View more

@cihankara I recommend starting a new community question as this sounds like a different use case from this community post.  Providing details of yoru use case like what is other output, how are those being ingested in to NiFi, what info is available in that output, etc.. Feel free to @MattWho in that new community post to trigger notification to me in the community. Thanks, Matt ... View more

@hargav  Please create a new community question for your queries around MergeRecord processor.  This is the best way to get attention and best for community to have a separate thread for each specific query.   I am not clear on your use case for using "cron driven" scheduling with the MergeRecord.  This would not be a common thing to do. Best to explain your use case in a new community thread along with sharing your MergeRecord processor configuration.  Feel free to @MattWho in the new community post to notify me. Thanks, Matt ... View more