I was having similar issue, where I had around 7000+ flow files and I needed to merge them into one. Provided that, I didn't know what will be the exact number of flow files, I couldn't specify that number in Minimum Number of Entries attribute of mergeContent processor to make it only 1 flow file after merge. After trying a lot of things, including trying to count the flow files or induce a delay before sending them off to merge, I finally found the solution on the mergeContent documentation below : https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.6.0/org.apache.nifi.processors.standard.MergeContent/index.html#:~:text=The%20%27Defragment%27%20algorithm%20combines%20fragments%20that%20are%20associated%20by%20attributes%20back%20into%20a%20single%20cohesive%20FlowFile.%20The%20%27Bin%2DPacking%20Algorithm%27%20generates%20a%20FlowFile%20populated%20by%20arbitrarily%20chosen%20FlowFiles And there you go ! setting 'Merge Strategy' property to 'Defragment' and 'Attribute Strategy' property to 'Keep Only Common Attributes' fixes the problem for me. In all my flow files, they have common attributes and are now merged into a single flow file. The original question is from 2017, but I hope it helps out somebody else looking for an answer. You can check the original answer here https://stackoverflow.com/questions/56356164/nifi-merging-all-of-necessary-flowfile-in-one-shot-with-mergecontent-processor/79257994#79257994 ... View more

@pankajgaikwad As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks. ... View more

That's perfect ! ... View more

Hi @Shu_ashu, @ramesh_ganginen  I am encountering the same issue. I attempted the method you suggested, but it didn't work. I'm trying to copy a table from my MySQL database to my local machine using Apache NiFi. I've configured the 'ConvertRecord' processor and added the 'CSVRecordSetWriter', but I'm still receiving files in JSON format. Can you please guide me if I'm making any mistakes? ... View more

Hi @marco21  can you please provide me the full implementation code for ListDynamiscSFTP that you have mentioned in your post. I do have the same requirement but not able to determine the methods that I have to override to get the exact implementation of ListSFTP  ... View more

Thanks ... View more

Your original example had everything at +0000 but the error has +0700 so perhaps change the pattern to  yyyy-MM-dd'T'HH:mm:ssZ ... View more

have you a response on your issue please? ... View more

@jricogar  Why not use the listHDFS processor? It retains state so that same HDFS files do not get listed multiple times. Just trying to understand your use case for using FetchHDFS without ListHDFS processor. Thanks, Matt ... View more

I understand that it'd be pointless to send a FlowFile to the ListS3 processor, but it still seems like we should be able to attach it to a Wait processor and have it trigger that way. ... View more