@Nisha Patel Could you please add your flow screenshot to understand how your flow is designed? and configurations of MergeContent processor. ... View more

@Gary Mullen-Schultz You are having array of json and trying to extract name value as attribute to the flowfile. Configure EvaluateJsonPath processor as below: thename $.[0].name So by using above path we are navigate array and extracting name value. Correct way of doing this is.. Use SplitJson processor Configure processor as $.* Using splitjson processor we are splitting json array into individual flowfiles.. then use EvaluateJsonPath processor add new property as thename $.name - If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues. ... View more

@Pepelu Rico Could you once make sure the scheduling of GetHDFSFileInfo processor by default this processor scheduled to run 0 sec(always running), I think that is causing this 10000 flowfiles. GetHDFSFileInfo processor doesn't store the state so it will always list out the files in the directory. Change the Run schedule like (1 hr) then this processor will run once per hour and you will get only the number of files in directory. ... View more

@Nisha Patel Take off Max Bin Age property value, as you are configured as 10sec so merge content processor will wait 10 sec and merges all the flowfiles but for defragement strategy processor needs 38225 files and found only 10k files, So this is routing to failure. In Addition use Record oriented processor(update record..etc) and then use PublishKafkaRecord processor, record oriented processors are intended to work on batch of records you don't have to use multiple split processors at all. Flow: 1.ListFile 2.FetchFile 3.UpdateRecord //you can use this processor instead of Replace Text processor 4.PublishKafkaRecord --other processing ... View more

@Pepelu Rico Please check my `updated answer` and we don't need to run the command in the processor as this processor designed to just configure the directory and all the commands will run by the processor it self. ... View more

@Pepelu Rico Use GetHDFSFileInfo processor and configure the Full path property value as `<directory>` and this processor is stateless so you are going to list out all the files from the directory. GetHDFSFileInfo Configs: we are listing out all files in /tmp directory recursively and configured Destination as Attributes, so the flowfiles will have all the write attributes as flowfile attributes. This processor has been added in NiFi-1.7, if you are using earlier version of NiFi then you need to run a script that can list out all the files in the directory then extract the path and use the extracted attribute in FetchHDFS processor. ... View more