When I start the NiFi service in Windows Services manager, NiFi shoots up to around 5.9GB of memory used. This is without even passing any data into the NiFi flow, just the flow existing with the processors on. I have a ListenTCP, 4 ReplaceText processors, and a PostHTTP processor. Why is NiFi using so much memory while doing nothing, and how can I optimize NiFi's memory usage to fix this? ... View more

Given a flowfile of text, I'm trying to extract certain lines from it using regex and pass ONLY those lines onto the next processors. For example, if I have the text: cat dog fish dog bird I only want to extract the lines with "dog", then put those lines into their own flowfile that would look like: dog dog I understand that using an ExtractText processor is probably my best bet in this case, but I'm not sure of how this processor is used correctly. I've read multiple questions where the answer describes how to grab specific text and store them into attributes, but the answers always stop there. I need to know how I can then use those attributes and pass them to another processor, and how to make that processor only use those attributes that ExtractText caught. TL;DR: How do I use ExtractText to grab specific lines, then pass those lines to another processor, and then how do I use that processor to spit out the previously grabbed lines? ... View more

I'm trying to use the ExecuteScript processor to take in a flow file, convert that flow file to a string, regex the string, convert the regexed string back into a flow file, then pass that flow file along the processor flow. I'm wanting to do this with Python. As an example, an incoming string might have text like "The 8 dogs jumped over the 2 cats !". I want the result to look like "The_8_dogs_jumped_over_the_2_cats_!". I've already got a regex that works in this case, my trouble lies within converting the incoming flow file into a string that I can then use regex on. The nature of the regex requires the string to be processed multiple times to eliminate all of the whitespaces, so I would like the ExecuteScript processor to be able to pass back into itself multiple times per flowfile. Another note: I've tried using a ReplaceText processor coupled with a RouteOnContent processor, however this solution is much too slow to handle the quantity of data I'm working with (even when adjusting the concurrent tasks property). In short I want to convert a flowfile to a string, do some regex substitutions, then convert back to a flowfile. ... View more