question Re: NiFi - how to remove efficiently a line from a big flow file? in Support Questions

question Re: NiFi - how to remove efficiently a line from a big flow file? in Support Questions https://community.cloudera.com/t5/Support-Questions/NiFi-how-to-remove-efficiently-a-line-from-a-big-flow-file/m-p/124720#M87464 <P>I suggest you use SplitText a few times to avoid loading all flow files into memory. Go from 1 million --> 100,000, --> 10,000 --> 1000 --> 1. You can cut those down to as well meaning from 1mil->10 thousand -> 1000 -> 1. Then from there use routeontext and route the header to one point and rest of the lines to another point.</P> Fri, 24 Feb 2017 23:28:09 GMT sunile_manjee 2017-02-24T23:28:09Z