https://community.cloudera.com/t5/Support-Questions/NiFi-how-to-remove-efficiently-a-line-from-a-big-flow-file/m-p/124719#M87463 <P>Task may seem to be easy, but in fact it isn't...</P><P>I have a big flow file (&gt;1GB), from which I need to remove, let's say, first line (header) before further processing.</P><P>So far I had 3 attempt, but none of them works as expected:</P><P>1) ReplaceText</P><P>Works for small files, but the problematic file is too big to load it into memory (I get memory out of bounds exception).</P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="12969-capture.jpg" style="width: 790px;"><img src="https://community.cloudera.com/t5/image/serverpage/image-id/22711i44706C87498915FE/image-size/medium?v=v2&amp;px=400" role="button" title="12969-capture.jpg" alt="12969-capture.jpg" /></span></P><P>2) SplitText</P><P>I was trying to use SplitText, but due to <A href="https://issues.apache.org/jira/browse/NIFI-3255" rel="nofollow noopener noreferrer" target="_blank">this issue</A> I cannot skip the header line in this processor at the moment.</P><P>In other words - this processor fails whenever Header Line Count &gt; 0.</P><P>3) ExecuteProcess</P><P>I can imagine running a linux command (e.g. tail or sed) to do this job, but it requires saving the flow file to the disk, which might be also costly.</P><P>Do you have any ideas if this can be done more efficiently?</P><P>Thanks, Michal</P> Mon, 19 Aug 2019 10:13:20 GMT michal_rudko 2019-08-19T10:13:20Z