Task may seem to be easy, but in fact it isn't... I have a big flow file (>1GB), from which I need to remove, let's say, first line (header) before further processing. So far I had 3 attempt, but none of them works as expected: 1) ReplaceText Works for small files, but the problematic file is too big to load it into memory (I get memory out of bounds exception). 2) SplitText I was trying to use SplitText, but due to this issue I cannot skip the header line in this processor at the moment. In other words - this processor fails whenever Header Line Count > 0. 3) ExecuteProcess I can imagine running a linux command (e.g. tail or sed) to do this job, but it requires saving the flow file to the disk, which might be also costly. Do you have any ideas if this can be done more efficiently? Thanks, Michal
... View more
