The process is triggered by a GetSFTP that retrieves a date file.. Then the query uses the date for filtering.. Thanks for your contribution.. As soon as I make progress I'll update you guys. ... View more

My point is, the error occurs when the ExecuteSQL is running. The cause is: ExecuteSQL needs to create a huge flow file that the edge machine doest not have enough processing power to create.. Your solutions looks good, but it would split the flow file after it was produced by the ExecuteSQL, your solution takes action in a moment when the error has already occurred.  ... View more

I don't know if these solutions works for me. What I really wanna do is make ExecuteSQL work as (for example) SelectHiveQL, which means, ExecuteSQL get only one incoming flow file and sends forward multiple flows file that can be merged.   My real problem is that the ExecuteSQL query sometimes needs to produce a flowfile whose size is too large for the edge machine to process, what ends in error.. so, I need to split the flow file to decrease the pressure on the edge machine...  I've been through the same situation in Hive queries, but I solved using the "Max Rows Per Flow File" property and then merging the flowfiles. ... View more

There is no such a option at ExecuteSQL..   Perhaps you're using a newer version of NiFi: Mine is 1.5.0.3.1.2.0-7 ... View more