Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi make single Database call after processing multiple flowfiles

Highlighted

NiFi make single Database call after processing multiple flowfiles

New Contributor

Hello,

I have a below scenario

1. get new files list with ListFile processor

2. set a constant variable  zipFilesBundleConstant = listBundle on each flowfile 

3. Put the list to Database 

4. Get all the list of files old and new from Database to process further with ExecuteSQL processor. (Here I want to make only one Database call to fetch complete list old and new, but ExecuteSQL is being called for all the flowfiles)

I tried keeping MergeContent processor with zipFilesBundleConstant as Correlation Attribute Name before ExecuteSQL to combine all the flowfiles but that is not working as expected and it merges some but always gives me multiple flowfiles.

Can anyone please help me with a solution on how to make a one call after inserting the new files list into the database.

Don't have an account?
Coming from Hortonworks? Activate your account here