Hi ,   Is not every record you pull through the GenerateTableFetch will have the max value for the max column? ... View more

Hi, The full picture is not clear on how your flow works, for example where do you get the json that goes through the jolt processor and input port from? Is there a correlation between getting the json from the different sources where one json is generated before the other or the two json sources are independent of each other? If they are independent of each other then how do you know when to merge , for example what if the json from the input port did not come? Can you explain more on how your flow works and if there is a dependency where one json input drives the other or not? ... View more

Hi, Couple of options I can think of but that depends on your flow and what are you trying to do with the data:   1- Get all the parameters you need through the whole flow from the xml after you fetch the file. Those parameters will be there on every generated flow file later on and at any step you can retrieve them and do whatever needed. 2- If the data you are trying to get downstream from the xml is unrelated you can always have multiple branches after the FetchFile and created different flow for each branch that can run asynchronously. 3- IF you are looking to do different API calls based on the same XML, the InvokeHttp has an Original relationship besides the Response relationship in case each response independent of the others. 4- If you are using Nifi 1.16 and higher and you are looking for data enrichment for the base XML you can look into the processors : ForkEnrichment, JoinEnrichment.     ... View more

Hi, In the ExecuteSQL or ExecuteSQLRecord you have Pre Query, Select Query and Post Query properties. In the Pre Query can you declare variables to store the output parameters, run the stored proc passing those parameter and then insert them into a temp table which then you can use the Select Query property to read the values from the temp table and that will translate to flowfiles. If you are using the ExecuteSQLRecord you can define in which format you want the flowfile in by defining the record writer property. Hope that helps. ... View more

Hi, not sure if you are repeating the attribute name in the processor dynamic property values! Make sure the different header attributes are set\add as follows:     ... View more

Hi, you can use  ReplaceText by setting the Evaluation Mode property to "Line-by-Line", then set the "Line-by-Line Evalaution Mode" to "Last Line". In the Replacement  Value set it to Empty String Set and the Search Value leave as "(?s)(^.*$)" as seen in the screenshot below:   If you find this helpful please accept solution. Thanks   ... View more

The lookupRecrod processor allows you to specify multiple lookup columns in the DatabaseRecordLookupService incase the id is not enough. I had a similar sitution and I usually defer this kind of check to the DB, so my workflow will call stored proc - with the record parameters - that will check if the record exist or not and based on that decide wither to update or insert. This way Im making only one connection to the DB. ... View more

Hi ,   What is the flowfile content format? Is there an Id you can check using the LookupRecord processor to see if the record already exists or not? ... View more