Hi Guys   I need to know the following, thanks in advance:   i) Do List processors w/ timestamp tracking store state locally?    ii) Does this state survive NiFi restarts?   iii) If running on primary node only, would this mean when another primary node is chosen, the List processor would list any files it hasn't tracked (and re-ingress a large backlog of files if still there)?   iv) What out-of-box solutions can help to get around the issue of non-persisted non-distributed listing, or do we need custom auditing triggering individual listings? ... View more

Hey Guys,   Need to establish links between dependent flows within the same NiFi cluster / canvas - e.g. one flow finishes ETL, triggering another flow to begin its ETL on the result of the first's.   From what I gather this could be achieved in 3 ways: 1. Direct connections between flows - undesirable in our production environment and data governance and a spider's web of dependencies 2. Remote processor groups (RPGs) - if can send / receive from same NiFi Cluster  3. HTTP   Could you please advise on options 2 & 3 as a solution for this?  RPGs seem simpler than handling HTTP requests / responses yet require an input port on the top level of the flow, which would then need to be directly connected into each flow (being another version of option 1).   Thanks ... View more