I find it odd that the GetHTTP processor does not have a failure termination relationship, given that the process can fail due to a number of reasons. Can someone shed light on the proper way to handle a failure (e.g. remote site down)? Thanks. ... View more

I've found that NIFI supports the use of a NIFI registry: https://nifi.apache.org/docs/nifi-registry-docs/index.html NIFI-REGISTRY has built in ability to version control a process group. Ultimately we will likely need to export a versioned process group, and place this in a standard version control system such as GIT or SVN. Does the NIFI-registry version control mechanism support connection to GIT or SVN? ... View more

I've used the GetHTTP processor to get a zip file from the internet.. I then use PutFile to put this into the file system. I then need to unzip the file .. and preserve the directory structure that the zip file specifies. Can I do this unzip with a NIFI processor? Once unzipped, I will then need to do additional nifi processing on specific files within the original zip file. I tried to use UnpackContent, however its output was a set of flowfiles that lost the directory structure. Would I need a custom script for this (e.g. use ExecuteScript processor)? Or perhaps I should integrate "Storm" with NIFI to facilitate such an unzip.. that seems overly complex.. and i dont even know that its a proper task for a Storm process.. Please advise.. I'd think a simple unzip file action.. is .. well simple. ... View more

I am looking at creating several logical (independent) NIFI flows. Because of their independence I could imagine executing each flow within a separate instance of NIFI. Of course, I can also create these flows within a single instance of NIFI. I'm trying to understand the best way to organize my project. Would you suggest that I run multiple instances of NIFI on my platform (one for each independent flow)? Or should I run a single instance of NIFI, and have it manage each independent flow? Part of what I am struggling with is the graphical management of the flows within a single instance of NIFI. The graphical interface works well for a small number of processors, it starts to feel cumbersome as the number of processors and flows increases. (I'm used to the neat structure of a software program). Ultimately the flows I'm creating would be part of a mission critical system. I want to make sure I adopt the best practice in the formulation of the flows and the management environment. ... View more