Thank You. Yes.. i do know what you highlight.. and of course the GetHTTP processor behaves in exactly the way you describe. What it does not do is provide me status about its progress. For example (having built many HTTP interfaces - in many languages) its relatively easy to keep track of the number of bytes that you've uploaded so far... its easy to keep track of the fact that you've gotten access to the upload URL (and begun the upload). What I don't see is "status information" from the GetHTTP processor that would allow me to know where it is in its lifecyle: its progress towards completion of the "get". The DEBUG or INFO bulletins dont provide this.. I guess the answer is that whether or not there is adequate detail within a bulletin is up to the specific processor. I am guessing that some processors have more useful INFO and DEBUG bulletins than others. ... View more

Thank you @Timothy Spann. That is indeed the right way to go. Additionally, my initial look at the registry seems to suggest that it contains support for versioning at the process group level. For some reason I thought I saw a registry JIRA issue that suggested it did not support that. I started to try it out yesterday. If we decide to use NIFI, we will definitely do so through the official HDF release. Right now I am in an evaluation mode to see if it can suit the needs of a mission critical system. ... View more

@Matt Clarke Hi Matt. One question I'd like to get your perspective on.. Assuming that I manage independent flows within a single NIFI cluster, is it your experience that I can use the NIFI registry to properly version and manage the independent flows that are processed within that cluster? The inability to manage each independent flow as a versioned flow, could potentially drive me to using multiple NIFI clusters (and to assign each cluster one or several flows). I'm concerned about the overall complexity of the processing that is assigned to a single cluster. ... View more

Thank you very much. I'll try these this week. Great detail in your response.. appreciated. ... View more

Thank you. I like your answer very much. I do think the referenced example was not focused on a zip of zip (just a simple zip of a directory tree).. Yet I think your answer is proper.. The "path" attribute does the job. I'll try this.. and thanks. ... View more

One example I've found is this: https://gist.github.com/ijokarumawak/01c4fd2d9291d3e74ec424a581659ca8 This looks relatively clean. Is this the best option? ... View more