I'm trying to set up a Load Balancing Demo.   I have a GetFile processor that watcches a directory for incoming files and then a flow that processes them.   To try to understand LoadBalancing, I have created a second NiFi instance on the same host (my dev machine), but on a different port 8090 to the first 8080. I have then checked out the flow from the Registry so that it is identical on both instances.   Next, I have set the Load Balancing Strategy on the output queue from both nodes first processsor, (the GetFile proc) in order to see if I can get data going through both instances. I can then drop files into the watch dir and see them hit my flow. However, all the files are going into the same node, even if I wait 10 minutes between dropping them into the dir. But, when I run again it switches to the other node and all the files go through there. Is there a timeout somewhere that I can set to speed up the switch from one node to the other? Or better to switch files to alternate between the nodes. I have assumed the use of the embedded Zookeepr and not made any specific cluster based config as yet... Any help greatly appreciated. Note that this is all runnig on the same localhost, ports 8080 and 8090... ... View more

The NiFi Toolkit CLI has a neat option for setting variables in a deployed NiFi flow. This is very useful for deploying a flow to different environments and then changing a few necessary variables. The commands are nifi pg-get-vars and nifi pg-set-var and would be used as follows;   #> nifi pg-get-vars -pgid 34x015f8-0284-1000-5488-a7c6511e5656 -u http://nifi-prod:8080 #> nifi pg-set-var -pgid 34x015f8-0284-1000-5488-a7c6511e5656 -var ListFilesInputDir -val /prod/temp -u http://nifi-prod:8080 However, using Parameters in  Parameter Contexts seems to be the new and better way of doing things and can be used among different groups in a flow, I have implemented many in my 140 processor project!   So my question is this: How do I now set different values for these Parameters for different environments when I deploy my flow. My deployment will be automated using the CLI in the NiFi toolkit, so I'm looking for a solution that is automated/scripted.   There appears to be ListParamContexts, GetParamContext and SetParam, but when I run;   nifi list-param-contexts -u http://localhost:8090/nifi     I get <title>Error 404 Not Found</title>   I am running NiFi-Toolkit version 1.11.4.       ... View more

I have a line by line list in my flowfile, which records the result of some file processing, somthing like the following;   C:\Data\client1\order100.txt - SUCCESS C:\Data\client1\order122.txt - ERROR C:\Data\client1\order323.txt - SUCCESS   I can't see a way to add this flowfile content to the e-mail MessageBody.   I have therefore tried an ExtractText processor with message.body as an attribute and (.*) as the regex. This gets me close, but all the filenames are on the same line, so I end up with this;   C:\Data\client1\order100.txt - SUCCESS C:\Data\client1\order122.txt - ERROR C:\Data\client1\order323.txt - SUCCESS   Which is not quite the e-mail I'm looking for. Any sensible suggestions welcome.       ... View more

I have few files as follows. /source/abc.txt /source/xyz.txt /source/subdir/abc-sub.txt /source/subdir/xyz-sub.txt   Currently, all the files are copied to the output dir /output/abc.txt /output/xyz.txt /output/abc-sub.txt /output/xyz-sub.txt   Is it possible to re-create/maintain the original file hierarchy, as follows; /output/abc.txt /output/xyz.txt /output/subdir/abc-sub.txt /output/subdir/xyz-sub.txt     ... View more