Member since
03-01-2017
30
Posts
2
Kudos Received
0
Solutions
05-11-2017
03:26 PM
@Matt Clarke If one flowfile is acquire by any processor, then all the processing is done by that processor only or there is an option to distribute it on other nodes, if working in an cluster.
... View more
05-11-2017
01:42 PM
Hi Matt, Can you briefly explain what this line exactly mean "The distributed files are then fed to a FetchSFTP processor that will retrieve the content form the SFTP server and insert it in to the FlowFile at that time"
... View more
05-11-2017
10:52 AM
flow.pngThanks Matt, All above steps are helpful for me to setup cluster. I attach my workflow. Workflow is configured so that GetSFTP is executed on primary node and after that there is Remote process group. By GetSFTP all file contents are put on primary node local content repository. So when flow reaches to remote process group,it will distribute flowfiles to nodes connected in cluster. As each node read contents from their local content repository, so in case of RPG , Is contents are again written over nodes local contents repository? If so, then suppose a case where GetSFTP gets multiple file having 2tb total size and write all contents in primary node content repo. After that RPG distribute flowfiles among different nodes, and again it will write contents in their respective repo. So this will be overhead of space as well as time.
... View more
05-08-2017
02:59 PM
This means that, if one node is performing some transformation to flowfile, and in between it if that node goes down, then its overall functionality is transferred to another node.
... View more
05-08-2017
10:28 AM
I am working with nifi cluster. As in tutorial it is suggestion to use remote process group with cluster for load balancing.
But to use Remote process group, we have to provide url of other nifi instance which is hardcoded. So what will happen if that nifi instance goes down in between of workflow execution. Is remote process call is working in that situation as load balancing concept is implemented in Remote process call.
... View more
Labels:
- Labels:
-
Apache NiFi