Member since
09-18-2017
4
Posts
0
Kudos Received
0
Solutions
10-25-2017
05:56 AM
@Matt Clarke Thanks for the reply, appreciate it. In my case directory from which files will be listed exist only on one node. For now I am trying to implement with ListSFTP and FetchSFTP processors and hope it works fine. Thank you once again for your valuable suggestions. Thanks, Basant
... View more
10-23-2017
09:29 PM
@Matt Clarke My use case: In one the nodes of nifi cluster, there is a Unix shell script running which create files in a directory every 15 minutes. To ingest these files I am using "ListFile processor" on the node on which the file is generated and then use remote process group to input to FetchFile processor to efficiently use the nifi cluster. My doubt is that do we need to run the ListFile processor on Primary Node. What will happen if the Primary Node goes down? Will the newly elected Primary node be able to access the original directory. I am also following this blog: https://pierrevillard.com/2017/02/23/listfetch-pattern-and-remote-process-group-in-apache-nifi/ According to this RPG can also be used to connect a NiFi cluster to itself. Could you please clarify on this. Thanks for all your help and support. Thanks, Basant
... View more
10-21-2017
11:12 PM
A have a nifi cluster with 5 machines, their FQDNs are mycoapmny.nifiui.node01.net mycoapmny.nifiui.node02.net (is the primary node) mycoapmny.nifiui.node03.net mycoapmny.nifiui.node04.net mycoapmny.nifiui.node04.net I am configuring remoteprocessgroup on mycoapmny.nifiui.node02.net to list files in a directory on the same node. but I got the options such as Transport protocol will it be HTTP? or Raw? HTTP Proxy Server hostnames of each nodes in cluster Http Proxy user --> is my ad group username? required here? Local netwrok interface --> bond0? since this is the name I got doing after ifconfig on the primary node Http proxy server port --> which port ? 9091 since this is configured for my nifi ui Http proxy password --> is my ad group password required here?
... View more
Labels:
- Labels:
-
Apache NiFi
10-21-2017
05:02 PM
Labels:
- Labels:
-
Apache NiFi