GETSFTP with NiFi cluster

[#1]

I'm using NiFi 1.6.0, in a 3 node cluster.

When I use GETSFTP (Set to ALL Nodes) in a clustered nifi the cluster seems to distribute the data acquired evenly among nodes.

Does this mean that all 3 servers GetSFTP the data evenly?

I also tried using FETCH SFTP to get the listings and then did a site to site, back to my own cluster and It did NOT distribute the Fetch 0 byte files evenly among the nodes for the fetch SFTP load to be evenly distributed.

What would be the best practice to Load Balance SFTPGET in a nifi cluster?

John

[#2]

Do you mean you tried ListSFTP to get the listings?

[#3]

@John T Take a look at @Matt Burgess answer to a similar question here:

https://community.hortonworks.com/questions/141921/nifi-all-files-are-processed-by-sftp-processor-on...

[#4]

https://community.hortonworks.com/content/kbentry/109629/how-to-achieve-better-load-balancing-using-...