NiFi-1.10- Load Balancer

[#1]

Hello guys,

We have a 3 node NiFi cluster with version 1.10, we are trying to load balance with round robin but all our flows are going to only one node, not distributing to all nodes. Is there any method or work around to fix this? Also, is there any bug in the NiFi version 1.10? 

[#2]

@Masi  Load Balancing related issues are fixed in NiFi 1.10, so you should not be hitting any known issue in this version.

On LB queue how many flowfiles you pass at any given point? How many nodes you have? 

If you are passing one flowfile and till the time it processed/passed to next processor there is no flowfile in queue then it is possible that NiFi not load balancing the flowfiles at all as it doesn’t have enough flowfiles.

Also on load balancing queue you should have an icon representing LB queue, do you see that icon color changing from green to grey? If icon is green means it is load balancing the flowfiles and if grey then it finished the balancing.

If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here.

-Akash

[#3]

@ashinde, thanks for responding to my queries. 

We have a 3 node cluster and the amount of data traversing after splitJson is in the thousands. 

Our icon representing LB queue is never green and it is always grey, is there anything we are missing in our config? 

Masi.

[#4]

@Masi There have been many bug fixes in NiFi 1.9, 1.10, and 1.11 to LB connections.  No particular bug comes to mind that explains what you are seeing.  Is you NiFi secured?  If so are you have authorization or SSL exceptions in your NiFi logs that may explain issue with 1 node sending FlowFiles to another node?

[#5]

@MattWho , currently we are using a self-signed certificate and we have this error in our bootstrap log. 

2021-04-05 17:51:14,740 ERROR [NiFi logging handler] org.apache.nifi.StdErr Mon Apr 05 17:51:14 EDT 2021 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.

Is the above error is related to the LB on nifi? How can we fix this. 

TIA.. 

[#6]

@Masi 

The exception does not appear related to Load Balance connections in NiFi.  LB Connections utilize NiFi S2S in the background which does not use MySQL. 

Matt

[#7]

nifi 1.10 is not supported please upgrade