- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
NiFi-1.10- Load Balancer
- Labels:
-
Apache NiFi
Created 03-31-2021 03:41 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello guys,
We have a 3 node NiFi cluster with version 1.10, we are trying to load balance with round robin but all our flows are going to only one node, not distributing to all nodes. Is there any method or work around to fix this? Also, is there any bug in the NiFi version 1.10?
Created 04-01-2021 02:02 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Masi Load Balancing related issues are fixed in NiFi 1.10, so you should not be hitting any known issue in this version.
On LB queue how many flowfiles you pass at any given point? How many nodes you have?
If you are passing one flowfile and till the time it processed/passed to next processor there is no flowfile in queue then it is possible that NiFi not load balancing the flowfiles at all as it doesn’t have enough flowfiles.
Also on load balancing queue you should have an icon representing LB queue, do you see that icon color changing from green to grey? If icon is green means it is load balancing the flowfiles and if grey then it finished the balancing.
If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here.
-Akash
Created 04-01-2021 07:02 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@ashinde, thanks for responding to my queries.
We have a 3 node cluster and the amount of data traversing after splitJson is in the thousands.
Our icon representing LB queue is never green and it is always grey, is there anything we are missing in our config?
Masi.
Created 04-05-2021 05:16 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Masi There have been many bug fixes in NiFi 1.9, 1.10, and 1.11 to LB connections. No particular bug comes to mind that explains what you are seeing. Is you NiFi secured? If so are you have authorization or SSL exceptions in your NiFi logs that may explain issue with 1 node sending FlowFiles to another node?
Created 04-08-2021 08:51 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@MattWho , currently we are using a self-signed certificate and we have this error in our bootstrap log.
2021-04-05 17:51:14,740 ERROR [NiFi logging handler] org.apache.nifi.StdErr Mon Apr 05 17:51:14 EDT 2021 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Is the above error is related to the LB on nifi? How can we fix this.
TIA..
Created 04-12-2021 05:35 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Masi
The exception does not appear related to Load Balance connections in NiFi. LB Connections utilize NiFi S2S in the background which does not use MySQL.
Matt
Created 04-05-2021 05:56 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
nifi 1.10 is not supported please upgrade