Suggested value for properties "nifi.cluster.node.protocol.max.threads"

[#1]

Hi All,

Thanks for help to this awesome community

nifi.cluster.node.protocol.max.threads=

The field is empty by default in nifi.properties

We have a data source feeds producing 15000 events per second.

What do you guys recommend.

As per recommendaions from this community I changed these properties for the above mentioned event per second

nifi.cluster.node.connection.timeout=15 sec 

nifi.cluster.node.read.timeout=15 sec 

nifi.cluster.node.protocol.threads=50

Need suggestions recomendations. I know I have to tune it by changing these properties to reach optimal performance, however a startin value for this nifi.cluster.node.protocol.max.threads=

be awesome

Thanks

Dheeru

[#2 · Accepted solution]

@dhieru singh

If the nifi.cluster.node.protocol.max.threads property is left blank it will default to a value of 50. Which should be more than adequate for most cases. You can set the nifi.cluster.node.protocol.threads=10, that is your lower limit and the max.threads is your upper limit.

How many nodes are in your cluster?

[#3]

@Wynner Thanks a lot for theconfirmation, yes I set nifi.cluster.node.protocol.max.threads=50 and nifi.cluster.node.protocol.threads=49, I have 5 nodes in a cluster 16 cores

[#4]

@dhieru singh

With 5 nodes, I would set the nifi.cluster.node.read.timeout and nifi.cluster.node.connection.timeout to 60 secs. In addition, I would set the nifi.cluster.protocol.heartbeat.interval to 15 secs instead of the default of 5 secs.

[#5]

@Wynner @dhieru singh, "nifi.cluster.node.protocol.max.threads=50 and nifi.cluster.node.protocol.threads=49, I have 5 nodes in a cluster 16 cores" 
How 50 (other than being default) for max threads and 49 for node protocol is chosen?

[#6]

@nruak As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks!