question Re: Suggested value for properties "nifi.cluster.node.protocol.max.threads" in Archives of Support Questions (Read Only)

Suggested value for properties "nifi.cluster.node.protocol.max.threads"

dhieru — Mon, 30 Oct 2017 23:24:22 GMT

Hi All,

Thanks for help to this awesome community

nifi.cluster.node.protocol.max.threads=

The field is empty by default in nifi.properties

We have a data source feeds producing 15000 events per second.

What do you guys recommend.

As per recommendaions from this community I changed these properties for the above mentioned event per second

nifi.cluster.node.connection.timeout=15 sec

nifi.cluster.node.read.timeout=15 sec

nifi.cluster.node.protocol.threads=50

Need suggestions recomendations. I know I have to tune it by changing these properties to reach optimal performance, however a startin value for this nifi.cluster.node.protocol.max.threads=

be awesome

Thanks

Dheeru

Re: Suggested value for properties "nifi.cluster.node.protocol.max.threads"

Wynner — Wed, 01 Nov 2017 03:32:35 GMT

@dhieru singh

If the nifi.cluster.node.protocol.max.threads property is left blank it will default to a value of 50. Which should be more than adequate for most cases. You can set the nifi.cluster.node.protocol.threads=10, that is your lower limit and the max.threads is your upper limit.

How many nodes are in your cluster?

Re: Suggested value for properties "nifi.cluster.node.protocol.max.threads"

dhieru — Wed, 01 Nov 2017 03:36:48 GMT

@Wynner Thanks a lot for theconfirmation, yes I set nifi.cluster.node.protocol.max.threads=50 and nifi.cluster.node.protocol.threads=49, I have 5 nodes in a cluster 16 cores

Re: Suggested value for properties "nifi.cluster.node.protocol.max.threads"

Wynner — Wed, 01 Nov 2017 19:46:23 GMT

@dhieru singh

With 5 nodes, I would set the nifi.cluster.node.read.timeout and nifi.cluster.node.connection.timeout to 60 secs. In addition, I would set the nifi.cluster.protocol.heartbeat.interval to 15 secs instead of the default of 5 secs.

Re: Suggested value for properties "nifi.cluster.node.protocol.max.threads"

nruak — Tue, 22 Feb 2022 20:55:34 GMT

@Wynner @dhieru singh, "nifi.cluster.node.protocol.max.threads=50 and nifi.cluster.node.protocol.threads=49, I have 5 nodes in a cluster 16 cores"
How 50 (other than being default) for max threads and 49 for node protocol is chosen?

Re: Suggested value for properties "nifi.cluster.node.protocol.max.threads"

DianaTorres — Tue, 22 Feb 2022 22:19:34 GMT

@nruak As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks!