Support Questions
Find answers, ask questions, and share your expertise

Nifi ubnormal nifi process count

Nifi ubnormal nifi process count

Contributor

39856-ubnormal-nifi-count-process.png

39857-maximum-count.png

I see 4958 process (screen - ubnormal nifi count process.png) , but real max process only 1000 ( screen - maximum count.png)

Please help resolve/describe.

2 REPLIES 2

Re: Nifi ubnormal nifi process count

@Dmitro Vasilenko

That number represents the total number of processes across all three nodes. The 1000/1000 is a limitation per node and it is a soft limit, not a hard limit.

FYI, 1000/1000 for Maximum Timer Driven and Maximum Event Driven threads are unrealistic values. The Maximum Number of Timer Driven threads should be between 2 and 4 times the number of CPUs on the nodes. The Maximum Number of Event driven threads should remain at 5.

Re: Nifi ubnormal nifi process count

Master Guru

@Dmitro Vasilenko

In addition to the above correct answer. HDF 3.0 has a bug where the max Event Driven thread pool shows as active threads in the UI. With 1,000 set for Max Event Driven and 3 nodes in your cluster, that accounts for 3,000 of your 4,958 there. Also, if you increase the Max event Driven thread count and then decrease it, the active thread count will still show the higher setting. Only a restart of NiFI will trigger a reduction.

Thanks,

Matt