Nifi UI Working very Slow, How to increase performance of a Standalone Nifi-1.1.1 Instance

[#1]

Hi All,

We have Nifi-1.1.1 installed on hdp 2.6.3, standalone instance. The UI has become very slow, it takes more than a minute to move between process-groups, also many a times while entering into a process-group the cursor returns back to the Nifi-Flow root window. Also CPU Usage goes to 500 % and memory usage to 10 percent when only 115 processors are running and rest (2k) processors are stopped.

Could you please suggest some settings to improve the performance of UI :

I have applied all settings in nifi.properties & bootstrap.conf files according to this article by @Matt Clarke:

https://community.hortonworks.com/articles/7882/hdfnifi-best-practices-for-setting-up-a-high-perfo.h...

Server Disc Space Details:

total used free shared buffers cached Mem:

120G 73G 46G 40G 488M 43G

-/+ buffers/cache: 29G 90G Swap: 511M 0B 511M

CPU Usage Details:

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND

118806 root 20 0 19.7g 10g 103m S 455.0 9.0 559:31.81 java

Canvas Details: (Is processor crowding can be issue for slowness?)

20385 Processors Stopped

2524 Disabled

115 Running

@Matt Burgess,@Mark Payne,@Matt Clarke

Please suggest solutions to improve nifi performance.

Thanks in advance!!!!

[#2 · Accepted solution]

@sri chaturvedi

The large number of stopped processors on your canvas is definitely going to affect the UI performance. NiFi will validate these stopped processors to determine if they are "valid" or "invalid". Considering you have so many stopped processors, this validation will take considerable time and have a considerable affect on UI performance and may even result in nodes disconnecting from NiFi.

-

There is some good news... You are running NiFi 1.1.0. Prior to NIFi 1.1.0, NiFi validated components in all states (Stopped, Started, and disabled). In NiFi 1.1.0 and newer, NiFi only validates "stopped" processors. This means you can improve your NiFi UI performance by simply disabling stopped processors you are not using.
-
You can find more details on this in https://issues.apache.org/jira/browse/NIFI-2996

-

Thank you,

Matt

*** If you found this answer addressed your question, please take a moment to login and click "accept".

[#3]

@sri chaturvedi

I have captured above in a new article:
https://community.hortonworks.com/articles/184786/hdfnifi-improving-the-performance-of-your-ui.html

[#4]

Thanks a lot Matt for your valuable inputs on this. I was looking for the solution on this since a long time. I will definitely disable the unused processors and check the performance. Thanks again 🙂