Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Nifi UI Working very Slow, How to increase performance of a Standalone Nifi-1.1.1 Instance

Solved Go to solution
Highlighted

Nifi UI Working very Slow, How to increase performance of a Standalone Nifi-1.1.1 Instance

New Contributor

Hi All,

We have Nifi-1.1.1 installed on hdp 2.6.3, standalone instance. The UI has become very slow, it takes more than a minute to move between process-groups, also many a times while entering into a process-group the cursor returns back to the Nifi-Flow root window. Also CPU Usage goes to 500 % and memory usage to 10 percent when only 115 processors are running and rest (2k) processors are stopped.

Could you please suggest some settings to improve the performance of UI :

I have applied all settings in nifi.properties & bootstrap.conf files according to this article by @Matt Clarke:

https://community.hortonworks.com/articles/7882/hdfnifi-best-practices-for-setting-up-a-high-perfo.h...

Server Disc Space Details:

total used free shared buffers cached Mem:

120G 73G 46G 40G 488M 43G

-/+ buffers/cache: 29G 90G Swap: 511M 0B 511M

CPU Usage Details:

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND

118806 root 20 0 19.7g 10g 103m S 455.0 9.0 559:31.81 java


Canvas Details: (Is processor crowding can be issue for slowness?)

20385 Processors Stopped

2524 Disabled

115 Running

@Matt Burgess,@Mark Payne,@Matt Clarke

Please suggest solutions to improve nifi performance.

Thanks in advance!!!!

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Nifi UI Working very Slow, How to increase performance of a Standalone Nifi-1.1.1 Instance

Master Guru
@sri chaturvedi

The large number of stopped processors on your canvas is definitely going to affect the UI performance. NiFi will validate these stopped processors to determine if they are "valid" or "invalid". Considering you have so many stopped processors, this validation will take considerable time and have a considerable affect on UI performance and may even result in nodes disconnecting from NiFi.

-

There is some good news... You are running NiFi 1.1.0. Prior to NIFi 1.1.0, NiFi validated components in all states (Stopped, Started, and disabled). In NiFi 1.1.0 and newer, NiFi only validates "stopped" processors. This means you can improve your NiFi UI performance by simply disabling stopped processors you are not using.
-
You can find more details on this in https://issues.apache.org/jira/browse/NIFI-2996

-

Thank you,

Matt

*** If you found this answer addressed your question, please take a moment to login and click "accept".

3 REPLIES 3

Re: Nifi UI Working very Slow, How to increase performance of a Standalone Nifi-1.1.1 Instance

Master Guru
@sri chaturvedi

The large number of stopped processors on your canvas is definitely going to affect the UI performance. NiFi will validate these stopped processors to determine if they are "valid" or "invalid". Considering you have so many stopped processors, this validation will take considerable time and have a considerable affect on UI performance and may even result in nodes disconnecting from NiFi.

-

There is some good news... You are running NiFi 1.1.0. Prior to NIFi 1.1.0, NiFi validated components in all states (Stopped, Started, and disabled). In NiFi 1.1.0 and newer, NiFi only validates "stopped" processors. This means you can improve your NiFi UI performance by simply disabling stopped processors you are not using.
-
You can find more details on this in https://issues.apache.org/jira/browse/NIFI-2996

-

Thank you,

Matt

*** If you found this answer addressed your question, please take a moment to login and click "accept".

Re: Nifi UI Working very Slow, How to increase performance of a Standalone Nifi-1.1.1 Instance

Master Guru

Re: Nifi UI Working very Slow, How to increase performance of a Standalone Nifi-1.1.1 Instance

New Contributor

Thanks a lot Matt for your valuable inputs on this. I was looking for the solution on this since a long time. I will definitely disable the unused processors and check the performance. Thanks again :-)

Don't have an account?
Coming from Hortonworks? Activate your account here