Support Questions

Find answers, ask questions, and share your expertise

nifi 1.11.4 ui responding slow

Explorer

Hi,

we are running nifi 1.11.4 version .we had resource issue before recently RAM and CPU core increase in server.

we changed bootstrap.conf file 

java.arg.2=-Xms20g
java.arg.3=-Xmx40g

Total 1100 processors are running in nifi,  around 150+ processor disable (in disable processors have queue with 3GB).

After restart nifi it is working fine for sometime ,after that Nifi ui response is too slowly.

Even for refresh option it is taking 1 minute +.

After sometime we are unable to access nifi ui. it is not loading anything but in server nifi is running telnet is working fine.

os: redhat

RAM : 64 GB

CPU : 16GB

java:1.8

unable to find the actually issue.

 

nifi-api/system-diagnostics

{"systemDiagnostics":{"aggregateSnapshot":{"totalNonHeap":"366 MB","totalNonHeapBytes":383778816,"usedNonHeap":"273.25 MB","usedNonHeapBytes":286525256,"freeNonHeap":"92.75 MB","freeNonHeapBytes":97253560,"maxNonHeap":"-1 bytes","maxNonHeapBytes":-1,"totalHeap":"38.34 GB","totalHeapBytes":41163423744,"usedHeap":"35.97 GB","usedHeapBytes":38624675432,"freeHeap":"2.36 GB","freeHeapBytes":2538748312,"maxHeap":"38.34 GB","maxHeapBytes":41163423744,"heapUtilization":"94.0%","availableProcessors":20,"processorLoadAverage":14.13,"totalThreads":338,"daemonThreads":155,"uptime":"91:55:36.089","flowFileRepositoryStorageUsage":{"freeSpace":"145.38 GB","totalSpace":"300 GB","usedSpace":"154.62 GB","freeSpaceBytes":156101574656,"totalSpaceBytes":322122547200,"usedSpaceBytes":166020972544,"utilization":"52.0%"},"contentRepositoryStorageUsage":[{"identifier":"default","freeSpace":"145.38 GB","totalSpace":"300 GB","usedSpace":"154.62 GB","freeSpaceBytes":156101574656,"totalSpaceBytes":322122547200,"usedSpaceBytes":166020972544,"utilization":"52.0%"}],"provenanceRepositoryStorageUsage":[{"identifier":"default","freeSpace":"145.38 GB","totalSpace":"300 GB","usedSpace":"154.62 GB","freeSpaceBytes":156101574656,"totalSpaceBytes":322122547200,"usedSpaceBytes":166020972544,"utilization":"52.0%"}],"garbageCollection":[{"name":"PS Scavenge","collectionCount":2458,"collectionTime":"00:52:34.376","collectionMillis":3154376},{"name":"PS MarkSweep","collectionCount":4935,"collectionTime":"64:44:42.397","collectionMillis":233082397}],"statsLastRefreshed":"10:40:31 IST","versionInfo":{"niFiVersion":"1.11.4","javaVendor":"Oracle Corporation","javaVersion":"1.8.0_242","osName":"Linux","osVersion":"3.10.0-1062.12.1.el7.x86_64","osArchitecture":"amd64","buildTag":"nifi-1.11.4-RC1","buildTimestamp":"03/18/2020 12:42:54 IST"}}}}
2 REPLIES 2

Rising Star

I've run into similar issues and haven't reached a clear conclusion either. It seems your have very high heap usage which might potentially be relevant. 

Explorer

@Green_ wrote:

I've run into similar issues and haven't reached a clear conclusion either. It seems your have very high heap usage which might potentially be relevant. 


Once we stop nifi then only it is reducing..there is no data in queue but it is in high heap only.. unable to understanding why it is not reducing automatically..