Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Nifi UI is down and Nifi OutOfMemoryError

Nifi UI is down and Nifi OutOfMemoryError

New Contributor

My Nifi UI is down daily in the past few days. I wounder if it is relative to OutOfMemoryError.

Any suggestion on this issue?

1) On the vi nifi-bootstrap_2017-05-13.log file

2017-05-13 02:55:41,053 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" at 2017/05/13 02:55:41 - please wait.

2017-05-13 02:55:41,05ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Heap dump using '/app/Project/nifi-1.1.1/heapdump.20170513.025541.31792.0001.phd' in response to an event

2017-05-13 02:55:48,525 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Heap dump written to /app/Project/nifi-1.1.1/heapdump.20170513.025541.31792.0001.phd

2017-05-13 02:55:48,529 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested System dump using '/app/Project/nifi-1.1.1/core.20170513.025541.31792.0002.dmp' in response to an event

2017-05-13 02:55:56,811 ERROR [NiFi logging handler] org.apache.nifi.StdErr Warning: unable to move dump to "/app/Project/nifi-1.1.1/core.20170513.025541.31792.0002.dmp" across file systems (check kernel core_pattern). Using alternate file location "/var/core/core.20170513.025541.31792.0002.dmp"

2017-05-13 02:55:56,818 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I System dump written to /var/core/core.20170513.025541.31792.0002.dmp

2017-05-13 02:55:56,818 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Java dump using '/app/Project/nifi-1.1.1/javacore.20170513.025541.31792.0003.txt' in response to an event

2017-05-13 02:55:56,971 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Java dump written to /app/Project/nifi-1.1.1/javacore.20170513.025541.31792.0003.txt

2017-05-13 02:55:56,972 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Snap dump using '/app/Project/nifi-1.1.1/Snap.20170513.025541.31792.0005.trc' in response to an event

2017-05-13 02:55:56,972 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Snap dump written to /app/Project/nifi-1.1.1/Snap.20170513.025541.31792.0005.trc

2017-05-13 02:55:56,973 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".

2017-05-13 02:55:56,974 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Heap dump using '/app/Project/nifi-1.1.1/heapdump.20170513.025541.31792.0004.phd' in response to an event

2017-05-13 02:56:05,809 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Heap dump written to /app/Project/nifi-1.1.1/heapdump.20170513.025541.31792.0004.phd 2017-05-13 02:56:05,810 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Java dump using '/app/Project/nifi-1.1.1/javacore.20170513.025541.31792.0006.txt' in response to an event 2017-05-13 02:56:05,970 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Java dump written to /app/Project/nifi-1.1.1/javacore.20170513.025541.31792.0006.txt 2017-05-13 02:56:05,970 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" at 2017/05/13 02:56:05 - please wait.

2017-05-13 02:56:05,970 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Snap dump using '/app/Project/nifi-1.1.1/Snap.20170513.025541.31792.0007.trc' in response to an event

2017-05-13 02:56:05,970 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Snap dump written to /app/Project/nifi-1.1.1/Snap.20170513.025541.31792.0007.trc

2017-05-13 02:56:05,970 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".

2017-05-13 02:56:05,971 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Heap dump using '/app/Project/nifi-1.1.1/heapdump.20170513.025605.31792.0008.phd' in response to an event 2017-05-13 02:56:14,533 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Heap dump written to /app/Project/nifi-1.1.1/heapdump.20170513.025605.31792.0008.phd

2017-05-13 02:56:22,867 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Java dump using '/app/Project/nifi-1.1.1/javacore.20170513.025605.31792.0009.txt' in response to an event

2017-05-13 02:56:23,055 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Java dump written to /app/Project/nifi-1.1.1/javacore.20170513.025605.31792.0009.txt

2017-05-13 02:56:23,064 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Snap dump using '/app/Project/nifi-1.1.1/Snap.

20170513.025605.31792.0010.trc' in response to an event 2017-05-13 02:56:23,064 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Snap dump written to /app/Project/nifi-1.1.1/Snap.

20170513.025605.31792.0010.trc 2017-05-13 02:56:23,065 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".

2017-05-13 02:56:23,073 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" at 2017/05/13 02:56:23 - please wait.

2 REPLIES 2

Re: Nifi UI is down and Nifi OutOfMemoryError

Hi, the default NIFI memory settings are usually to low (512MB). Check your current maximum memory allocation pool setting (Xmx) for the NIFI JVM. Try to set it to about 80% of your available memory. Then keep an eye of the memory consumption of your flow for a few days (e.g. with a NIFI monitoring task), and see if the high mark is hit and you can a) optimize your flow, or b) assign/add more memory

Re: Nifi UI is down and Nifi OutOfMemoryError

New Contributor

Hi, you can increase your memory by editing bootstrap.conf file. See the lines below.

# JVM memory settings
java.arg.2Xms512m
java.arg.3=-Xmx512m