Support Questions
Find answers, ask questions, and share your expertise

Nifi UI is down and Nifi OutOfMemoryError

Explorer

My Nifi UI is down daily in the past few days. I wounder if it is relative to OutOfMemoryError.

Any suggestion on this issue?

1) On the vi nifi-bootstrap_2017-05-13.log file

2017-05-13 02:55:41,053 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" at 2017/05/13 02:55:41 - please wait.

2017-05-13 02:55:41,05ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Heap dump using '/app/Project/nifi-1.1.1/heapdump.20170513.025541.31792.0001.phd' in response to an event

2017-05-13 02:55:48,525 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Heap dump written to /app/Project/nifi-1.1.1/heapdump.20170513.025541.31792.0001.phd

2017-05-13 02:55:48,529 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested System dump using '/app/Project/nifi-1.1.1/core.20170513.025541.31792.0002.dmp' in response to an event

2017-05-13 02:55:56,811 ERROR [NiFi logging handler] org.apache.nifi.StdErr Warning: unable to move dump to "/app/Project/nifi-1.1.1/core.20170513.025541.31792.0002.dmp" across file systems (check kernel core_pattern). Using alternate file location "/var/core/core.20170513.025541.31792.0002.dmp"

2017-05-13 02:55:56,818 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I System dump written to /var/core/core.20170513.025541.31792.0002.dmp

2017-05-13 02:55:56,818 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Java dump using '/app/Project/nifi-1.1.1/javacore.20170513.025541.31792.0003.txt' in response to an event

2017-05-13 02:55:56,971 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Java dump written to /app/Project/nifi-1.1.1/javacore.20170513.025541.31792.0003.txt

2017-05-13 02:55:56,972 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Snap dump using '/app/Project/nifi-1.1.1/Snap.20170513.025541.31792.0005.trc' in response to an event

2017-05-13 02:55:56,972 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Snap dump written to /app/Project/nifi-1.1.1/Snap.20170513.025541.31792.0005.trc

2017-05-13 02:55:56,973 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".

2017-05-13 02:55:56,974 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Heap dump using '/app/Project/nifi-1.1.1/heapdump.20170513.025541.31792.0004.phd' in response to an event

2017-05-13 02:56:05,809 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Heap dump written to /app/Project/nifi-1.1.1/heapdump.20170513.025541.31792.0004.phd 2017-05-13 02:56:05,810 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Java dump using '/app/Project/nifi-1.1.1/javacore.20170513.025541.31792.0006.txt' in response to an event 2017-05-13 02:56:05,970 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Java dump written to /app/Project/nifi-1.1.1/javacore.20170513.025541.31792.0006.txt 2017-05-13 02:56:05,970 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" at 2017/05/13 02:56:05 - please wait.

2017-05-13 02:56:05,970 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Snap dump using '/app/Project/nifi-1.1.1/Snap.20170513.025541.31792.0007.trc' in response to an event

2017-05-13 02:56:05,970 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Snap dump written to /app/Project/nifi-1.1.1/Snap.20170513.025541.31792.0007.trc

2017-05-13 02:56:05,970 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".

2017-05-13 02:56:05,971 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Heap dump using '/app/Project/nifi-1.1.1/heapdump.20170513.025605.31792.0008.phd' in response to an event 2017-05-13 02:56:14,533 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Heap dump written to /app/Project/nifi-1.1.1/heapdump.20170513.025605.31792.0008.phd

2017-05-13 02:56:22,867 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Java dump using '/app/Project/nifi-1.1.1/javacore.20170513.025605.31792.0009.txt' in response to an event

2017-05-13 02:56:23,055 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Java dump written to /app/Project/nifi-1.1.1/javacore.20170513.025605.31792.0009.txt

2017-05-13 02:56:23,064 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP032I JVM requested Snap dump using '/app/Project/nifi-1.1.1/Snap.

20170513.025605.31792.0010.trc' in response to an event 2017-05-13 02:56:23,064 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP010I Snap dump written to /app/Project/nifi-1.1.1/Snap.

20170513.025605.31792.0010.trc 2017-05-13 02:56:23,065 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".

2017-05-13 02:56:23,073 ERROR [NiFi logging handler] org.apache.nifi.StdErr JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" at 2017/05/13 02:56:23 - please wait.

2 REPLIES 2

Hi, the default NIFI memory settings are usually to low (512MB). Check your current maximum memory allocation pool setting (Xmx) for the NIFI JVM. Try to set it to about 80% of your available memory. Then keep an eye of the memory consumption of your flow for a few days (e.g. with a NIFI monitoring task), and see if the high mark is hit and you can a) optimize your flow, or b) assign/add more memory

New Contributor

Hi, you can increase your memory by editing bootstrap.conf file. See the lines below.

# JVM memory settings
java.arg.2Xms512m
java.arg.3=-Xmx512m