Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Heap Size is increasing

Heap Size is increasing

Explorer

How to reduce heap size? whether heap size is related to garbage collector? If it is yes then how to run garbage collector manually?

6 REPLIES 6

Re: Heap Size is increasing

@Joshva Peter

What is your specific use case? Are you running NiFi and getting OOM errors?

Your questions are a little vague and need more context.

Re: Heap Size is increasing

Explorer

I am using NiFi but I am not getting OOM error. The process are running faster when we start the cluster but slowly after some time we are seeing slowness in the query run time.

Re: Heap Size is increasing

Explorer

I am using NIFI and there is no error but the process is running slow. When we restart the cluster the process are running faster and then its slowly after sometime the process are running slow.

Re: Heap Size is increasing

@Joshva Peter

There could be a number of things causing the flow to slow down.

How many processors are in the flow? What is the volume of data through the flow? Have you increased the default value for Maximum number of Timer driven threads? How many nodes are in your cluster?

Re: Heap Size is increasing

Explorer

1000 files we are using. Name node server thread 200. 12 nodes in my cluster.

Re: Heap Size is increasing

@Joshva Peter

Do you have HDP and HDF clusters?

I was wanting to know how many NiFi nodes are in your cluster? How many processors are in your NiFi flow?

Don't have an account?
Coming from Hortonworks? Activate your account here