question Re: Hadoop not utilizing available memory in Archives of Support Questions (Read Only)

Hadoop not utilizing available memory

Bahubali Jain — Fri, 16 Sep 2022 09:36:36 GMT

Hi,

I have a 2 node cluster (each node having 32 GB RAM and 8 Cores). I have installed CDH 5.4.

But I dont think the available memory is being utilized by hadoop, as the page :8088/cluster/apps shows up only 16 GB in "Memory Total" column.

Only once I could see that the "Memory Total " as 64GB, not sure whats going on.

What could be the reason?

Thanks,

Baahu

Bahubali Jain — Sun, 02 Aug 2015 10:40:32 GMT

The yarn.nodemanager.resource.memory-mb parameter was set to 8GB which was causing the problem.

I have reset this to a higher value , which helped me resolve this behavior.

cjervis — Sun, 02 Aug 2015 12:57:09 GMT

Congratulations on solving your issue. Thank you for sharing the solution as it may also help others. 🙂