Support Questions

Find answers, ask questions, and share your expertise

datanode with different RAM to utilize the max memory

Hi All,

I wanted to know what parameters needs to be changed we have cluster with nodes of different characteristics in RAM,

Eg: We have 143 datanodes with 256 GB RAM planning to upgrade few datanodes to 512 GB RAM, so how can i make sure YARN utilizes this change. Currently yarn is allocated 168 GB.

I researched and found this which says to add config groups

Is there any detailed document for this, as what settings needs changes.


Expert Contributor

Hi @sudi ts

Create a "Config Group" under YARN Service.

Note, just increasing RAM capacity might not be enough. You may need additional CPUs to handle more jobs / containers.


Add Node Manager Host to this config group

Restart Respective Nodemanagers associated to this config group.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.