Skip to main content
anonymous_123
Bronze ⭐️⭐️⭐️
May 8, 2025
Solved

Resource manager heap calculation

I am running few yarn jobs and sometimes I am seeing the heap utilisation going beyond 80%.
As of now the heap for RM is set as 4GB.
Let me know how to decide the RM heap ?

AyazHussain
Gold ⭐️⭐️⭐️
May 8, 2025

Hi @anonymous_123 ,
Generally the RM heap calculation depends on the yarn.resourcemanager.max-completed-applications value and the number of applications running daily.
Default value for yarn.resourcemanager.max-completed-applications is 10000 but if you see that you dont have enough applications running you can set this to 6000. 
Regarding 4GB heap that is production level RM heap and it is fine if you are not seeing any heap related errors.

1 reply

AyazHussain
Gold ⭐️⭐️⭐️
Gold ⭐️⭐️⭐️
May 8, 2025

Hi @anonymous_123 ,
Generally the RM heap calculation depends on the yarn.resourcemanager.max-completed-applications value and the number of applications running daily.
Default value for yarn.resourcemanager.max-completed-applications is 10000 but if you see that you dont have enough applications running you can set this to 6000. 
Regarding 4GB heap that is production level RM heap and it is fine if you are not seeing any heap related errors.

Translate