Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

why more than 30 gb memory for a reduce task is not recommended?

why more than 30 gb memory for a reduce task is not recommended?

Contributor

My cluster is having 188 GB ram on data nodes.
I have given 19 GB for map memory and since we have to assign reduce memory just double of map memory so i have assign 38 GB.
But there is this warning which says more than 30 GB is not recommended.
Any reason?

Don't have an account?
Coming from Hortonworks? Activate your account here