Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

CDH added JobConf 'getMemoryRequiredHelper' has a bug (it shouldn't be using 'int').

CDH added JobConf 'getMemoryRequiredHelper' has a bug (it shouldn't be using 'int').

New Contributor

I'm not sure how to report a bug, so I'll just put this here.

This is a problem because the Cloudera Manager will translate configuration values into bytes.  So, attempting to set memory allocations greater than max int (2G) for reduce or map heaps will generate a number format exception.

2 REPLIES 2

Re: CDH added JobConf 'getMemoryRequiredHelper' has a bug (it shouldn't be using 'int').

New Contributor
I found the cloudera jira, and put this in as a ticket (DISTRO-724)...

Re: CDH added JobConf 'getMemoryRequiredHelper' has a bug (it shouldn't be using 'int').

New Contributor
This apparently is fixed in cdh 5.4.1...