https://community.cloudera.com/t5/Archives-of-Support-Questions/Is-it-possible-to-dynamically-set-map-and-reduce-memory-for/m-p/226111#M72717 Mon, 18 Dec 2017 21:03:46 GMT phoncy_joseph 2017-12-18T21:03:46Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Is-it-possible-to-dynamically-set-map-and-reduce-memory-for/m-p/226111#M72717 Mon, 18 Dec 2017 21:03:46 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Is-it-possible-to-dynamically-set-map-and-reduce-memory-for/m-p/226111#M72717 phoncy_joseph 2017-12-18T21:03:46Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Is-it-possible-to-dynamically-set-map-and-reduce-memory-for/m-p/226112#M72718 <P><A rel="user" href="https://community.cloudera.com/users/2713/phoncyjoseph.html" nodeid="2713">@Phoncy Joseph</A> </P><P>The configs can be changed when you are submitting the job and not while the job is running. Below are the configs to change them while submitting the job.</P><PRE>-Dmapreduce.map.memory.mb=2048 -Dmapreduce.reduce.memory.mb=2048</PRE> Tue, 19 Dec 2017 02:42:42 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Is-it-possible-to-dynamically-set-map-and-reduce-memory-for/m-p/226112#M72718 sandyy006 2017-12-19T02:42:42Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Is-it-possible-to-dynamically-set-map-and-reduce-memory-for/m-p/226113#M72719 <P>Thanks for the response. I wanted to know if the memory assignment could be done, without providing these while submitting jobs. </P> Tue, 19 Dec 2017 21:31:52 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Is-it-possible-to-dynamically-set-map-and-reduce-memory-for/m-p/226113#M72719 phoncy_joseph 2017-12-19T21:31:52Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Is-it-possible-to-dynamically-set-map-and-reduce-memory-for/m-p/226114#M72720 <P><A rel="user" href="https://community.cloudera.com/users/2713/phoncyjoseph.html" nodeid="2713">@Phoncy Joseph</A> There are only 3 ways as of now: </P><P>- Global configs which are in mapred-site.xml</P><P>- Passing through command line while submitting the job</P><P>- Hardcode in the code(although this is not dynamic).</P> Tue, 19 Dec 2017 23:26:10 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Is-it-possible-to-dynamically-set-map-and-reduce-memory-for/m-p/226114#M72720 sandyy006 2017-12-19T23:26:10Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Is-it-possible-to-dynamically-set-map-and-reduce-memory-for/m-p/226115#M72721 <P>Thank you </P> Fri, 22 Dec 2017 19:15:23 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Is-it-possible-to-dynamically-set-map-and-reduce-memory-for/m-p/226115#M72721 phoncy_joseph 2017-12-22T19:15:23Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Is-it-possible-to-dynamically-set-map-and-reduce-memory-for/m-p/226116#M72722 <P><A rel="user" href="https://community.cloudera.com/users/2713/phoncyjoseph.html" nodeid="2713">@Phoncy Joseph</A> You're welcome. Feel free to accept the answer if this helps you.</P> Fri, 22 Dec 2017 19:45:02 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Is-it-possible-to-dynamically-set-map-and-reduce-memory-for/m-p/226116#M72722 sandyy006 2017-12-22T19:45:02Z