Reply
Contributor
Posts: 52
Registered: ‎10-19-2015

JVM reuse in hadoop2

Since JVM reuse is disabled in Hadoop2, how to avoid over head of launching large number of JVMS for small jobs.

Posts: 1,896
Kudos: 433
Solutions: 303
Registered: ‎07-31-2013

Re: JVM reuse in hadoop2

Use the Uber mode, which runs threaded MR within the AM directly. To configure, search for all "uber" named properties under http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-mapreduce-client/hadoop-mapreduce-client-core/m...
Contributor
Posts: 52
Registered: ‎10-19-2015

Re: JVM reuse in hadoop2

Is it ok to run large number of mappers in AM?

Announcements