Support Questions
Find answers, ask questions, and share your expertise
Alert: Please see the Cloudera blog for information on the Cloudera Response to CVE-2021-4428

How to configure hadoop to reuse JVM for mappers?

Can you explain me how to configure Hadoop to reuse JVM for mappers?


Setting the parameter mapred.job.reuse.jvm.num.tasks=-1 causes the

TaskTracker to reuse jvms for the same job. But it's better to start a new JVM for the tasks(if the tasks are not reasonably small) for long running jobs.If we set thse to (-1)it will reused unlimited time.