Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to configure hadoop to reuse JVM for mappers?

How to configure hadoop to reuse JVM for mappers?

Can you explain me how to configure Hadoop to reuse JVM for mappers?

1 REPLY 1
Highlighted

Re: How to configure hadoop to reuse JVM for mappers?

Setting the parameter mapred.job.reuse.jvm.num.tasks=-1 causes the

TaskTracker to reuse jvms for the same job. But it's better to start a new JVM for the tasks(if the tasks are not reasonably small) for long running jobs.If we set thse to (-1)it will reused unlimited time.

Don't have an account?
Coming from Hortonworks? Activate your account here