- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Error occurred during initialization of VM
Created on ‎03-11-2016 01:14 PM - edited ‎09-16-2022 03:08 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am trying to run sample hadoop example jobs on the new cluster with CDH 5.6.0
/usr/bin/yarn jar /usr/lib/hadoop-0.20-mapreduce/hadoop-examples.jar pi 16 100Number of Maps = 16Samples per Map = 100Wrote input for Map #0Wrote input for Map #1Wrote input for Map #2Wrote input for Map #3Wrote input for Map #4Wrote input for Map #5Wrote input for Map #6Wrote input for Map #7Wrote input for Map #8Wrote input for Map #9Wrote input for Map #10Wrote input for Map #11Wrote input for Map #12Wrote input for Map #13Wrote input for Map #14Wrote input for Map #15Starting Job16/03/11 15:24:19 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm7316/03/11 15:24:19 INFO input.FileInputFormat: Total input paths to process : 1616/03/11 15:24:19 INFO mapreduce.JobSubmitter: number of splits:1616/03/11 15:24:19 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1457718893017_000416/03/11 15:24:20 INFO impl.YarnClientImpl: Submitted application application_1457718893017_000416/03/11 15:24:20 INFO mapreduce.Job: The url to track the job: http://hmn002.dev.abc.com:8088/proxy/application_1457718893017_0004/16/03/11 15:24:20 INFO mapreduce.Job: Running job: job_1457718893017_000416/03/11 15:24:25 INFO mapreduce.Job: Job job_1457718893017_0004 running in uber mode : false16/03/11 15:24:25 INFO mapreduce.Job: map 0% reduce 0%16/03/11 15:24:27 INFO mapreduce.Job: Task Id : attempt_1457718893017_0004_m_000004_0, Status : FAILEDException from container-launch.Container id: container_1457718893017_0004_01_000005Exit code: 1Stack trace: ExitCodeException exitCode=1:at org.apache.hadoop.util.Shell.runCommand(Shell.java:561)at org.apache.hadoop.util.Shell.run(Shell.java:478)at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:738)at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:210)at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)at java.util.concurrent.FutureTask.run(FutureTask.java:262)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)at java.lang.Thread.run(Thread.java:745)Container exited with a non-zero exit code 116/03/11 15:24:27 INFO mapreduce.Job: Task Id : attempt_1457718893017_0004_m_000007_0, Status : FAILEDException from container-launch.Container id: container_1457718893017_0004_01_000009Exit code: 1Stack trace: ExitCodeException exitCode=1:at org.apache.hadoop.util.Shell.runCommand(Shell.java:561)at org.apache.hadoop.util.Shell.run(Shell.java:478)at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:738)at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:210)at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)at java.util.concurrent.FutureTask.run(FutureTask.java:262)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)at java.lang.Thread.run(Thread.java:745)Container exited with a non-zero exit code 1
Log Type: stderr
Log Upload Time: Fri Mar 11 20:24:44 +0000 2016
Log Length: 108
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.Log Type: stdout
Log Upload Time: Fri Mar 11 20:24:44 +0000 2016
Log Length: 90
Error occurred during initialization of VM
Could not reserve enough space for object heap
Created ‎03-16-2016 09:52 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Roy,
It seems like your JVM Heap sizes configured incorrectly. Better check the JVM opts and heap spaces. (Since it is not able to launch vm)
Sathish (Satz)
Created ‎03-16-2016 09:52 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Roy,
It seems like your JVM Heap sizes configured incorrectly. Better check the JVM opts and heap spaces. (Since it is not able to launch vm)
Sathish (Satz)
Created ‎07-13-2017 03:28 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Starting a JVM like below will start it with 256MB of memory, and will allow the process to use up to 2048MB of memory:
java -Xmx2048m -Xms256m
More about...memory management
