2016-12-30 10:57:46,121 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1483110359030_0003_m_000000_0: Container [pid=9684,containerID=container_e14_1483110359030_0003_01_000002] is running beyond physical memory limits. Current usage: 520.4 MB of 409 MB physical memory used; 4.8 GB of 4.0 GB virtual memory used. Killing container. Dump of the process-tree for container_e14_1483110359030_0003_01_000002 : |- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE |- 9684 9681 9684 9684 (bash) 1 1 115859456 365 /bin/bash -c /usr/jdk64/jdk1.8.0_77/bin/java -server -XX:NewRatio=8 -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.3.0-37 -Xmx300m -Djava.io.tmpdir=/hadoop/yarn/local/usercache/admin/appcache/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/hadoop/yarn/log/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 192.168.1.109 39829 attempt_1483110359030_0003_m_000000_0 15393162788866 1>/hadoop/yarn/log/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002/stdout 2>/hadoop/yarn/log/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002/stderr |- 9700 9684 9684 9684 (java) 1774 57 2122727424 46124 /usr/jdk64/jdk1.8.0_77/bin/java -server -XX:NewRatio=8 -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.3.0-37 -Xmx300m -Djava.io.tmpdir=/hadoop/yarn/local/usercache/admin/appcache/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/hadoop/yarn/log/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog org.apache.hadoop.mapred.YarnChild 192.168.1.109 39829 attempt_1483110359030_0003_m_000000_0 15393162788866 |- 9746 9700 9684 9684 (java) 1890 91 2914295808 86738 /usr/jdk64/jdk1.8.0_77/bin/java -Xmx1024m -Dhdp.version=2.5.3.0-37 -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.3.0-37 -Djava.net.preferIPv4Stack=true -Dhdp.version= -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/var/log/hadoop/yarn -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/usr/hdp/2.5.3.0-37/hadoop -Dhadoop.id.str=yarn -Dhadoop.root.logger=INFO,console -Djava.library.path=:/usr/hdp/2.5.3.0-37/hadoop/lib/native/Linux-amd64-64:/usr/hdp/2.5.3.0-37/hadoop/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.3.0-37 -Dhadoop.log.dir=/var/log/hadoop/yarn -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/usr/hdp/2.5.3.0-37/hadoop -Dhadoop.id.str=yarn -Dhadoop.root.logger=INFO,console -Djava.library.path=:/usr/hdp/2.5.3.0-37/hadoop/lib/native/Linux-amd64-64:/usr/hdp/2.5.3.0-37/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir:/usr/hdp/2.5.3.0-37/hadoop/lib/native/Linux-amd64-64:/usr/hdp/2.5.3.0-37/hadoop/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Dhdp.version=2.5.3.0-37 -Dhadoop.log.dir=/var/log/hadoop/admin -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/usr/hdp/2.5.3.0-37/hadoop -Dhadoop.id.str=admin -Dhadoop.root.logger=INFO,console -Djava.library.path=:/usr/hdp/2.5.3.0-37/hadoop/lib/native/Linux-amd64-64:/usr/hdp/2.5.3.0-37/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir:/usr/hdp/2.5.3.0-37/hadoop/lib/native/Linux-amd64-64:/usr/hdp/2.5.3.0-37/hadoop/lib/native:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir:/usr/hdp/2.5.3.0-37/hadoop/lib/native/Linux-amd64-64:/usr/hdp/2.5.3.0-37/hadoop/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Xmx1024m -Xmx1000m -Dhive.metastore.local=false -Dhive.metastore.uris=thrift://lenu.dom.hdp:9083 -Dhive.metastore.sasl.enabled=false -Dhive.metastore.execute.setugi=true -Dhive.execution.engine=tez -Dpig.log.dir=/hadoop/yarn/local/filecache/12/pig.tar.gz/pig/bin/../logs -Dpig.log.file=pig.log -Dpig.home.dir=/hadoop/yarn/local/filecache/12/pig.tar.gz/pig/bin/.. -Dpig.additional.jars.uris=file:///hadoop/yarn/local/usercache/admin/appcache/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002/hive.tar.gz/hive/lib/hive-metastore-1.2.1000.2.5.3.0-37.jar,file:///hadoop/yarn/local/usercache/admin/appcache/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002/hive.tar.gz/hive/lib/libthrift-0.9.3.jar,file:///hadoop/yarn/local/usercache/admin/appcache/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002/hive.tar.gz/hive/lib/hive-exec-1.2.1000.2.5.3.0-37.jar,file:///hadoop/yarn/local/usercache/admin/appcache/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002/hive.tar.gz/hive/lib/libfb303-0.9.3.jar,file:///hadoop/yarn/local/usercache/admin/appcache/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002/hive.tar.gz/hive/lib/jdo-api-3.0.1.jar,file://,file:///hadoop/yarn/local/usercache/admin/appcache/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002/hive.tar.gz/hive/lib/hive-hbase-handler-1.2.1000.2.5.3.0-37.jar,file:///hadoop/yarn/local/usercache/admin/appcache/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002/hive.tar.gz/hive/hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.5.3.0-37.jar,file://,file:///hadoop/yarn/local/usercache/admin/appcache/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002/hive.tar.gz/hive/hcatalog/share/hcatalog/hive-hcatalog-pig-adapter-1.2.1000.2.5.3.0-37.jar -Xmx1024m -Xmx1024m -Dhadoop.security.logger=INFO,NullAppender org.apache.hadoop.util.RunJar /hadoop/yarn/local/filecache/12/pig.tar.gz/pig/bin/../pig-0.16.0.2.5.3.0-37-core-h2.jar -Dmapreduce.job.credentials.binary=/hadoop/yarn/local/usercache/admin/appcache/application_1483110359030_0003/container_e14_1483110359030_0003_01_000002/container_tokens -Dmapreduce.job.tags=job_1483110359030_0003 -x tez -file script.pig Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143