Log Type: stderr Log Upload Time: Mon Apr 16 21:33:24 +0200 2018 Log Length: 2251 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/grid/3/hadoop/yarn/local/filecache/25/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/grid/1/hadoop/yarn/local/filecache/223/slf4j-log4j12-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] Apr 16, 2018 9:33:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a provider class Apr 16, 2018 9:33:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class Apr 16, 2018 9:33:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices as a root resource class Apr 16, 2018 9:33:07 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' Apr 16, 2018 9:33:07 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" Apr 16, 2018 9:33:08 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" Apr 16, 2018 9:33:08 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider INFO: Binding org.apache.hadoop.mapreduce.v2.app.webapp.AMWebServices to GuiceManagedComponentProvider with the scope "PerRequest" log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Log Type: stdout Log Upload Time: Mon Apr 16 21:33:24 +0200 2018 Log Length: 0 Log Type: syslog Log Upload Time: Mon Apr 16 21:33:24 +0200 2018 Log Length: 33441 Showing 4096 bytes of 33441 total. Click here for the full log. dler: In stop, writing event JOB_FINISHED 2018-04-16 21:33:16,964 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://ssehdp101.metmom.mmih.biz:8020/user/hdfs/.staging/job_1523861794322_0628/job_1523861794322_0628_1.jhist to hdfs://ssehdp101.metmom.mmih.biz:8020/mr-history/tmp/hdfs/job_1523861794322_0628-1523907149053-hdfs-oozie%3Alauncher%3AT%3Dsqoop%3AW%3Dsqoop%2Dwf%3AA-1523907196844-1-0-SUCCEEDED-Process-1523907189176.jhist_tmp 2018-04-16 21:33:16,993 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://ssehdp101.metmom.mmih.biz:8020/mr-history/tmp/hdfs/job_1523861794322_0628-1523907149053-hdfs-oozie%3Alauncher%3AT%3Dsqoop%3AW%3Dsqoop%2Dwf%3AA-1523907196844-1-0-SUCCEEDED-Process-1523907189176.jhist_tmp 2018-04-16 21:33:16,995 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://ssehdp101.metmom.mmih.biz:8020/user/hdfs/.staging/job_1523861794322_0628/job_1523861794322_0628_1_conf.xml to hdfs://ssehdp101.metmom.mmih.biz:8020/mr-history/tmp/hdfs/job_1523861794322_0628_conf.xml_tmp 2018-04-16 21:33:17,023 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://ssehdp101.metmom.mmih.biz:8020/mr-history/tmp/hdfs/job_1523861794322_0628_conf.xml_tmp 2018-04-16 21:33:17,030 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://ssehdp101.metmom.mmih.biz:8020/mr-history/tmp/hdfs/job_1523861794322_0628.summary_tmp to hdfs://ssehdp101.metmom.mmih.biz:8020/mr-history/tmp/hdfs/job_1523861794322_0628.summary 2018-04-16 21:33:17,031 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://ssehdp101.metmom.mmih.biz:8020/mr-history/tmp/hdfs/job_1523861794322_0628_conf.xml_tmp to hdfs://ssehdp101.metmom.mmih.biz:8020/mr-history/tmp/hdfs/job_1523861794322_0628_conf.xml 2018-04-16 21:33:17,033 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://ssehdp101.metmom.mmih.biz:8020/mr-history/tmp/hdfs/job_1523861794322_0628-1523907149053-hdfs-oozie%3Alauncher%3AT%3Dsqoop%3AW%3Dsqoop%2Dwf%3AA-1523907196844-1-0-SUCCEEDED-Process-1523907189176.jhist_tmp to hdfs://ssehdp101.metmom.mmih.biz:8020/mr-history/tmp/hdfs/job_1523861794322_0628-1523907149053-hdfs-oozie%3Alauncher%3AT%3Dsqoop%3AW%3Dsqoop%2Dwf%3AA-1523907196844-1-0-SUCCEEDED-Process-1523907189176.jhist 2018-04-16 21:33:17,033 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop() 2018-04-16 21:33:17,036 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job diagnostics to 2018-04-16 21:33:17,036 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is http://ssehdp102.metmom.mmih.biz:19888/jobhistory/job/job_1523861794322_0628 2018-04-16 21:33:17,042 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for application to be successfully unregistered. 2018-04-16 21:33:18,044 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0 2018-04-16 21:33:18,047 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://ssehdp101.metmom.mmih.biz:8020 /user/hdfs/.staging/job_1523861794322_0628 2018-04-16 21:33:18,070 INFO [Thread-68] org.apache.hadoop.ipc.Server: Stopping server on 45385 2018-04-16 21:33:18,076 INFO [IPC Server listener on 45385] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 45385 2018-04-16 21:33:18,076 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder 2018-04-16 21:33:18,076 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted Log Type: directory.info Log Upload Time: Mon Apr 16 21:33:24 +0200 2018 Log Length: 206359 Showing 4096 bytes of 206359 total. Click here for the full log. tanucleus-core-3.2.10.jar.crc 557070 4 -rw-r--r-- 1 yarn hadoop 2664 Apr 16 21:32 ./spark/.datanucleus-api-jdo-3.2.6.jar.crc 557081 356 -r-xr-xr-x 1 yarn hadoop 358253 Apr 16 21:32 ./spark/pyspark.zip 557083 186592 -r-xr-xr-x 1 yarn hadoop 190876257 Apr 16 21:32 ./spark/spark-assembly-1.6.3.2.6.2.0-205-hadoop2.7.3.2.6.2.0-205.jar 557073 1772 -r-xr-xr-x 1 yarn hadoop 1809447 Apr 16 21:32 ./spark/datanucleus-rdbms-3.2.9.jar 47915401 224 -r-xr-xr-x 1 yarn hadoop 221941 Apr 16 11:52 ./hadoop-aws-2.7.3.2.6.2.0-205.jar 557092 56 -r-xr-xr-x 1 yarn hadoop 49725 Apr 16 21:32 ./hive-ant-1.2.1000.2.6.2.0-205.jar 31195755 580 -r-xr-xr-x 1 yarn hadoop 588337 Apr 16 21:32 ./commons-collections-3.2.2.jar 58998815 236 -r-xr-xr-x 1 yarn hadoop 236660 Apr 16 21:32 ./ST4-4.0.4.jar 47916341 2772 -r-xr-xr-x 1 yarn hadoop 2831358 Apr 16 21:32 ./derby-10.10.1.1.jar 47916622 888 -r-xr-xr-x 1 yarn hadoop 904730 Apr 16 21:32 ./tez-api-0.7.0.2.6.2.0-205.jar 524329 16 -r-xr-xr-x 1 yarn hadoop 15071 Apr 16 21:32 ./transaction-api-1.1.jar 30974545 260 -r-xr-xr-x 1 yarn hadoop 258578 Apr 16 11:52 ./aws-java-sdk-kms-1.10.6.jar 40878641 20 -r-xr-xr-x 1 yarn hadoop 20479 Apr 16 21:32 ./oozie-sharelib-hive-4.2.0.2.6.2.0-205.jar 31072668 764 -r-xr-xr-x 1 yarn hadoop 778089 Apr 16 11:52 ./azure-storage-5.3.0.jar 31072665 68 -r-xr-xr-x 1 yarn hadoop 64661 Apr 16 11:52 ./okio-1.4.0.jar 30974551 564 -r-xr-xr-x 1 yarn hadoop 570101 Apr 16 11:52 ./aws-java-sdk-s3-1.10.6.jar 17171818 416 -r-xr-xr-x 1 yarn hadoop 420458 Apr 16 21:32 ./hadoop-yarn-server-common-2.7.3.2.6.2.0-205.jar 17072649 3556 -r-xr-xr-x 1 yarn hadoop 3636386 Apr 16 21:32 ./db2jcc.jar 40911089 4 -rwx------ 1 yarn hadoop 681 Apr 16 21:33 ./default_container_executor_session.sh 40911084 4 drwx--x--- 2 yarn hadoop 4096 Apr 16 21:33 ./tmp 47898690 1616 -r-xr-xr-x 1 yarn hadoop 1648200 Apr 16 11:52 ./guava-11.0.2.jar 31072658 636 -r-xr-xr-x 1 yarn hadoop 643727 Apr 16 11:52 ./hsqldb-1.8.0.7.jar 549648 1216 -r-xr-xr-x 1 yarn hadoop 1240394 Apr 16 21:32 ./tez-dag-0.7.0.2.6.2.0-205.jar 557101 1260 -r-xr-xr-x 1 yarn hadoop 1282424 Apr 16 21:32 ./ivy-2.4.0.jar 40878644 36 -r-xr-xr-x 1 yarn hadoop 33031 Apr 16 21:32 ./jsr305-2.0.3.jar 40878622 1648 -r-xr-xr-x 1 yarn hadoop 1681148 Apr 16 21:32 ./jetty-all-7.6.0.v20120127.jar 17171502 68 -r-xr-xr-x 1 yarn hadoop 62983 Apr 16 21:32 ./activation-1.1.jar 40878629 28 -r-xr-xr-x 1 yarn hadoop 27160 Apr 16 21:32 ./tez-yarn-timeline-history-0.7.0.2.6.2.0-205.jar 31195758 16 -r-xr-xr-x 1 yarn hadoop 14786 Apr 16 21:32 ./jersey-guice-1.9.jar 31195890 132 -r-xr-xr-x 1 yarn hadoop 130458 Apr 16 21:32 ./jersey-client-1.9.jar 47916625 100 -r-xr-xr-x 1 yarn hadoop 96221 Apr 16 21:32 ./commons-pool-1.5.4.jar 549270 16 -r-xr-xr-x 1 yarn hadoop 13647 Apr 16 11:52 ./oozie-sharelib-sqoop-4.2.0.2.6.2.0-205.jar 47916908 44 -r-xr-xr-x 1 yarn hadoop 41123 Apr 16 21:32 ./commons-cli-1.2.jar 31195906 540 -r-xr-xr-x 1 yarn hadoop 545178 Apr 16 21:32 ./zookeeper-3.4.6.2.6.2.0-205-tests.jar 17171518 2840 -r-xr-xr-x 1 yarn hadoop 2902379 Apr 16 21:32 ./parquet-hadoop-bundle-1.8.1.jar 47882767 1048 -r-xr-xr-x 1 yarn hadoop 1067552 Apr 16 11:52 ./sqoop-1.4.6.2.6.2.0-205.jar 549663 260 -r-xr-xr-x 1 yarn hadoop 261809 Apr 16 21:32 ./commons-lang-2.4.jar 557104 544 -r-xr-xr-x 1 yarn hadoop 549161 Apr 16 21:32 ./tez-runtime-library-0.7.0.2.6.2.0-205.jar 47916634 12 -r-xr-xr-x 1 yarn hadoop 12131 Apr 16 21:32 ./jpam-1.1.jar 40731145 32 -r-xr-xr-x 1 yarn hadoop 29555 Apr 16 21:32 ./paranamer-2.3.jar 557098 136 -r-xr-xr-x 1 yarn hadoop 132368 Apr 16 21:32 ./servlet-api-2.5-6.1.14.jar broken symlinks(find -L . -maxdepth 5 -type l -ls): Log Type: launch_container.sh Log Upload Time: Mon Apr 16 21:33:24 +0200 2018 Log Length: 43548 Showing 4096 bytes of 43548 total. Click here for the full log. rcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/grid/4/hadoop/yarn/local/filecache/71/avro-1.8.0.jar" "avro-1.8.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/grid/5/hadoop/yarn/local/filecache/98/libfb303-0.9.3.jar" "libfb303-0.9.3.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/grid/5/hadoop/yarn/local/filecache/132/hadoop-annotations-2.7.3.2.6.2.0-205.jar" "hadoop-annotations-2.7.3.2.6.2.0-205.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/grid/3/hadoop/yarn/local/filecache/89/hadoop-aws-2.7.3.2.6.2.0-205.jar" "hadoop-aws-2.7.3.2.6.2.0-205.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/grid/1/hadoop/yarn/local/filecache/199/tez-yarn-timeline-history-0.7.0.2.6.2.0-205.jar" "tez-yarn-timeline-history-0.7.0.2.6.2.0-205.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/grid/4/hadoop/yarn/local/filecache/96/azure-storage-5.3.0.jar" "azure-storage-5.3.0.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/grid/0/hadoop/yarn/local/filecache/136/javax.jdo-3.2.0-m3.jar" "javax.jdo-3.2.0-m3.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/grid/4/hadoop/yarn/local/filecache/191/avatica-1.8.0.2.6.2.0-205.jar" "avatica-1.8.0.2.6.2.0-205.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/grid/3/hadoop/yarn/local/filecache/127/distcp" "distcp" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi ln -sf "/grid/0/hadoop/yarn/local/filecache/179/commons-compress-1.4.1.jar" "commons-compress-1.4.1.jar" hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi # Creating copy of launch script cp "launch_container.sh" "/opt/hadoop/yarn/log/application_1523861794322_0628/container_e36_1523861794322_0628_01_000001/launch_container.sh" chmod 640 "/opt/hadoop/yarn/log/application_1523861794322_0628/container_e36_1523861794322_0628_01_000001/launch_container.sh" # Determining directory contents echo "ls -l:" 1>"/opt/hadoop/yarn/log/application_1523861794322_0628/container_e36_1523861794322_0628_01_000001/directory.info" ls -l 1>>"/opt/hadoop/yarn/log/application_1523861794322_0628/container_e36_1523861794322_0628_01_000001/directory.info" echo "find -L . -maxdepth 5 -ls:" 1>>"/opt/hadoop/yarn/log/application_1523861794322_0628/container_e36_1523861794322_0628_01_000001/directory.info" find -L . -maxdepth 5 -ls 1>>"/opt/hadoop/yarn/log/application_1523861794322_0628/container_e36_1523861794322_0628_01_000001/directory.info" echo "broken symlinks(find -L . -maxdepth 5 -type l -ls):" 1>>"/opt/hadoop/yarn/log/application_1523861794322_0628/container_e36_1523861794322_0628_01_000001/directory.info" find -L . -maxdepth 5 -type l -ls 1>>"/opt/hadoop/yarn/log/application_1523861794322_0628/container_e36_1523861794322_0628_01_000001/directory.info" exec /bin/bash -c "$JAVA_HOME/bin/java -Djava.io.tmpdir=$PWD/tmp -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=/grid/2/hadoop/yarn/log/application_1523861794322_0628/container_e36_1523861794322_0628_01_000001 -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog -Dhdp.version=2.6.2.0-205 -Xmx1638m -Dhdp.version=2.6.2.0-205 -Djava.io.tmpdir=./tmp org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1>/grid/2/hadoop/yarn/log/application_1523861794322_0628/container_e36_1523861794322_0628_01_000001/stdout 2>/grid/2/hadoop/yarn/log/application_1523861794322_0628/container_e36_1523861794322_0628_01_000001/stderr " hadoop_shell_errorcode=$? if [ $hadoop_shell_errorcode -ne 0 ] then exit $hadoop_shell_errorcode fi