O RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports.
17/11/08 18:56:21 INFO ShutdownHookManager: Deleting directory /home/dma/tmp/spark-c5e9fb54-b1e7-4c84-9b9a-1385dd9b3032
[root@dma2 dma]# yarn logs -applicationId application_1510146086615_0006
17/11/08 18:56:45 INFO client.RMProxy: Connecting to ResourceManager at dma2.siso.com/107.110.7.59:8050
17/11/08 18:56:45 INFO client.AHSProxy: Connecting to Application History server at dma2.siso.com/107.110.7.59:10200
17/11/08 18:56:46 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
17/11/08 18:56:46 INFO compress.CodecPool: Got brand-new decompressor [.deflate]
Container: container_e11_1510146086615_0006_02_000001 on dma2.siso.com_45454_1510147583137
LogAggregationType: AGGREGATED
==========================================================================================
LogType:directory.info
Log Upload Time:Wed Nov 08 18:56:23 +0530 2017
LogLength:5937
Log Contents:
ls -l:
total 32
-rw-r--r--. 1 yarn hadoop   69 Nov  8 18:56 container_tokens
-rwx------. 1 yarn hadoop  653 Nov  8 18:56 default_container_executor_session.sh
-rwx------. 1 yarn hadoop  707 Nov  8 18:56 default_container_executor.sh
lrwxrwxrwx. 1 yarn hadoop   70 Nov  8 18:56 dma-collect.properties -> /hadoop/yarn/local/usercache/root/filecache/128/dma-collect.properties
-rwx------. 1 yarn hadoop 6125 Nov  8 18:56 launch_container.sh
lrwxrwxrwx. 1 yarn hadoop   85 Nov  8 18:56 __spark_conf__ -> /hadoop/yarn/local/usercache/root/filecache/129/__spark_conf__6272169802038099584.zip
lrwxrwxrwx. 1 yarn hadoop   54 Nov  8 18:56 __spark__.jar -> /hadoop/yarn/local/filecache/13/spark-hdp-assembly.jar
drwx--x---. 2 yarn hadoop 4096 Nov  8 18:56 tmp
find -L . -maxdepth 5 -ls:
8519991    4 drwx--x---   3 yarn     hadoop       4096 Nov  8 18:56 .
8520252    4 -rw-r--r--   1 yarn     hadoop         56 Nov  8 18:56 ./.launch_container.sh.crc
8520254    4 -rw-r--r--   1 yarn     hadoop         16 Nov  8 18:56 ./.default_container_executor_session.sh.crc
8520255    4 -rwx------   1 yarn     hadoop        707 Nov  8 18:56 ./default_container_executor.sh
8520211    4 drwx------   2 yarn     hadoop       4096 Nov  8 18:56 ./__spark_conf__
8520222    4 -r-x------   1 yarn     hadoop       2250 Nov  8 18:56 ./__spark_conf__/yarn-env.cmd
8520231    4 -r-x------   1 yarn     hadoop       1020 Nov  8 18:56 ./__spark_conf__/commons-logging.properties
8520242    8 -r-x------   1 yarn     hadoop       4956 Nov  8 18:56 ./__spark_conf__/metrics.properties
8520233    4 -r-x------   1 yarn     hadoop       2490 Nov  8 18:56 ./__spark_conf__/hadoop-metrics.properties
8520223    4 -r-x------   1 yarn     hadoop        884 Nov  8 18:56 ./__spark_conf__/ssl-client.xml
8520221    4 -r-x------   1 yarn     hadoop       1631 Nov  8 18:56 ./__spark_conf__/kms-log4j.properties
8520227    4 -r-x------   1 yarn     hadoop        758 Nov  8 18:56 ./__spark_conf__/mapred-site.xml.template
8520249   32 -r-x------   1 yarn     hadoop      29534 Nov  8 18:56 ./__spark_conf__/__spark_conf__.properties
8520241    4 -r-x------   1 yarn     hadoop         74 Nov  8 18:56 ./__spark_conf__/topology_mappings.data
8520229    8 -r-x------   1 yarn     hadoop       5319 Nov  8 18:56 ./__spark_conf__/yarn-env.sh
8520240    4 -r-x------   1 yarn     hadoop         15 Nov  8 18:56 ./__spark_conf__/slaves
8520213    4 -r-x------   1 yarn     hadoop        948 Nov  8 18:56 ./__spark_conf__/log4j.properties
8520215    4 -r-x------   1 yarn     hadoop        900 Nov  8 18:56 ./__spark_conf__/hadoop-metrics2.properties
8520226    4 -r-x------   1 yarn     hadoop       2358 Nov  8 18:56 ./__spark_conf__/topology_script.py
8520234    8 -r-x------   1 yarn     hadoop       4221 Nov  8 18:56 ./__spark_conf__/task-log4j.properties
8520218    4 -r-x------   1 yarn     hadoop       3169 Nov  8 18:56 ./__spark_conf__/core-site.xml
8520217   20 -r-x------   1 yarn     hadoop      17487 Nov  8 18:56 ./__spark_conf__/yarn-site.xml
8520225    4 -r-x------   1 yarn     hadoop       3518 Nov  8 18:56 ./__spark_conf__/kms-acls.xml
8520232    4 -r-x------   1 yarn     hadoop       1054 Nov  8 18:56 ./__spark_conf__/container-executor.cfg
8520219    4 -r-x------   1 yarn     hadoop          1 Nov  8 18:56 ./__spark_conf__/dfs.exclude
8520248    8 -r-x------   1 yarn     hadoop       4113 Nov  8 18:56 ./__spark_conf__/mapred-queues.xml.template
8520238    4 -r-x------   1 yarn     hadoop       1527 Nov  8 18:56 ./__spark_conf__/kms-env.sh
8520244    4 -r-x------   1 yarn     hadoop       1000 Nov  8 18:56 ./__spark_conf__/ssl-server.xml
8520224    4 -r-x------   1 yarn     hadoop       2136 Nov  8 18:56 ./__spark_conf__/capacity-scheduler.xml
8520214    8 -r-x------   1 yarn     hadoop       6869 Nov  8 18:56 ./__spark_conf__/mapred-site.xml
8520220    0 -r-x------   1 yarn     hadoop          0 Nov  8 18:56 ./__spark_conf__/yarn.exclude
8520243    4 -r-x------   1 yarn     hadoop        951 Nov  8 18:56 ./__spark_conf__/mapred-env.cmd
8520216    4 -r-x------   1 yarn     hadoop       3979 Nov  8 18:56 ./__spark_conf__/hadoop-env.cmd
8520235    4 -r-x------   1 yarn     hadoop        856 Nov  8 18:56 ./__spark_conf__/mapred-env.sh
8520239    4 -r-x------   1 yarn     hadoop       1308 Nov  8 18:56 ./__spark_conf__/hadoop-policy.xml
8520245    4 -r-x------   1 yarn     hadoop       2697 Nov  8 18:56 ./__spark_conf__/ssl-server.xml.example
8520236    4 -r-x------   1 yarn     hadoop       1602 Nov  8 18:56 ./__spark_conf__/health_check
8520237    4 -r-x------   1 yarn     hadoop       2316 Nov  8 18:56 ./__spark_conf__/ssl-client.xml.example
8520247    4 -r-x------   1 yarn     hadoop        945 Nov  8 18:56 ./__spark_conf__/taskcontroller.cfg
8520228    4 -r-x------   1 yarn     hadoop       1335 Nov  8 18:56 ./__spark_conf__/configuration.xsl
8520212    8 -r-x------   1 yarn     hadoop       6336 Nov  8 18:56 ./__spark_conf__/hadoop-env.sh
8520230    8 -r-x------   1 yarn     hadoop       6752 Nov  8 18:56 ./__spark_conf__/hdfs-site.xml
8520246    8 -r-x------   1 yarn     hadoop       5511 Nov  8 18:56 ./__spark_conf__/kms-site.xml
8520210    4 -rw-r--r--   1 yarn     hadoop         69 Nov  8 18:56 ./container_tokens
8520167    4 -r-x------   1 yarn     hadoop       1890 Nov  8 18:56 ./dma-collect.properties
8520253    4 -rwx------   1 yarn     hadoop        653 Nov  8 18:56 ./default_container_executor_session.sh
8520251    8 -rwx------   1 yarn     hadoop       6125 Nov  8 18:56 ./launch_container.sh
8520209    4 drwx--x---   2 yarn     hadoop       4096 Nov  8 18:56 ./tmp
8520256    4 -rw-r--r--   1 yarn     hadoop         16 Nov  8 18:56 ./.default_container_executor.sh.crc
6949365 186420 -r-xr-xr-x   1 yarn     hadoop   190891225 Oct 12 17:30 ./__spark__.jar
8520250    4 -rw-r--r--   1 yarn     hadoop         12 Nov  8 18:56 ./.container_tokens.crc
broken symlinks(find -L . -maxdepth 5 -type l -ls):

End of LogType:directory.info

LogType:launch_container.sh
Log Upload Time:Wed Nov 08 18:56:23 +0530 2017
LogLength:6125
Log Contents:
#!/bin/bash

export SPARK_YARN_STAGING_DIR=".sparkStaging/application_1510146086615_0006"
export PATH="/usr/sbin:/sbin:/usr/lib/ambari-server/*:/sbin:/usr/sbin:/bin:/usr/bin:/var/lib/ambari-agent"
export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-"/usr/hdp/current/hadoop-client/conf"}
export MAX_APP_ATTEMPTS="2"
export JAVA_HOME=${JAVA_HOME:-"/usr/lib/java-1.8.0/jdk1.8.0_144"}
export SPARK_YARN_CACHE_FILES="hdfs://dma2.siso.com:8020/hdp/apps/2.6.1.0-129/spark/spark-hdp-assembly.jar#__spark__.jar,hdfs://dma2.siso.com:8020/user/root/.sparkStaging/application_1510146086615_0006/dma-collect.properties#dma-collect.properties"
export LANG="en_US.UTF-8"
export APP_SUBMIT_TIME_ENV="1510147576703"
export NM_HOST="dma2.siso.com"
export SPARK_YARN_CACHE_FILES_FILE_SIZES="190891225,1890"
export SPARK_YARN_CACHE_ARCHIVES_TIME_STAMPS="1510147576675"
export LOGNAME="root"
export JVM_PID="$$"
export PWD="/hadoop/yarn/local/usercache/root/appcache/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001"
export LOCAL_DIRS="/hadoop/yarn/local/usercache/root/appcache/application_1510146086615_0006,/hadoop/yarn/local/usercache/root/appcache/application_1510146086615_0006"
export APPLICATION_WEB_PROXY_BASE="/proxy/application_1510146086615_0006"
export NM_HTTP_PORT="8042"
export SPARK_DIST_CLASSPATH=":/home/analytics/sparkServer/lib/*"
export LOG_DIRS="/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001,/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001"
export NM_AUX_SERVICE_mapreduce_shuffle="AAA0+gAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=
"
export NM_PORT="45454"
export SPARK_YARN_CACHE_FILES_TIME_STAMPS="1507722357508,1510147576640"
export USER="root"
export HADOOP_YARN_HOME=${HADOOP_YARN_HOME:-"/usr/hdp/current/hadoop-yarn-nodemanager"}
export CLASSPATH="$PWD:$PWD/__spark_conf__:$PWD/__spark__.jar:/etc/hadoop/conf:/usr/hdp/current/hadoop-client/*:/usr/hdp/current/hadoop-client/lib/*:/usr/hdp/current/hadoop-hdfs-client/*:/usr/hdp/current/hadoop-hdfs-client/lib/*:/usr/hdp/current/hadoop-yarn-client/*:/usr/hdp/current/hadoop-yarn-client/lib/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.6.1.0-129/hadoop/lib/hadoop-lzo-0.6.0.2.6.1.0-129.jar:/etc/hadoop/conf/secure::/home/analytics/sparkServer/lib/*"
export SPARK_YARN_CACHE_ARCHIVES="hdfs://dma2.siso.com:8020/user/root/.sparkStaging/application_1510146086615_0006/__spark_conf__6272169802038099584.zip#__spark_conf__"
export SPARK_YARN_CACHE_ARCHIVES_FILE_SIZES="137810"
export SPARK_YARN_MODE="true"
export SPARK_YARN_CACHE_FILES_VISIBILITIES="PUBLIC,PRIVATE"
export HADOOP_TOKEN_FILE_LOCATION="/hadoop/yarn/local/usercache/root/appcache/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001/container_tokens"
export NM_AUX_SERVICE_spark_shuffle=""
export SPARK_USER="root"
export LOCAL_USER_DIRS="/hadoop/yarn/local/usercache/root/,/hadoop/yarn/local/usercache/root/"
export HADOOP_HOME="/usr/hdp/2.6.1.0-129/hadoop"
export SPARK_YARN_CACHE_ARCHIVES_VISIBILITIES="PRIVATE"
export HOME="/home/"
export NM_AUX_SERVICE_spark2_shuffle=""
export CONTAINER_ID="container_e11_1510146086615_0006_02_000001"
export MALLOC_ARENA_MAX="4"
ln -sf "/hadoop/yarn/local/usercache/root/filecache/129/__spark_conf__6272169802038099584.zip" "__spark_conf__"
hadoop_shell_errorcode=$?
if [ $hadoop_shell_errorcode -ne 0 ]
then
  exit $hadoop_shell_errorcode
fi
ln -sf "/hadoop/yarn/local/filecache/13/spark-hdp-assembly.jar" "__spark__.jar"
hadoop_shell_errorcode=$?
if [ $hadoop_shell_errorcode -ne 0 ]
then
  exit $hadoop_shell_errorcode
fi
ln -sf "/hadoop/yarn/local/usercache/root/filecache/128/dma-collect.properties" "dma-collect.properties"
hadoop_shell_errorcode=$?
if [ $hadoop_shell_errorcode -ne 0 ]
then
  exit $hadoop_shell_errorcode
fi
# Creating copy of launch script
cp "launch_container.sh" "/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001/launch_container.sh"
chmod 640 "/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001/launch_container.sh"
# Determining directory contents
echo "ls -l:" 1>"/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001/directory.info"
ls -l 1>>"/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001/directory.info"
echo "find -L . -maxdepth 5 -ls:" 1>>"/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001/directory.info"
find -L . -maxdepth 5 -ls 1>>"/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001/directory.info"
echo "broken symlinks(find -L . -maxdepth 5 -type l -ls):" 1>>"/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001/directory.info"
find -L . -maxdepth 5 -type l -ls 1>>"/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001/directory.info"
exec /bin/bash -c "$JAVA_HOME/bin/java -server -Xmx512m -Djava.io.tmpdir=$PWD/tmp '-Dhdp.verion=2.6.1.0-129' -Dhdp.version=2.6.1.0-129 -Dspark.yarn.app.container.log.dir=/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001 org.apache.spark.deploy.yarn.ExecutorLauncher --arg '107.110.7.59:50634' --executor-memory 2048m --executor-cores 1 --properties-file $PWD/__spark_conf__/__spark_conf__.properties 1> /hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001/stdout 2> /hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_02_000001/stderr"
hadoop_shell_errorcode=$?
if [ $hadoop_shell_errorcode -ne 0 ]
then
  exit $hadoop_shell_errorcode
fi

End of LogType:launch_container.sh

LogType:stderr
Log Upload Time:Wed Nov 08 18:56:23 +0530 2017
LogLength:4701
Log Contents:
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/hadoop/yarn/local/filecache/13/spark-hdp-assembly.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/2.6.1.0-129/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
17/11/08 18:56:20 INFO ApplicationMaster: Registered signal handlers for [TERM, HUP, INT]
17/11/08 18:56:20 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/11/08 18:56:20 INFO ApplicationMaster: ApplicationAttemptId: appattempt_1510146086615_0006_000002
17/11/08 18:56:21 WARN DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
17/11/08 18:56:21 INFO SecurityManager: Changing view acls to: yarn,root
17/11/08 18:56:21 INFO SecurityManager: Changing modify acls to: yarn,root
17/11/08 18:56:21 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, root); users with modify permissions: Set(yarn, root)
Exception in thread "main" java.lang.ExceptionInInitializerError
        at javax.crypto.JceSecurityManager.<clinit>(JceSecurityManager.java:65)
        at javax.crypto.Cipher.getConfiguredPermission(Cipher.java:2587)
        at javax.crypto.Cipher.getMaxAllowedKeyLength(Cipher.java:2611)
        at sun.security.ssl.CipherSuite$BulkCipher.isUnlimited(CipherSuite.java:535)
        at sun.security.ssl.CipherSuite$BulkCipher.<init>(CipherSuite.java:507)
        at sun.security.ssl.CipherSuite.<clinit>(CipherSuite.java:614)
        at sun.security.ssl.SSLContextImpl.getApplicableCipherSuiteList(SSLContextImpl.java:294)
        at sun.security.ssl.SSLContextImpl.access$100(SSLContextImpl.java:42)
        at sun.security.ssl.SSLContextImpl$AbstractTLSContext.<clinit>(SSLContextImpl.java:425)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:264)
        at java.security.Provider$Service.getImplClass(Provider.java:1634)
        at java.security.Provider$Service.newInstance(Provider.java:1592)
        at sun.security.jca.GetInstance.getInstance(GetInstance.java:236)
        at sun.security.jca.GetInstance.getInstance(GetInstance.java:164)
        at javax.net.ssl.SSLContext.getInstance(SSLContext.java:156)
        at javax.net.ssl.SSLContext.getDefault(SSLContext.java:96)
        at org.apache.spark.SSLOptions.liftedTree1$1(SSLOptions.scala:123)
        at org.apache.spark.SSLOptions.<init>(SSLOptions.scala:115)
        at org.apache.spark.SSLOptions$.parse(SSLOptions.scala:200)
        at org.apache.spark.SecurityManager.<init>(SecurityManager.scala:245)
        at org.apache.spark.deploy.yarn.ApplicationMaster.run(ApplicationMaster.scala:190)
        at org.apache.spark.deploy.yarn.ApplicationMaster$$anonfun$main$1.apply$mcV$sp(ApplicationMaster.scala:674)
        at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:68)
        at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:67)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
        at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:67)
        at org.apache.spark.deploy.yarn.ApplicationMaster$.main(ApplicationMaster.scala:672)
        at org.apache.spark.deploy.yarn.ExecutorLauncher$.main(ApplicationMaster.scala:699)
        at org.apache.spark.deploy.yarn.ExecutorLauncher.main(ApplicationMaster.scala)
Caused by: java.lang.SecurityException: Can not initialize cryptographic mechanism
        at javax.crypto.JceSecurity.<clinit>(JceSecurity.java:88)
        ... 32 more
Caused by: java.lang.SecurityException: Cannot locate policy or framework files!
        at javax.crypto.JceSecurity.setupJurisdictionPolicies(JceSecurity.java:255)
        at javax.crypto.JceSecurity.access$000(JceSecurity.java:48)
        at javax.crypto.JceSecurity$1.run(JceSecurity.java:80)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.crypto.JceSecurity.<clinit>(JceSecurity.java:77)
        ... 32 more
17/11/08 18:56:21 INFO ApplicationMaster: Final app status: UNDEFINED, exitCode: 0, (reason: Shutdown hook called before final status was reported.)
17/11/08 18:56:21 INFO ApplicationMaster: Unregistering ApplicationMaster with UNDEFINED (diag message: Shutdown hook called before final status was reported.)
17/11/08 18:56:21 INFO ApplicationMaster: Deleting staging directory .sparkStaging/application_1510146086615_0006
17/11/08 18:56:21 INFO ShutdownHookManager: Shutdown hook called

End of LogType:stderr

LogType:stdout
Log Upload Time:Wed Nov 08 18:56:23 +0530 2017
LogLength:0
Log Contents:

End of LogType:stdout

Container: container_e11_1510146086615_0006_01_000001 on dma2.siso.com_45454_1510147583137
LogAggregationType: AGGREGATED
==========================================================================================
LogType:directory.info
Log Upload Time:Wed Nov 08 18:56:23 +0530 2017
LogLength:5937
Log Contents:
ls -l:
total 32
-rw-r--r--. 1 yarn hadoop   69 Nov  8 18:56 container_tokens
-rwx------. 1 yarn hadoop  653 Nov  8 18:56 default_container_executor_session.sh
-rwx------. 1 yarn hadoop  707 Nov  8 18:56 default_container_executor.sh
lrwxrwxrwx. 1 yarn hadoop   70 Nov  8 18:56 dma-collect.properties -> /hadoop/yarn/local/usercache/root/filecache/128/dma-collect.properties
-rwx------. 1 yarn hadoop 6125 Nov  8 18:56 launch_container.sh
lrwxrwxrwx. 1 yarn hadoop   85 Nov  8 18:56 __spark_conf__ -> /hadoop/yarn/local/usercache/root/filecache/129/__spark_conf__6272169802038099584.zip
lrwxrwxrwx. 1 yarn hadoop   54 Nov  8 18:56 __spark__.jar -> /hadoop/yarn/local/filecache/13/spark-hdp-assembly.jar
drwx--x---. 2 yarn hadoop 4096 Nov  8 18:56 tmp
find -L . -maxdepth 5 -ls:
8519991    4 drwx--x---   3 yarn     hadoop       4096 Nov  8 18:56 .
8520252    4 -rw-r--r--   1 yarn     hadoop         56 Nov  8 18:56 ./.launch_container.sh.crc
8520254    4 -rw-r--r--   1 yarn     hadoop         16 Nov  8 18:56 ./.default_container_executor_session.sh.crc
8520255    4 -rwx------   1 yarn     hadoop        707 Nov  8 18:56 ./default_container_executor.sh
8520211    4 drwx------   2 yarn     hadoop       4096 Nov  8 18:56 ./__spark_conf__
8520222    4 -r-x------   1 yarn     hadoop       2250 Nov  8 18:56 ./__spark_conf__/yarn-env.cmd
8520231    4 -r-x------   1 yarn     hadoop       1020 Nov  8 18:56 ./__spark_conf__/commons-logging.properties
8520242    8 -r-x------   1 yarn     hadoop       4956 Nov  8 18:56 ./__spark_conf__/metrics.properties
8520233    4 -r-x------   1 yarn     hadoop       2490 Nov  8 18:56 ./__spark_conf__/hadoop-metrics.properties
8520223    4 -r-x------   1 yarn     hadoop        884 Nov  8 18:56 ./__spark_conf__/ssl-client.xml
8520221    4 -r-x------   1 yarn     hadoop       1631 Nov  8 18:56 ./__spark_conf__/kms-log4j.properties
8520227    4 -r-x------   1 yarn     hadoop        758 Nov  8 18:56 ./__spark_conf__/mapred-site.xml.template
8520249   32 -r-x------   1 yarn     hadoop      29534 Nov  8 18:56 ./__spark_conf__/__spark_conf__.properties
8520241    4 -r-x------   1 yarn     hadoop         74 Nov  8 18:56 ./__spark_conf__/topology_mappings.data
8520229    8 -r-x------   1 yarn     hadoop       5319 Nov  8 18:56 ./__spark_conf__/yarn-env.sh
8520240    4 -r-x------   1 yarn     hadoop         15 Nov  8 18:56 ./__spark_conf__/slaves
8520213    4 -r-x------   1 yarn     hadoop        948 Nov  8 18:56 ./__spark_conf__/log4j.properties
8520215    4 -r-x------   1 yarn     hadoop        900 Nov  8 18:56 ./__spark_conf__/hadoop-metrics2.properties
8520226    4 -r-x------   1 yarn     hadoop       2358 Nov  8 18:56 ./__spark_conf__/topology_script.py
8520234    8 -r-x------   1 yarn     hadoop       4221 Nov  8 18:56 ./__spark_conf__/task-log4j.properties
8520218    4 -r-x------   1 yarn     hadoop       3169 Nov  8 18:56 ./__spark_conf__/core-site.xml
8520217   20 -r-x------   1 yarn     hadoop      17487 Nov  8 18:56 ./__spark_conf__/yarn-site.xml
8520225    4 -r-x------   1 yarn     hadoop       3518 Nov  8 18:56 ./__spark_conf__/kms-acls.xml
8520232    4 -r-x------   1 yarn     hadoop       1054 Nov  8 18:56 ./__spark_conf__/container-executor.cfg
8520219    4 -r-x------   1 yarn     hadoop          1 Nov  8 18:56 ./__spark_conf__/dfs.exclude
8520248    8 -r-x------   1 yarn     hadoop       4113 Nov  8 18:56 ./__spark_conf__/mapred-queues.xml.template
8520238    4 -r-x------   1 yarn     hadoop       1527 Nov  8 18:56 ./__spark_conf__/kms-env.sh
8520244    4 -r-x------   1 yarn     hadoop       1000 Nov  8 18:56 ./__spark_conf__/ssl-server.xml
8520224    4 -r-x------   1 yarn     hadoop       2136 Nov  8 18:56 ./__spark_conf__/capacity-scheduler.xml
8520214    8 -r-x------   1 yarn     hadoop       6869 Nov  8 18:56 ./__spark_conf__/mapred-site.xml
8520220    0 -r-x------   1 yarn     hadoop          0 Nov  8 18:56 ./__spark_conf__/yarn.exclude
8520243    4 -r-x------   1 yarn     hadoop        951 Nov  8 18:56 ./__spark_conf__/mapred-env.cmd
8520216    4 -r-x------   1 yarn     hadoop       3979 Nov  8 18:56 ./__spark_conf__/hadoop-env.cmd
8520235    4 -r-x------   1 yarn     hadoop        856 Nov  8 18:56 ./__spark_conf__/mapred-env.sh
8520239    4 -r-x------   1 yarn     hadoop       1308 Nov  8 18:56 ./__spark_conf__/hadoop-policy.xml
8520245    4 -r-x------   1 yarn     hadoop       2697 Nov  8 18:56 ./__spark_conf__/ssl-server.xml.example
8520236    4 -r-x------   1 yarn     hadoop       1602 Nov  8 18:56 ./__spark_conf__/health_check
8520237    4 -r-x------   1 yarn     hadoop       2316 Nov  8 18:56 ./__spark_conf__/ssl-client.xml.example
8520247    4 -r-x------   1 yarn     hadoop        945 Nov  8 18:56 ./__spark_conf__/taskcontroller.cfg
8520228    4 -r-x------   1 yarn     hadoop       1335 Nov  8 18:56 ./__spark_conf__/configuration.xsl
8520212    8 -r-x------   1 yarn     hadoop       6336 Nov  8 18:56 ./__spark_conf__/hadoop-env.sh
8520230    8 -r-x------   1 yarn     hadoop       6752 Nov  8 18:56 ./__spark_conf__/hdfs-site.xml
8520246    8 -r-x------   1 yarn     hadoop       5511 Nov  8 18:56 ./__spark_conf__/kms-site.xml
8520210    4 -rw-r--r--   1 yarn     hadoop         69 Nov  8 18:56 ./container_tokens
8520167    4 -r-x------   1 yarn     hadoop       1890 Nov  8 18:56 ./dma-collect.properties
8520253    4 -rwx------   1 yarn     hadoop        653 Nov  8 18:56 ./default_container_executor_session.sh
8520251    8 -rwx------   1 yarn     hadoop       6125 Nov  8 18:56 ./launch_container.sh
8520209    4 drwx--x---   2 yarn     hadoop       4096 Nov  8 18:56 ./tmp
8520256    4 -rw-r--r--   1 yarn     hadoop         16 Nov  8 18:56 ./.default_container_executor.sh.crc
6949365 186420 -r-xr-xr-x   1 yarn     hadoop   190891225 Oct 12 17:30 ./__spark__.jar
8520250    4 -rw-r--r--   1 yarn     hadoop         12 Nov  8 18:56 ./.container_tokens.crc
broken symlinks(find -L . -maxdepth 5 -type l -ls):

End of LogType:directory.info

LogType:launch_container.sh
Log Upload Time:Wed Nov 08 18:56:23 +0530 2017
LogLength:6125
Log Contents:
#!/bin/bash

export SPARK_YARN_STAGING_DIR=".sparkStaging/application_1510146086615_0006"
export PATH="/usr/sbin:/sbin:/usr/lib/ambari-server/*:/sbin:/usr/sbin:/bin:/usr/bin:/var/lib/ambari-agent"
export HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-"/usr/hdp/current/hadoop-client/conf"}
export MAX_APP_ATTEMPTS="2"
export JAVA_HOME=${JAVA_HOME:-"/usr/lib/java-1.8.0/jdk1.8.0_144"}
export SPARK_YARN_CACHE_FILES="hdfs://dma2.siso.com:8020/hdp/apps/2.6.1.0-129/spark/spark-hdp-assembly.jar#__spark__.jar,hdfs://dma2.siso.com:8020/user/root/.sparkStaging/application_1510146086615_0006/dma-collect.properties#dma-collect.properties"
export LANG="en_US.UTF-8"
export APP_SUBMIT_TIME_ENV="1510147576703"
export NM_HOST="dma2.siso.com"
export SPARK_YARN_CACHE_FILES_FILE_SIZES="190891225,1890"
export SPARK_YARN_CACHE_ARCHIVES_TIME_STAMPS="1510147576675"
export LOGNAME="root"
export JVM_PID="$$"
export PWD="/hadoop/yarn/local/usercache/root/appcache/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001"
export LOCAL_DIRS="/hadoop/yarn/local/usercache/root/appcache/application_1510146086615_0006,/hadoop/yarn/local/usercache/root/appcache/application_1510146086615_0006"
export APPLICATION_WEB_PROXY_BASE="/proxy/application_1510146086615_0006"
export NM_HTTP_PORT="8042"
export SPARK_DIST_CLASSPATH=":/home/analytics/sparkServer/lib/*"
export LOG_DIRS="/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001,/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001"
export NM_AUX_SERVICE_mapreduce_shuffle="AAA0+gAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=
"
export NM_PORT="45454"
export SPARK_YARN_CACHE_FILES_TIME_STAMPS="1507722357508,1510147576640"
export USER="root"
export HADOOP_YARN_HOME=${HADOOP_YARN_HOME:-"/usr/hdp/current/hadoop-yarn-nodemanager"}
export CLASSPATH="$PWD:$PWD/__spark_conf__:$PWD/__spark__.jar:/etc/hadoop/conf:/usr/hdp/current/hadoop-client/*:/usr/hdp/current/hadoop-client/lib/*:/usr/hdp/current/hadoop-hdfs-client/*:/usr/hdp/current/hadoop-hdfs-client/lib/*:/usr/hdp/current/hadoop-yarn-client/*:/usr/hdp/current/hadoop-yarn-client/lib/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.6.1.0-129/hadoop/lib/hadoop-lzo-0.6.0.2.6.1.0-129.jar:/etc/hadoop/conf/secure::/home/analytics/sparkServer/lib/*"
export SPARK_YARN_CACHE_ARCHIVES="hdfs://dma2.siso.com:8020/user/root/.sparkStaging/application_1510146086615_0006/__spark_conf__6272169802038099584.zip#__spark_conf__"
export SPARK_YARN_CACHE_ARCHIVES_FILE_SIZES="137810"
export SPARK_YARN_MODE="true"
export SPARK_YARN_CACHE_FILES_VISIBILITIES="PUBLIC,PRIVATE"
export HADOOP_TOKEN_FILE_LOCATION="/hadoop/yarn/local/usercache/root/appcache/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001/container_tokens"
export NM_AUX_SERVICE_spark_shuffle=""
export SPARK_USER="root"
export LOCAL_USER_DIRS="/hadoop/yarn/local/usercache/root/,/hadoop/yarn/local/usercache/root/"
export HADOOP_HOME="/usr/hdp/2.6.1.0-129/hadoop"
export SPARK_YARN_CACHE_ARCHIVES_VISIBILITIES="PRIVATE"
export HOME="/home/"
export NM_AUX_SERVICE_spark2_shuffle=""
export CONTAINER_ID="container_e11_1510146086615_0006_01_000001"
export MALLOC_ARENA_MAX="4"
ln -sf "/hadoop/yarn/local/usercache/root/filecache/129/__spark_conf__6272169802038099584.zip" "__spark_conf__"
hadoop_shell_errorcode=$?
if [ $hadoop_shell_errorcode -ne 0 ]
then
  exit $hadoop_shell_errorcode
fi
ln -sf "/hadoop/yarn/local/filecache/13/spark-hdp-assembly.jar" "__spark__.jar"
hadoop_shell_errorcode=$?
if [ $hadoop_shell_errorcode -ne 0 ]
then
  exit $hadoop_shell_errorcode
fi
ln -sf "/hadoop/yarn/local/usercache/root/filecache/128/dma-collect.properties" "dma-collect.properties"
hadoop_shell_errorcode=$?
if [ $hadoop_shell_errorcode -ne 0 ]
then
  exit $hadoop_shell_errorcode
fi
# Creating copy of launch script
cp "launch_container.sh" "/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001/launch_container.sh"
chmod 640 "/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001/launch_container.sh"
# Determining directory contents
echo "ls -l:" 1>"/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001/directory.info"
ls -l 1>>"/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001/directory.info"
echo "find -L . -maxdepth 5 -ls:" 1>>"/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001/directory.info"
find -L . -maxdepth 5 -ls 1>>"/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001/directory.info"
echo "broken symlinks(find -L . -maxdepth 5 -type l -ls):" 1>>"/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001/directory.info"
find -L . -maxdepth 5 -type l -ls 1>>"/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001/directory.info"
exec /bin/bash -c "$JAVA_HOME/bin/java -server -Xmx512m -Djava.io.tmpdir=$PWD/tmp '-Dhdp.verion=2.6.1.0-129' -Dhdp.version=2.6.1.0-129 -Dspark.yarn.app.container.log.dir=/hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001 org.apache.spark.deploy.yarn.ExecutorLauncher --arg '107.110.7.59:50634' --executor-memory 2048m --executor-cores 1 --properties-file $PWD/__spark_conf__/__spark_conf__.properties 1> /hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001/stdout 2> /hadoop/yarn/log/application_1510146086615_0006/container_e11_1510146086615_0006_01_000001/stderr"
hadoop_shell_errorcode=$?
if [ $hadoop_shell_errorcode -ne 0 ]
then
  exit $hadoop_shell_errorcode
fi

End of LogType:launch_container.sh

LogType:stderr
Log Upload Time:Wed Nov 08 18:56:23 +0530 2017
LogLength:4427
Log Contents:
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/hadoop/yarn/local/filecache/13/spark-hdp-assembly.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/2.6.1.0-129/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
17/11/08 18:56:18 INFO ApplicationMaster: Registered signal handlers for [TERM, HUP, INT]
17/11/08 18:56:18 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/11/08 18:56:18 INFO ApplicationMaster: ApplicationAttemptId: appattempt_1510146086615_0006_000001
17/11/08 18:56:18 WARN DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
17/11/08 18:56:19 INFO SecurityManager: Changing view acls to: yarn,root
17/11/08 18:56:19 INFO SecurityManager: Changing modify acls to: yarn,root
17/11/08 18:56:19 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, root); users with modify permissions: Set(yarn, root)
Exception in thread "main" java.lang.ExceptionInInitializerError
        at javax.crypto.JceSecurityManager.<clinit>(JceSecurityManager.java:65)
        at javax.crypto.Cipher.getConfiguredPermission(Cipher.java:2587)
        at javax.crypto.Cipher.getMaxAllowedKeyLength(Cipher.java:2611)
        at sun.security.ssl.CipherSuite$BulkCipher.isUnlimited(CipherSuite.java:535)
        at sun.security.ssl.CipherSuite$BulkCipher.<init>(CipherSuite.java:507)
        at sun.security.ssl.CipherSuite.<clinit>(CipherSuite.java:614)
        at sun.security.ssl.SSLContextImpl.getApplicableCipherSuiteList(SSLContextImpl.java:294)
        at sun.security.ssl.SSLContextImpl.access$100(SSLContextImpl.java:42)
        at sun.security.ssl.SSLContextImpl$AbstractTLSContext.<clinit>(SSLContextImpl.java:425)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:264)
        at java.security.Provider$Service.getImplClass(Provider.java:1634)
        at java.security.Provider$Service.newInstance(Provider.java:1592)
        at sun.security.jca.GetInstance.getInstance(GetInstance.java:236)
        at sun.security.jca.GetInstance.getInstance(GetInstance.java:164)
        at javax.net.ssl.SSLContext.getInstance(SSLContext.java:156)
        at javax.net.ssl.SSLContext.getDefault(SSLContext.java:96)
        at org.apache.spark.SSLOptions.liftedTree1$1(SSLOptions.scala:123)
        at org.apache.spark.SSLOptions.<init>(SSLOptions.scala:115)
        at org.apache.spark.SSLOptions$.parse(SSLOptions.scala:200)
        at org.apache.spark.SecurityManager.<init>(SecurityManager.scala:245)
        at org.apache.spark.deploy.yarn.ApplicationMaster.run(ApplicationMaster.scala:190)
        at org.apache.spark.deploy.yarn.ApplicationMaster$$anonfun$main$1.apply$mcV$sp(ApplicationMaster.scala:674)
        at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:68)
        at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:67)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
        at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:67)
        at org.apache.spark.deploy.yarn.ApplicationMaster$.main(ApplicationMaster.scala:672)
        at org.apache.spark.deploy.yarn.ExecutorLauncher$.main(ApplicationMaster.scala:699)
        at org.apache.spark.deploy.yarn.ExecutorLauncher.main(ApplicationMaster.scala)
Caused by: java.lang.SecurityException: Can not initialize cryptographic mechanism
        at javax.crypto.JceSecurity.<clinit>(JceSecurity.java:88)
        ... 32 more
Caused by: java.lang.SecurityException: Cannot locate policy or framework files!
        at javax.crypto.JceSecurity.setupJurisdictionPolicies(JceSecurity.java:255)
        at javax.crypto.JceSecurity.access$000(JceSecurity.java:48)
        at javax.crypto.JceSecurity$1.run(JceSecurity.java:80)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.crypto.JceSecurity.<clinit>(JceSecurity.java:77)
        ... 32 more
17/11/08 18:56:19 INFO ApplicationMaster: Final app status: UNDEFINED, exitCode: 0, (reason: Shutdown hook called before final status was reported.)
17/11/08 18:56:19 INFO ShutdownHookManager: Shutdown hook called

End of LogType:stderr

LogType:stdout
Log Upload Time:Wed Nov 08 18:56:23 +0530 2017
LogLength:0
Log Contents:

End of LogType:stdout