Reply
New Contributor
Posts: 7
Registered: ‎06-14-2017

spark action coordinate use oozie

[ Edited ]

1. master=yarn-cluster is error

2. master=yarn-client is ok

 

oozie version = 4.1.0(release by cloudera)

oozie's sharelib i rebuild totally from right version code(by cloudera)

 

error info:

``` console

Parsed arguments:
  master                  yarn
  deployMode              cluster
  executorMemory          1G
  executorCores           1
  totalExecutorCores      null
  propertiesFile          null
  driverMemory            512m
  driverCores             null
  driverExtraClassPath    $PWD/*
  driverExtraLibraryPath  null
  driverExtraJavaOptions  -Dlog4j.configuration=spark-log4j.properties
  supervise               false
  queue                   null
  numExecutors            3
  files                   hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-format-2.3.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-annotations-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-media-jaxb-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-crypto-1.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-net-3.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.inject-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-graphx_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/httpclient-4.2.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/httpcore-4.2.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/xz-1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-encoding-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spire_2.11-0.7.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-pool-1.5.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-databind-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/derby-10.10.1.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/snappy-java-1.0.4.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/pmml-model-1.2.15.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-lang3-3.3.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/osgi-resource-locator-1.0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/kryo-shaded-3.0.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-graphite-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-sql_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-io-2.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-core-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-math3-3.4.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.servlet-api-3.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-server-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-library-2.11.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-codec-1.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-collections-3.2.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-1.7.6-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-json-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/datanucleus-core-3.2.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-sketch_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/calcite-linq4j-1.2.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.ws.rs-api-2.0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-compress-1.4.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/minlog-1.3.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javassist-3.18.1-GA.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-module-scala_2.11-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-catalyst_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/kryo-2.21.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-network-shuffle_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-ipc-1.7.6-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/libfb303-0.9.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-compiler-3.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/stream-2.7.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-jackson-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/paranamer-2.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-guava-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/json4s-ast_2.11-3.2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-hadoop-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scalap-2.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/reflectasm-1.07-shaded.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scalatest_2.11-2.2.6.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/ivy-2.0.0-rc2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-tags_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/validation-api-1.1.0.Final.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/xbean-asm5-shaded-4.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/netty-all-4.0.42.Final.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/breeze_2.11-0.12.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/unused-1.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/hk2-locator-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-launcher_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/hk2-api-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/calcite-avatica-1.2.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-mllib-local_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/guava-14.0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/chill_2.11-0.8.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/breeze-macros_2.11-0.12.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/asm-4.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/json4s-jackson_2.11-3.2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/hk2-utils-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/calcite-core-1.2.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-jvm-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/aopalliance-repackaged-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jcl-over-slf4j-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/RoaringBitmap-0.5.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/univocity-parsers-2.2.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-core_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/arpack_combined_all-0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-mapper-asl-1.8.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/oozie-sharelib-spark-4.1.0-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/antlr4-runtime-4.5.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-common-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-httpclient-3.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/json4s-core_2.11-3.2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.annotation-api-1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-compiler-2.11.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spire-macros_2.11-0.7.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/oozie/json-simple-1.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-parser-combinators_2.11-1.0.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/zookeeper-3.4.5-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-dbcp-1.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/objenesis-1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-repl_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-common-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/libthrift-0.9.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-lang-2.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-core-asl-1.8.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/compress-lzf-1.0.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-mllib_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/janino-3.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-unsafe_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-container-servlet-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-hive_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/eigenbase-properties-1.1.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-hadoop-bundle-1.6.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/opencsv-2.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-mapred-1.7.6-cdh5.11.0-hadoop2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/joda-time-2.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/slf4j-api-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/minlog-1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-logging-1.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/py4j-0.10.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/pmml-schema-1.2.15.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-ipc-1.7.6-cdh5.11.0-tests.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/chill-java-0.8.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/lz4-1.3.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/oozie/oozie-sharelib-oozie-4.1.0-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/core-1.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-module-paranamer-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/oozie/oozie-hadoop-utils-2.6.0-cdh5.11.0.oozie-4.1.0-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/netty-3.8.0.Final.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/curator-client-2.7.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/log4j-1.2.17.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jets3t-0.6.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-container-servlet-core-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-reflect-2.11.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-xml_2.11-1.0.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jul-to-slf4j-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/leveldbjni-all-1.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jline-2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-streaming_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/curator-framework-2.7.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/oro-2.0.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-column-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/pyrolite-4.13.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/curator-recipes-2.7.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jodd-core-3.5.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-core-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/shapeless_2.11-2.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jsr305-1.3.9.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/slf4j-log4j12-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jtransforms-2.4.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-network-common_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-client-2.22.2.jar
  pyFiles                 null
  archives                null
  mainClass               com.chaosdata.env.WordCount
  primaryResource         file:/usr/local/envtch/ooziejobs/envtest.jar
  name                    Spark wc
  childArgs               []
  jars                    null
  packages                null
  packagesExclusions      null
  repositories            null
  verbose                 true

Spark properties used, including those specified through
 --conf and those from the properties file null:
  spark.oozie.action.id -> 0000026-170614184640118-oozie-root-W@firstdemo
  spark.oozie.HadoopAccessorService.created -> true
  spark.yarn.security.tokens.hive.enabled -> false
  spark.yarn.tags -> oozie-ef69202922e9f03b467c6b1de9c4f5ce
  spark.yarn.jars -> hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-yarn_2.11-2.1.0.jar
  spark.yarn.historyServer.address -> http://master66:18088
  spark.eventLog.enabled -> true
  spark.oozie.job.id -> 0000026-170614184640118-oozie-root-W
  spark.executor.extraJavaOptions -> -Dlog4j.configuration=spark-log4j.properties
  spark.yarn.security.tokens.hbase.enabled -> false
  spark.driver.extraJavaOptions -> -Dlog4j.configuration=spark-log4j.properties
  spark.eventLog.dir -> hdfs://master66:8020/var/log/spark_hislog
  spark.executor.extraClassPath -> $PWD/*
  spark.driver.extraClassPath -> $PWD/*

    
Main class:
org.apache.spark.deploy.yarn.Client
Arguments:
--jar
file:/usr/local/envtch/ooziejobs/envtest.jar
--class
com.chaosdata.env.WordCount
System properties:
spark.oozie.action.id -> 0000026-170614184640118-oozie-root-W@firstdemo
spark.oozie.HadoopAccessorService.created -> true
spark.yarn.security.tokens.hive.enabled -> false
spark.yarn.tags -> oozie-ef69202922e9f03b467c6b1de9c4f5ce
spark.executor.memory -> 1G
spark.driver.memory -> 512m
spark.yarn.jars -> hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-yarn_2.11-2.1.0.jar
spark.executor.instances -> 3
spark.yarn.historyServer.address -> http://master66:18088
spark.eventLog.enabled -> true
spark.yarn.dist.files -> hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-format-2.3.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-annotations-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-media-jaxb-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-crypto-1.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-net-3.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.inject-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-graphx_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/httpclient-4.2.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/httpcore-4.2.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/xz-1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-encoding-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spire_2.11-0.7.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-pool-1.5.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-databind-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/derby-10.10.1.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/snappy-java-1.0.4.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/pmml-model-1.2.15.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-lang3-3.3.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/osgi-resource-locator-1.0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/kryo-shaded-3.0.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-graphite-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-sql_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-io-2.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-core-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-math3-3.4.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.servlet-api-3.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-server-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-library-2.11.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-codec-1.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-collections-3.2.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-1.7.6-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-json-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/datanucleus-core-3.2.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-sketch_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/calcite-linq4j-1.2.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.ws.rs-api-2.0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-compress-1.4.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/minlog-1.3.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javassist-3.18.1-GA.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-module-scala_2.11-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-catalyst_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/kryo-2.21.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-network-shuffle_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-ipc-1.7.6-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/libfb303-0.9.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-compiler-3.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/stream-2.7.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-jackson-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/paranamer-2.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-guava-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/json4s-ast_2.11-3.2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-hadoop-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scalap-2.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/reflectasm-1.07-shaded.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scalatest_2.11-2.2.6.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/ivy-2.0.0-rc2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-tags_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/validation-api-1.1.0.Final.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/xbean-asm5-shaded-4.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/netty-all-4.0.42.Final.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/breeze_2.11-0.12.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/unused-1.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/hk2-locator-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-launcher_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/hk2-api-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/calcite-avatica-1.2.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-mllib-local_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/guava-14.0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/chill_2.11-0.8.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/breeze-macros_2.11-0.12.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/asm-4.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/json4s-jackson_2.11-3.2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/hk2-utils-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/calcite-core-1.2.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-jvm-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/aopalliance-repackaged-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jcl-over-slf4j-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/RoaringBitmap-0.5.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/univocity-parsers-2.2.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-core_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/arpack_combined_all-0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-mapper-asl-1.8.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/oozie-sharelib-spark-4.1.0-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/antlr4-runtime-4.5.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-common-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-httpclient-3.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/json4s-core_2.11-3.2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.annotation-api-1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-compiler-2.11.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spire-macros_2.11-0.7.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/oozie/json-simple-1.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-parser-combinators_2.11-1.0.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/zookeeper-3.4.5-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-dbcp-1.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/objenesis-1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-repl_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-common-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/libthrift-0.9.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-lang-2.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-core-asl-1.8.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/compress-lzf-1.0.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-mllib_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/janino-3.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-unsafe_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-container-servlet-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-hive_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/eigenbase-properties-1.1.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-hadoop-bundle-1.6.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/opencsv-2.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-mapred-1.7.6-cdh5.11.0-hadoop2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/joda-time-2.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/slf4j-api-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/minlog-1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-logging-1.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/py4j-0.10.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/pmml-schema-1.2.15.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-ipc-1.7.6-cdh5.11.0-tests.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/chill-java-0.8.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/lz4-1.3.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/oozie/oozie-sharelib-oozie-4.1.0-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/core-1.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-module-paranamer-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/oozie/oozie-hadoop-utils-2.6.0-cdh5.11.0.oozie-4.1.0-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/netty-3.8.0.Final.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/curator-client-2.7.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/log4j-1.2.17.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jets3t-0.6.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-container-servlet-core-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-reflect-2.11.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-xml_2.11-1.0.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jul-to-slf4j-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/leveldbjni-all-1.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jline-2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-streaming_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/curator-framework-2.7.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/oro-2.0.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-column-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/pyrolite-4.13.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/curator-recipes-2.7.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jodd-core-3.5.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-core-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/shapeless_2.11-2.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jsr305-1.3.9.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/slf4j-log4j12-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jtransforms-2.4.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-network-common_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-client-2.22.2.jar
spark.oozie.job.id -> 0000026-170614184640118-oozie-root-W
SPARK_SUBMIT -> true
spark.executor.extraJavaOptions -> -Dlog4j.configuration=spark-log4j.properties
spark.app.name -> Spark wc
spark.yarn.security.tokens.hbase.enabled -> false
spark.driver.extraJavaOptions -> -Dlog4j.configuration=spark-log4j.properties
spark.submit.deployMode -> cluster
spark.executor.extraClassPath -> $PWD/*
spark.eventLog.dir -> hdfs://master66:8020/var/log/spark_hislog
spark.master -> yarn
spark.executor.cores -> 1
spark.driver.extraClassPath -> $PWD/*
Classpath elements:



Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], main() threw exception, Application application_1497340444423_0534 finished with failed status
org.apache.spark.SparkException: Application application_1497340444423_0534 finished with failed status
	at org.apache.spark.deploy.yarn.Client.run(Client.scala:1167)
	at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1213)
	at org.apache.spark.deploy.yarn.Client.main(Client.scala)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:738)
	at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:187)
	at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:212)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:126)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
	at org.apache.oozie.action.hadoop.SparkMain.runSpark(SparkMain.java:372)
	at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:282)
	at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:64)
	at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:82)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:234)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:388)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:302)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:187)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:230)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).

```

``` console

2017-06-15 10:06:02,097 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - 
	 client token: N/A
	 diagnostics: N/A
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: root.root
	 start time: 1497492361068
	 final status: UNDEFINED
	 tracking URL: http://master66:18088/proxy/application_1497340444423_0534/
	 user: root
2017-06-15 10:06:03,098 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1497340444423_0534 (state: ACCEPTED)
2017-06-15 10:06:04,100 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1497340444423_0534 (state: ACCEPTED)
2017-06-15 10:06:04,350 [communication thread] INFO  org.apache.hadoop.mapred.TaskAttemptListenerImpl  - Progress of TaskAttempt attempt_1497340444423_0533_m_000000_0 is : 1.0
2017-06-15 10:06:05,102 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1497340444423_0534 (state: ACCEPTED)
2017-06-15 10:06:06,104 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1497340444423_0534 (state: ACCEPTED)
2017-06-15 10:06:07,105 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1497340444423_0534 (state: FAILED)
2017-06-15 10:06:07,107 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - 
	 client token: N/A
	 diagnostics: Application application_1497340444423_0534 failed 2 times due to AM Container for appattempt_1497340444423_0534_000002 exited with  exitCode: 1
For more detailed output, check application tracking page:http://master66:18088/proxy/application_1497340444423_0534/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1497340444423_0534_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1: 
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:561)
	at org.apache.hadoop.util.Shell.run(Shell.java:478)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:738)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)


Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: root.root
	 start time: 1497492361068
	 final status: FAILED
	 tracking URL: http://master66:18088/cluster/app/application_1497340444423_0534
	 user: root
2017-06-15 10:06:07,124 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - Deleted staging directory hdfs://master66:8020/user/root/.sparkStaging/application_1497340444423_0534

<<< Invocation of Spark command completed <<<

Hadoop Job IDs executed by Spark: job_1497340444423_0534


<<< Invocation of Main class completed <<<

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], main() threw exception, Application application_1497340444423_0534 finished with failed status
org.apache.spark.SparkException: Application application_1497340444423_0534 finished with failed status
	at org.apache.spark.deploy.yarn.Client.run(Client.scala:1167)
	at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1213)
	at org.apache.spark.deploy.yarn.Client.main(Client.scala)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:738)
	at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:187)
	at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:212)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:126)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
	at org.apache.oozie.action.hadoop.SparkMain.runSpark(SparkMain.java:372)
	at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:282)
	at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:64)
	at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:82)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:234)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:388)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:302)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:187)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:230)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)

Oozie Launcher failed, finishing Hadoop job gracefully

Oozie Launcher, uploading action data to HDFS sequence file: hdfs://master66:8020/user/root/oozie-root/0000026-170614184640118-oozie-root-W/firstdemo--spark/action-data.seq
2017-06-15 10:06:07,180 [uber-SubtaskRunner] INFO  org.apache.hadoop.io.compress.CodecPool  - Got brand-new compressor [.deflate]
Successfully reset security manager from org.apache.oozie.action.hadoop.LauncherSecurityManager@1e2b5ded to null

Oozie Launcher ends

```

Highlighted
New Contributor
Posts: 7
Registered: ‎06-14-2017

Re: spark action coordinate use oozie

@yshi

Announcements