Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

spark action coordinate use oozie

Highlighted

spark action coordinate use oozie

New Contributor

1. master=yarn-cluster is error

2. master=yarn-client is ok

 

oozie version = 4.1.0(release by cloudera)

oozie's sharelib i rebuild totally from right version code(by cloudera)

 

error info:

``` console

Parsed arguments:
  master                  yarn
  deployMode              cluster
  executorMemory          1G
  executorCores           1
  totalExecutorCores      null
  propertiesFile          null
  driverMemory            512m
  driverCores             null
  driverExtraClassPath    $PWD/*
  driverExtraLibraryPath  null
  driverExtraJavaOptions  -Dlog4j.configuration=spark-log4j.properties
  supervise               false
  queue                   null
  numExecutors            3
  files                   hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-format-2.3.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-annotations-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-media-jaxb-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-crypto-1.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-net-3.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.inject-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-graphx_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/httpclient-4.2.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/httpcore-4.2.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/xz-1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-encoding-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spire_2.11-0.7.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-pool-1.5.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-databind-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/derby-10.10.1.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/snappy-java-1.0.4.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/pmml-model-1.2.15.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-lang3-3.3.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/osgi-resource-locator-1.0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/kryo-shaded-3.0.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-graphite-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-sql_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-io-2.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-core-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-math3-3.4.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.servlet-api-3.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-server-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-library-2.11.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-codec-1.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-collections-3.2.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-1.7.6-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-json-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/datanucleus-core-3.2.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-sketch_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/calcite-linq4j-1.2.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.ws.rs-api-2.0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-compress-1.4.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/minlog-1.3.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javassist-3.18.1-GA.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-module-scala_2.11-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-catalyst_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/kryo-2.21.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-network-shuffle_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-ipc-1.7.6-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/libfb303-0.9.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-compiler-3.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/stream-2.7.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-jackson-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/paranamer-2.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-guava-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/json4s-ast_2.11-3.2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-hadoop-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scalap-2.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/reflectasm-1.07-shaded.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scalatest_2.11-2.2.6.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/ivy-2.0.0-rc2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-tags_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/validation-api-1.1.0.Final.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/xbean-asm5-shaded-4.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/netty-all-4.0.42.Final.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/breeze_2.11-0.12.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/unused-1.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/hk2-locator-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-launcher_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/hk2-api-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/calcite-avatica-1.2.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-mllib-local_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/guava-14.0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/chill_2.11-0.8.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/breeze-macros_2.11-0.12.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/asm-4.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/json4s-jackson_2.11-3.2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/hk2-utils-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/calcite-core-1.2.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-jvm-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/aopalliance-repackaged-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jcl-over-slf4j-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/RoaringBitmap-0.5.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/univocity-parsers-2.2.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-core_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/arpack_combined_all-0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-mapper-asl-1.8.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/oozie-sharelib-spark-4.1.0-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/antlr4-runtime-4.5.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-common-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-httpclient-3.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/json4s-core_2.11-3.2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.annotation-api-1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-compiler-2.11.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spire-macros_2.11-0.7.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/oozie/json-simple-1.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-parser-combinators_2.11-1.0.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/zookeeper-3.4.5-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-dbcp-1.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/objenesis-1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-repl_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-common-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/libthrift-0.9.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-lang-2.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-core-asl-1.8.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/compress-lzf-1.0.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-mllib_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/janino-3.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-unsafe_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-container-servlet-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-hive_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/eigenbase-properties-1.1.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-hadoop-bundle-1.6.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/opencsv-2.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-mapred-1.7.6-cdh5.11.0-hadoop2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/joda-time-2.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/slf4j-api-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/minlog-1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-logging-1.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/py4j-0.10.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/pmml-schema-1.2.15.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-ipc-1.7.6-cdh5.11.0-tests.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/chill-java-0.8.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/lz4-1.3.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/oozie/oozie-sharelib-oozie-4.1.0-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/core-1.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-module-paranamer-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/oozie/oozie-hadoop-utils-2.6.0-cdh5.11.0.oozie-4.1.0-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/netty-3.8.0.Final.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/curator-client-2.7.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/log4j-1.2.17.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jets3t-0.6.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-container-servlet-core-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-reflect-2.11.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-xml_2.11-1.0.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jul-to-slf4j-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/leveldbjni-all-1.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jline-2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-streaming_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/curator-framework-2.7.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/oro-2.0.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-column-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/pyrolite-4.13.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/curator-recipes-2.7.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jodd-core-3.5.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-core-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/shapeless_2.11-2.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jsr305-1.3.9.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/slf4j-log4j12-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jtransforms-2.4.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-network-common_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-client-2.22.2.jar
  pyFiles                 null
  archives                null
  mainClass               com.chaosdata.env.WordCount
  primaryResource         file:/usr/local/envtch/ooziejobs/envtest.jar
  name                    Spark wc
  childArgs               []
  jars                    null
  packages                null
  packagesExclusions      null
  repositories            null
  verbose                 true

Spark properties used, including those specified through
 --conf and those from the properties file null:
  spark.oozie.action.id -> 0000026-170614184640118-oozie-root-W@firstdemo
  spark.oozie.HadoopAccessorService.created -> true
  spark.yarn.security.tokens.hive.enabled -> false
  spark.yarn.tags -> oozie-ef69202922e9f03b467c6b1de9c4f5ce
  spark.yarn.jars -> hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-yarn_2.11-2.1.0.jar
  spark.yarn.historyServer.address -> http://master66:18088
  spark.eventLog.enabled -> true
  spark.oozie.job.id -> 0000026-170614184640118-oozie-root-W
  spark.executor.extraJavaOptions -> -Dlog4j.configuration=spark-log4j.properties
  spark.yarn.security.tokens.hbase.enabled -> false
  spark.driver.extraJavaOptions -> -Dlog4j.configuration=spark-log4j.properties
  spark.eventLog.dir -> hdfs://master66:8020/var/log/spark_hislog
  spark.executor.extraClassPath -> $PWD/*
  spark.driver.extraClassPath -> $PWD/*

    
Main class:
org.apache.spark.deploy.yarn.Client
Arguments:
--jar
file:/usr/local/envtch/ooziejobs/envtest.jar
--class
com.chaosdata.env.WordCount
System properties:
spark.oozie.action.id -> 0000026-170614184640118-oozie-root-W@firstdemo
spark.oozie.HadoopAccessorService.created -> true
spark.yarn.security.tokens.hive.enabled -> false
spark.yarn.tags -> oozie-ef69202922e9f03b467c6b1de9c4f5ce
spark.executor.memory -> 1G
spark.driver.memory -> 512m
spark.yarn.jars -> hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-yarn_2.11-2.1.0.jar
spark.executor.instances -> 3
spark.yarn.historyServer.address -> http://master66:18088
spark.eventLog.enabled -> true
spark.yarn.dist.files -> hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-format-2.3.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-annotations-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-media-jaxb-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-crypto-1.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-net-3.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.inject-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-graphx_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/httpclient-4.2.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/httpcore-4.2.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/xz-1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-encoding-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spire_2.11-0.7.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-pool-1.5.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-databind-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/derby-10.10.1.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/snappy-java-1.0.4.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/pmml-model-1.2.15.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-lang3-3.3.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/osgi-resource-locator-1.0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/kryo-shaded-3.0.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-graphite-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-sql_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-io-2.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-core-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-math3-3.4.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.servlet-api-3.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-server-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-library-2.11.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-codec-1.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-collections-3.2.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-1.7.6-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-json-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/datanucleus-core-3.2.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-sketch_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/calcite-linq4j-1.2.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.ws.rs-api-2.0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-compress-1.4.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/minlog-1.3.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javassist-3.18.1-GA.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-module-scala_2.11-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-catalyst_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/kryo-2.21.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-network-shuffle_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-ipc-1.7.6-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/libfb303-0.9.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-compiler-3.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/stream-2.7.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-jackson-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/paranamer-2.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-guava-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/json4s-ast_2.11-3.2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-hadoop-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scalap-2.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/reflectasm-1.07-shaded.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scalatest_2.11-2.2.6.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/ivy-2.0.0-rc2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-tags_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/validation-api-1.1.0.Final.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/xbean-asm5-shaded-4.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/netty-all-4.0.42.Final.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/breeze_2.11-0.12.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/unused-1.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/hk2-locator-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-launcher_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/hk2-api-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/calcite-avatica-1.2.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-mllib-local_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/guava-14.0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/chill_2.11-0.8.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/breeze-macros_2.11-0.12.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/asm-4.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/json4s-jackson_2.11-3.2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/hk2-utils-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/calcite-core-1.2.0-incubating.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-jvm-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/aopalliance-repackaged-2.4.0-b34.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jcl-over-slf4j-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/RoaringBitmap-0.5.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/univocity-parsers-2.2.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-core_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/arpack_combined_all-0.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-mapper-asl-1.8.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/oozie-sharelib-spark-4.1.0-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/antlr4-runtime-4.5.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-common-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-httpclient-3.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/json4s-core_2.11-3.2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/javax.annotation-api-1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-compiler-2.11.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spire-macros_2.11-0.7.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/oozie/json-simple-1.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-parser-combinators_2.11-1.0.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/zookeeper-3.4.5-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-dbcp-1.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/objenesis-1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-repl_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-common-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/libthrift-0.9.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-lang-2.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-core-asl-1.8.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/compress-lzf-1.0.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-mllib_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/janino-3.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-unsafe_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-container-servlet-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-hive_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/eigenbase-properties-1.1.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-hadoop-bundle-1.6.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/opencsv-2.3.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-mapred-1.7.6-cdh5.11.0-hadoop2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/joda-time-2.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/slf4j-api-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/minlog-1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/commons-logging-1.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/py4j-0.10.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/pmml-schema-1.2.15.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/avro-ipc-1.7.6-cdh5.11.0-tests.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/chill-java-0.8.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/lz4-1.3.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/oozie/oozie-sharelib-oozie-4.1.0-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/core-1.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jackson-module-paranamer-2.6.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/oozie/oozie-hadoop-utils-2.6.0-cdh5.11.0.oozie-4.1.0-cdh5.11.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/netty-3.8.0.Final.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/curator-client-2.7.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/log4j-1.2.17.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jets3t-0.6.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-container-servlet-core-2.22.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-reflect-2.11.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/scala-xml_2.11-1.0.4.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jul-to-slf4j-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/leveldbjni-all-1.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jline-2.11.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-streaming_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/curator-framework-2.7.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/oro-2.0.8.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/parquet-column-1.8.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/pyrolite-4.13.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/curator-recipes-2.7.1.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jodd-core-3.5.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/metrics-core-3.1.2.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/shapeless_2.11-2.0.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jsr305-1.3.9.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/slf4j-log4j12-1.7.5.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jtransforms-2.4.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/spark-network-common_2.11-2.1.0.jar,hdfs://master66:8020/user/root/share/lib/lib_20170614150837/spark/jersey-client-2.22.2.jar
spark.oozie.job.id -> 0000026-170614184640118-oozie-root-W
SPARK_SUBMIT -> true
spark.executor.extraJavaOptions -> -Dlog4j.configuration=spark-log4j.properties
spark.app.name -> Spark wc
spark.yarn.security.tokens.hbase.enabled -> false
spark.driver.extraJavaOptions -> -Dlog4j.configuration=spark-log4j.properties
spark.submit.deployMode -> cluster
spark.executor.extraClassPath -> $PWD/*
spark.eventLog.dir -> hdfs://master66:8020/var/log/spark_hislog
spark.master -> yarn
spark.executor.cores -> 1
spark.driver.extraClassPath -> $PWD/*
Classpath elements:



Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], main() threw exception, Application application_1497340444423_0534 finished with failed status
org.apache.spark.SparkException: Application application_1497340444423_0534 finished with failed status
	at org.apache.spark.deploy.yarn.Client.run(Client.scala:1167)
	at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1213)
	at org.apache.spark.deploy.yarn.Client.main(Client.scala)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:738)
	at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:187)
	at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:212)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:126)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
	at org.apache.oozie.action.hadoop.SparkMain.runSpark(SparkMain.java:372)
	at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:282)
	at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:64)
	at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:82)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:234)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:388)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:302)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:187)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:230)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).

```

``` console

2017-06-15 10:06:02,097 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - 
	 client token: N/A
	 diagnostics: N/A
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: root.root
	 start time: 1497492361068
	 final status: UNDEFINED
	 tracking URL: http://master66:18088/proxy/application_1497340444423_0534/
	 user: root
2017-06-15 10:06:03,098 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1497340444423_0534 (state: ACCEPTED)
2017-06-15 10:06:04,100 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1497340444423_0534 (state: ACCEPTED)
2017-06-15 10:06:04,350 [communication thread] INFO  org.apache.hadoop.mapred.TaskAttemptListenerImpl  - Progress of TaskAttempt attempt_1497340444423_0533_m_000000_0 is : 1.0
2017-06-15 10:06:05,102 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1497340444423_0534 (state: ACCEPTED)
2017-06-15 10:06:06,104 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1497340444423_0534 (state: ACCEPTED)
2017-06-15 10:06:07,105 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - Application report for application_1497340444423_0534 (state: FAILED)
2017-06-15 10:06:07,107 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - 
	 client token: N/A
	 diagnostics: Application application_1497340444423_0534 failed 2 times due to AM Container for appattempt_1497340444423_0534_000002 exited with  exitCode: 1
For more detailed output, check application tracking page:http://master66:18088/proxy/application_1497340444423_0534/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1497340444423_0534_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1: 
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:561)
	at org.apache.hadoop.util.Shell.run(Shell.java:478)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:738)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)


Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: root.root
	 start time: 1497492361068
	 final status: FAILED
	 tracking URL: http://master66:18088/cluster/app/application_1497340444423_0534
	 user: root
2017-06-15 10:06:07,124 [uber-SubtaskRunner] INFO  org.apache.spark.deploy.yarn.Client  - Deleted staging directory hdfs://master66:8020/user/root/.sparkStaging/application_1497340444423_0534

<<< Invocation of Spark command completed <<<

Hadoop Job IDs executed by Spark: job_1497340444423_0534


<<< Invocation of Main class completed <<<

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], main() threw exception, Application application_1497340444423_0534 finished with failed status
org.apache.spark.SparkException: Application application_1497340444423_0534 finished with failed status
	at org.apache.spark.deploy.yarn.Client.run(Client.scala:1167)
	at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1213)
	at org.apache.spark.deploy.yarn.Client.main(Client.scala)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:738)
	at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:187)
	at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:212)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:126)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
	at org.apache.oozie.action.hadoop.SparkMain.runSpark(SparkMain.java:372)
	at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:282)
	at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:64)
	at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:82)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:234)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:388)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:302)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:187)
	at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:230)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)

Oozie Launcher failed, finishing Hadoop job gracefully

Oozie Launcher, uploading action data to HDFS sequence file: hdfs://master66:8020/user/root/oozie-root/0000026-170614184640118-oozie-root-W/firstdemo--spark/action-data.seq
2017-06-15 10:06:07,180 [uber-SubtaskRunner] INFO  org.apache.hadoop.io.compress.CodecPool  - Got brand-new compressor [.deflate]
Successfully reset security manager from org.apache.oozie.action.hadoop.LauncherSecurityManager@1e2b5ded to null

Oozie Launcher ends

```

1 REPLY 1

Re: spark action coordinate use oozie

New Contributor

@yshi