Member since
10-03-2016
51
Posts
1
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1491 | 09-14-2018 01:30 AM | |
1638 | 08-24-2018 03:37 AM | |
3337 | 08-18-2018 02:19 AM |
08-18-2018
02:19 AM
When use spark2.1,We have to add oozie-sharelib-spark-4.2.0.jar in spark2
... View more
08-17-2018
12:31 PM
when I use oozie to schedule spark2 on yarn.I have e pproblem : Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], main() threw exception, null
java.lang.NullPointerException
at scala.collection.mutable.ArrayOps$ofRef$.newBuilder$extension(ArrayOps.scala:190)
at scala.collection.mutable.ArrayOps$ofRef.newBuilder(ArrayOps.scala:186)
at scala.collection.TraversableLike$class.filterImpl(TraversableLike.scala:246)
at scala.collection.TraversableLike$class.filter(TraversableLike.scala:259)
at scala.collection.mutable.ArrayOps$ofRef.filter(ArrayOps.scala:186)
at org.apache.spark.deploy.yarn.Client$anonfun$prepareLocalResources$6.apply(Client.scala:531)
at org.apache.spark.deploy.yarn.Client$anonfun$prepareLocalResources$6.apply(Client.scala:527)
at scala.collection.mutable.ArraySeq.foreach(ArraySeq.scala:74)
at org.apache.spark.deploy.yarn.Client.prepareLocalResources(Client.scala:527)
at org.apache.spark.deploy.yarn.Client.createContainerLaunchContext(Client.scala:868)
at org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:170)
at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:56)
at org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:156)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:509)
at org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58)
... View more
Labels:
- Labels:
-
Apache Oozie
-
Apache Spark
08-16-2018
03:29 PM
@Sandeep Nemuri,Thank you very much!when I first install oozie,I use mysql.I think it caused by mysql.So i try Derby,But it stay slow!
... View more
08-16-2018
11:18 AM
When I use oozie,I hava install oozie success,But this web loading is very slow,I don‘t know why .Oozie's other function can work,and this web can work too,but web is very slow .Anyone know why this happening?Thank you very much.(or tell me where has Installation Steps and I will go to read(no ambari,just oozie and hadoop))
... View more
Labels:
- Labels:
-
Apache Oozie
06-07-2017
08:48 AM
Can you describe this question more clear?I can't understand this.
... View more
06-07-2017
12:44 AM
thank you !I will try this.
... View more
06-07-2017
12:44 AM
Yeah,maybe because the network problem.so i summit the same question twice,sorry!
... View more
06-06-2017
01:13 PM
Ok,thank you very much.I thought that in the fact there is a way to remove it,just I don't know。
... View more
06-06-2017
12:53 PM
Thank you very much,I just want to change the replications of files that have upload to HDFS.So yesterdy,I found that one command can realize that.So thank you very much!
... View more
06-04-2017
03:18 PM
I just want to remove the record!thank you!
... View more
Labels:
- Labels:
-
Apache Hadoop