Member since
05-05-2015
7
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
86127 | 09-01-2015 12:14 AM |
05-08-2017
10:53 AM
1 Kudo
Since Spark 1.6.1 spark-submit takes no wait option. I bet many people faced the same problem 🙂 --conf spark.yarn.submit.waitAppCompletion=false
... View more
02-24-2016
01:38 PM
Dear sonups3, I met the same issue, can you explain detailed what you did to fix? Thanks!
... View more
01-15-2016
07:37 AM
I think I figured this out. In this case, I needed to use the other flavor of explode in the second operation: val ydf = xdf.explode("nar", "gname") { nar: Seq[String] => nar } Always happens, as soon as you ask the question publicly...
... View more