Created on 04-29-2015 03:44 AM - edited 09-16-2022 02:27 AM
Hi, does some cloudera distirbution provides
https://issues.apache.org/jira/browse/SPARK-5967 backport?
Can't find it, even in CDH 5.4
Created 04-29-2015 02:46 PM
That doc lists patches that are *also* applied on top of 1.3.0. From your original message, it did not even look like you were affected by this issue, since your process did not run out of memory.
Created 04-29-2015 08:41 AM
CDH 5.4 = 1.3.0, and this was marked fixed for 1.3.0, so it was included. I'm not sure what you are looking for or referring to.
Created 04-29-2015 12:50 PM
Thanks for reply.
I read this note:
http://archive.cloudera.com/cdh5/cdh/5/spark-1.3.0-cdh5.4.0.releasenotes.html
We are using jobserver to submit jobs for eavry 5 mins, and that issue stated
"This is a blocker for 24/7 running applications like Spark Streaming apps."
Jobserver holds a job context to share context among other jobs? Am I right?
Created 04-29-2015 02:46 PM
That doc lists patches that are *also* applied on top of 1.3.0. From your original message, it did not even look like you were affected by this issue, since your process did not run out of memory.
Created 05-07-2015 01:05 AM
Thanks, my fault, missed that remark.