question Re: backport for SPARK-5967 in Archives of Support Questions (Read Only)

backport for SPARK-5967

sergey.sheypak566881637 — Fri, 16 Sep 2022 09:27:20 GMT

Hi, does some cloudera distirbution provides

https://issues.apache.org/jira/browse/SPARK-5967 backport?

Can't find it, even in CDH 5.4

Re: backport for SPARK-5967

srowen — Wed, 29 Apr 2015 15:41:23 GMT

CDH 5.4 = 1.3.0, and this was marked fixed for 1.3.0, so it was included. I'm not sure what you are looking for or referring to.

Re: backport for SPARK-5967

sergey.sheypak566881637 — Wed, 29 Apr 2015 19:50:23 GMT

Thanks for reply.

I read this note:

http://archive.cloudera.com/cdh5/cdh/5/spark-1.3.0-cdh5.4.0.releasenotes.html

We are using jobserver to submit jobs for eavry 5 mins, and that issue stated

"This is a blocker for 24/7 running applications like Spark Streaming apps."

Jobserver holds a job context to share context among other jobs? Am I right?

Re: backport for SPARK-5967

srowen — Wed, 29 Apr 2015 21:46:29 GMT

That doc lists patches that are *also* applied on top of 1.3.0. From your original message, it did not even look like you were affected by this issue, since your process did not run out of memory.

Re: backport for SPARK-5967

sergey.sheypak566881637 — Thu, 07 May 2015 08:05:21 GMT

Thanks, my fault, missed that remark.