question Re: Spark 3.3 support in Support Questions

Spark 3.3 support

Ben1978 — Tue, 16 Aug 2022 11:51:35 GMT

Which versions and distributions of Hadoop are compatible with Spark 3.3?

Re: Spark 3.3 support

rki_ — Tue, 16 Aug 2022 12:44:47 GMT

Hi @Ben1978

Spark 3.3 will be a compatible with CDP 7.1.8 which is yet to be released.

Re: Spark 3.3 support

Ben1978 — Tue, 16 Aug 2022 15:29:52 GMT

@rki_ Thanks for responding. Do you have a link to a compatibility matrix you can share perhaps?

Re: Spark 3.3 support

rki_ — Tue, 16 Aug 2022 17:00:37 GMT

@Ben1978 You can refer the below docs for spark 3,3.1,3.2 respectively

https://docs.cloudera.com/cdp-private-cloud-base/7.1.4/cds-3/topics/spark-spark-3-requirements.html

https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/cds-3/topics/spark-spark-3-requirements.html

https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/cds-3/topics/spark-3-requirements.html

As CDP 7.1.8 is not release yet, we don't have an official doc on that.

--
Was your question answered? Please take some time to click on “Accept as Solution” below this post.
If you find a reply useful, say thanks by clicking on the thumbs up button.