Skip to main content
Ben1978
Silver ⭐️
Aug 16, 2022 11:51 AM UTC
Solved

Spark 3.3 support

Which versions and distributions of Hadoop are compatible with Spark 3.3?

rki_
rki_Answer
Gold ⭐️
Aug 16, 2022 12:44 PM UTC

Hi @Ben1978 

 

Spark 3.3 will be a compatible with CDP 7.1.8 which is yet to be released.

3 replies

rki_
Gold ⭐️
rki_Answer
Gold ⭐️
Aug 16, 2022 12:44 PM UTC

Hi @Ben1978 

 

Spark 3.3 will be a compatible with CDP 7.1.8 which is yet to be released.

Translate
Ben1978
Ben1978Author
Silver ⭐️
Aug 16, 2022 3:29 PM UTC

@rki_ Thanks for responding. Do you have a link to a compatibility matrix you can share perhaps?

Translate
rki_
Gold ⭐️
Gold ⭐️
Aug 16, 2022 5:00 PM UTC

@Ben1978 You can refer the below docs for spark 3,3.1,3.2 respectively

 

https://docs.cloudera.com/cdp-private-cloud-base/7.1.4/cds-3/topics/spark-spark-3-requirements.html

https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/cds-3/topics/spark-spark-3-requirements.html

https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/cds-3/topics/spark-3-requirements.html

 

As CDP 7.1.8 is not release yet, we don't have an official doc on that.

 

--
Was your question answered? Please take some time to click on “Accept as Solution” below this post.
If you find a reply useful, say thanks by clicking on the thumbs up button.

 

 

Translate