Created 10-26-2023 01:08 PM
Hello
I was able to install CDS (spark) 3.3 with CDP 7.1.7-SP2. However, I am not able to do it with CDP 7.1.7.
Can someone confirm the latest spark supported bu following CDP(s):
1. CDP 7.1.7 - ??
2. CDP 7.1.7 SP1 - ??
3. CDP 7.1.7 SP1 - CD 3.3 works here.
Created 10-26-2023 05:40 PM
Officially, CDP 7.1.7 ( GA, SP1, SP2) supports CDS 3.2 (Apache spark 3.2.3 based) :
https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/cds-3/topics/spark-3-requirements.html
- CDP 7.1.8 supports CDS 3.3 (apache spark 3.3.0 based)
https://docs.cloudera.com/cdp-private-cloud-base/7.1.8/cds-3/topics/spark-3-requirements.html
- CDP 7.1.9 supports CDS 3.3 (apache spark 3.3.2 based)
https://docs.cloudera.com/cdp-private-cloud-base/7.1.9/cds-3/topics/spark-3-requirements.html
There's basically a 1:1 mapping between CDS spark3 version support with a CDP 7.1.{7,8,9} version.
Created 10-26-2023 01:14 PM
@AK- Welcome to the Cloudera Community!
To help you get the best possible solution, I have tagged our Spark experts @Bharati @smdas who may be able to assist you further.
Please keep us updated on your post, and we hope you find a satisfactory solution to your query.
Regards,
Diana Torres,Created 10-26-2023 01:53 PM
CDP 7.1.7 supports Spark 3.2.3 not Spark 3.3
https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/cds-3/topics/spark-3-requirements.html
Created 10-26-2023 02:01 PM
however, CDP 7.1.7 sp2 support 3.3 does CDP 7.1.7 sp1 also support CDS 3.3 ?
Created 10-26-2023 05:40 PM
Officially, CDP 7.1.7 ( GA, SP1, SP2) supports CDS 3.2 (Apache spark 3.2.3 based) :
https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/cds-3/topics/spark-3-requirements.html
- CDP 7.1.8 supports CDS 3.3 (apache spark 3.3.0 based)
https://docs.cloudera.com/cdp-private-cloud-base/7.1.8/cds-3/topics/spark-3-requirements.html
- CDP 7.1.9 supports CDS 3.3 (apache spark 3.3.2 based)
https://docs.cloudera.com/cdp-private-cloud-base/7.1.9/cds-3/topics/spark-3-requirements.html
There's basically a 1:1 mapping between CDS spark3 version support with a CDP 7.1.{7,8,9} version.
Created 10-30-2023 10:40 PM
@AK- Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.
Regards,
Diana Torres,