Spark 3 Parcel Compatibility with CDP Private Cloud Base 7.3.1 and Cloudera Manager 7.13.1 on RHEL 9.4

[#1]

We have installed Cloudera Manager 7.13.1 and CDP Private Cloud Base 7.3.1 on Red Hat Enterprise Linux 9.4.

However, we are unable to find a supported Spark 3 parcel that is compatible with this combination. We have reviewed the Cloudera Support Matrix but could not find any officially supported Spark 3 version for CDP Private Cloud Base 7.3.1.

We attempted to use the following Spark3 parcels:

• SPARK3-3.3.2.3.3.7190.0-91-1.p0.45265883

• SPARK3-3.3.0.3.3.7180.0-274-1.p0.31212967

Displays the following error when unpacking spark3 parcels
There was an error communicating with the server:

CDH 7.3.1 replaces SPARK3 3.3.2.3.3.7190.0-91-1.p0.45265883.

[#2]

@people Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our Spark experts @Bharati @jagadeesan  who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

[#3 · Accepted solution]

@people Starting with Cloudera Runtime 7.3.x, Spark 3 is the default and integrated Spark version, and Spark 2 has been removed and is no longer supported.

As a result, you do not need to install a separate Spark 3 parcel for CDP Private Cloud Base 7.3.x. The Spark 3 runtime is bundled within the Cloudera Runtime parcel itself so you won’t find a separate, compatible Spark 3 parcel in the support matrix or parcel repository for this version. 

That’s why the attempt to deploy a separate Spark3 parcel triggers the conflict message you are seeing. 

To proceed, simply use the Spark service that comes bundled with the Cloudera Runtime 7.3.x. After initial Cloudera Runtime 7.3.x installation, you can use the Add a Spark3 Service wizard to add and configure new service instances directly via Cloudera Manager

For more details you can refer the below release notes:
https://docs.cloudera.com/cdp-private-cloud-base/7.3.1/private-release-notes/topics/rt-whats-new-spa...

[#4]

Thanks for the clarification. So just to confirm we can add and configure Spark 3 as a service in Cloudera Manager without needing to install a separate Spark 3 parcel, since Spark 3 is already integrated into Cloudera Runtime 7.3.x

[#5]

Thank you for confirming!