We are excited to announce the release of Cloudera Distribution of Apache Spark (CDS) 3.5 for Cloudera on premises 7.1.9. This new release is available as an add-on parcel and provides long-term support for Apache Spark 3.5, the latest Long-Term Support (LTS) version adopted by both Cloudera and the broader Apache community.
What's Changing?
This update is for customers using the CDS 3.3 add-on parcel to use Spark 3 with Cloudera on premises 7.1.9.
Key Benefits of Upgrading to Apache Spark 3.5
Cloudera recommends upgrading to CDS 3.5 for all users currently running CDS 3.3. This upgrade offers significant advantages:
- Performance Boost: Spark 3.5 is expected to deliver a performance increase of over 20% compared to Spark 3.3. This means faster data processing and more efficient workloads for your enterprise.
- Enhanced Features: This release includes enhanced security, bug fixes, and support for newer versions of Python. These improvements ensure your data engineering workflows are more robust and reliable.
- Future-Ready: CDS 3.5 on Cloudera on premises 7.1.9 enables a smooth transition path to the Cloudera 7.3.x release line, which ships with Spark 3.5 as the default.
Please note that NVIDIA RAPIDS and Spark Connect are not supported in CDS 3.5
Deprecation of CDS 3.3
With the release of CDS 3.5, Cloudera is deprecating CDS 3.3, with support ending August 2026. By migrating to CDS 3.5, you can ensure continued support from Cloudera and access to the latest Spark features.
Take Action
Cloudera strongly encourages all customers using the CDS 3.3 add-on parcel with Cloudera on premises 7.1.9 clusters to upgrade to CDS 3.5 before August 2026. This upgrade will provide you with the latest Spark features, performance improvements, and security updates.
Consult the Cloudera documentation to get started with upgrading the CDS parcel and migrating applications from Spark 3.3 to 3.5.
To follow more updates, please visit the corresponding Knowledge Article for this release.
