We’ve set up Cloudera Manager 7.13.1 along with CDP Private Cloud Base 7.3.1 on RHEL 9.4. As part of our environment validation, we’re looking to include Apache Spark 3 in the stack. However, we haven’t been able to locate a supported Spark 3 parcel that’s officially compatible with this combination. We’ve reviewed the Cloudera Support Matrix, but couldn’t find a clear reference for Spark 3 support with these specific versions of CDP and CM. According to a recent blog post, Announcing availability of Spark 3.5 on Cloudera Unified Runtime which also directs the reader to What's New in Apache Spark (7.3.1). Apparently Spark 3 is supported by 7.3.1 and Spark 3.5 by 7.3.1 SP1. Does Spark still get installed separately or is it included with the base runtime? Should the support matrix be updated to reflect support for Spark 3?
... View more
