Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

What's New @ Cloudera

Find the latest Cloudera product news
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

ML Runtimes in Cloudera Cloudera AI now support Add Ons such as Spark

avatar
Cloudera Employee

ML Runtimes are designed to be the successor to Engines in Cloudera Cloudera AI (CML), moving away from the monolithic architecture of Engines and enabling finer grained control over exactly what is necessary by defining the Editor, Kernel, Edition, and Version needed for the given workload. One core piece previously missing from ML Runtimes was the ability to define Addons that go beyond these settings, in particular the ability to leverage the Spark execution engine through an ML Runtime.

 

Admins can now define Addons for ML Runtimes, including Spark and Hadoop CLI. In doing so, Users can leverage these Addons when running workloads such as Sessions, thereby enabling such functionality as Spark-on-K8s to be run through the ML Runtime.


To learn more, visit the documentation about Runtime Addons in CML.