Community Articles

Find and share helpful community-sourced technical articles.
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.
Cloudera Employee

Question

What are the available cluster types in Data Engineering Cluster?

Answer

Currently, Cloudera provides clusters that can run the following Data Engineering job types:

 

- Hive on MapReduce

- Hive on Spark

- Spark on YARN

- MapReduce2

- PySpark

 

Note:  Job submission for a cluster is restricted to the type of job for that various cluster.   For example, if you wanted to run just a MR2 job on a Spark-on-YARN cluster, you cannot submit this, even though Spark is configured to use YARN.   You would need to standup a separate YARN cluster for it to accept a MR2/YARN job.

622 Views
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.
Version history
Last update:
‎09-16-2022 08:38 AM
Updated by:
Top Kudoed Authors