Community Articles
Find and share helpful community-sourced technical articles
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
Labels (1)
Cloudera Employee

Question

What are the available cluster types in Data Engineering Cluster?

Answer

Currently, Cloudera provides clusters that can run the following Data Engineering job types:

 

- Hive on MapReduce

- Hive on Spark

- Spark on YARN

- MapReduce2

- PySpark

 

Note:  Job submission for a cluster is restricted to the type of job for that various cluster.   For example, if you wanted to run just a MR2 job on a Spark-on-YARN cluster, you cannot submit this, even though Spark is configured to use YARN.   You would need to standup a separate YARN cluster for it to accept a MR2/YARN job.

428 Views
Don't have an account?
Coming from Hortonworks? Activate your account here
Version history
Revision #:
6 of 6
Last update:
‎06-26-2018 08:34 AM
Updated by:
 
Top Kudoed Authors