Cluster CDP Best Practices

Cluster-CDP — Wed, 30 Sep 2020 10:12:15 GMT

Hello All,

We would like to install a cluster CDP 7.1 on our DEV environment composed of 8 nodes :
3 Masters
3 Slaves
1 Edge
1 Cloudera-manager

What are the best practices for distributing the services (Spark,Hbase,Zookeeper...) on the different nodes of the cluster?

Thanks for your feedback.

Re: Cluster CDP Best Practices

GangWar — Wed, 30 Sep 2020 10:47:52 GMT

@Cluster-CDP You can follow below Cloudera Recommendation about Role distribution as per number of nodes in the cluster. Though in your case this seems a best fit for me.

https://docs.cloudera.com/cloudera-manager/7.0.3/installation/topics/cdpdc-runtime-cluster-hosts-role-assignments.html

Master Hosts Utility Hosts Gateway Hosts Worker Hosts

Master Host 1:

NameNode
YARN ResourceManager
JobHistory Server
ZooKeeper
Kudu master
Spark History Server

One host for all Utility and Gateway roles:

Secondary NameNode
Cloudera Manager
Cloudera Manager Management Service
Hive Metastore
HiveServer2
Impala Catalog Server
Impala StateStore
Hue
Oozie
Flume
Gateway configuration
HBase backup master
Ranger Admin, Tagsync, Usersync servers
Atlas server
Solr server (CDP-INFRA-SOLR instance to support Atlas)
Streams Messaging Manager
Streams Replication Manager Service
ZooKeeper

3 - 10 Worker Hosts:

DataNode
NodeManager
Impalad
Kudu tablet server

question Re: Cluster CDP Best Practices in Support Questions

Cluster CDP Best Practices

Re: Cluster CDP Best Practices