Support Questions

Find answers, ask questions, and share your expertise

services distribution to masters

Explorer

hi, I setup a demo cluster for testing and I would like to ask if this configuration-distribution of services is ok

consists of 4 master nodes and 10 slaves

namenode--> namenode, zookeeper, accumulo master,GC, Monitor, Tracer, atlas, kafka, knox, activity analyzer, activity explorer, hst , spark history, spark2 history, zeppelin

hbasemaster--> hive metastore, webhcat, hiveserver2, hbase master, oozie, zookeeper, falcon

resourcemanager--> snamenode, app timeline, resourcemanager, history server, zookeeper, dprc, nimbus, storm

ambari--> ambari, zookeeper, infra solr, metrics collector, grafana

do you have any suggestions ?

thank you

2 REPLIES 2

Super Mentor

@Bill Ferris

Hortonworks recommends separating master and slave nodes because:

  • Task/application workloads on the slave nodes should be isolated from the masters.
  • Slaves nodes are frequently decommissioned for maintenance.

Please see: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_cluster-planning/content/typical-hadoop-...

Your "namenode" host seems to be having many components. So i guess that host will have enough resources specially RAM.

.

Following link provides some very useful "Cluster Planning" recommendations: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_cluster-planning/content/ch_hardware-rec...

Explorer

I am aware of these docs, if you have 3 servers and 1 less powered server, I started the installation through ambari guide and asks for distribution of many services to master nodes. do you think that there will be a problem ?