Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

slave nodes with different hardware

Solved Go to solution
Highlighted

slave nodes with different hardware

New Contributor

What if I have nodes with different hardware configurations? for example I have 10 slave nodes and 5 each of them have 64 gb ram and 24 core cpu and rest has 32 gb ram and 12 core cpu, can I have some optimal configuration for yarn? for example "Memory allocated for all YARN containers on a node" - can I set it more than 32GB, or I have to remove all slave nodes with low hardware configuration in this case and use only servers which has 64 GB ram?

Is it must to have slave nodes with identical hardware configurations?

Please link me some documentation about this question

Thank you for advice

;)

1 ACCEPTED SOLUTION

Accepted Solutions

Re: slave nodes with different hardware

See @Artem Ervits' answer in https://community.hortonworks.com/questions/14080/hadoop-nodes-with-different-characteristics.html on this question. Ambari has "config groups" features that will help you out here.

Good luck and happy Hadooping!

3 REPLIES 3

Re: slave nodes with different hardware

See @Artem Ervits' answer in https://community.hortonworks.com/questions/14080/hadoop-nodes-with-different-characteristics.html on this question. Ambari has "config groups" features that will help you out here.

Good luck and happy Hadooping!

Re: slave nodes with different hardware

New Contributor

Tthat's great I will try use config groups in the ambari thank you very much

Re: slave nodes with different hardware

Contributor

Please follow this Document by Hortonworks to set up config groups: https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.1.0/bk_ambari-user-guide/content/using_host_con...