slave nodes with different hardware

[#1]

What if I have nodes with different hardware configurations? for example I have 10 slave nodes and 5 each of them have 64 gb ram and 24 core cpu and rest has 32 gb ram and 12 core cpu, can I have some optimal configuration for yarn? for example "Memory allocated for all YARN containers on a node" - can I set it more than 32GB, or I have to remove all slave nodes with low hardware configuration in this case and use only servers which has 64 GB ram?

Is it must to have slave nodes with identical hardware configurations?

Please link me some documentation about this question

Thank you for advice

😉

[#2 · Accepted solution]

See @Artem Ervits' answer in https://community.hortonworks.com/questions/14080/hadoop-nodes-with-different-characteristics.html on this question. Ambari has "config groups" features that will help you out here.

Good luck and happy Hadooping!

[#3]

Tthat's great I will try use config groups in the ambari thank you very much

[#4]

Please follow this Document by Hortonworks to set up config groups: https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.1.0/bk_ambari-user-guide/content/using_host_con...