Support Questions

Find answers, ask questions, and share your expertise

slave nodes with different hardware

avatar
Contributor

What if I have nodes with different hardware configurations? for example I have 10 slave nodes and 5 each of them have 64 gb ram and 24 core cpu and rest has 32 gb ram and 12 core cpu, can I have some optimal configuration for yarn? for example "Memory allocated for all YARN containers on a node" - can I set it more than 32GB, or I have to remove all slave nodes with low hardware configuration in this case and use only servers which has 64 GB ram?

Is it must to have slave nodes with identical hardware configurations?

Please link me some documentation about this question

Thank you for advice

😉

1 ACCEPTED SOLUTION

avatar

See @Artem Ervits' answer in https://community.hortonworks.com/questions/14080/hadoop-nodes-with-different-characteristics.html on this question. Ambari has "config groups" features that will help you out here.

Good luck and happy Hadooping!

View solution in original post

3 REPLIES 3

avatar

See @Artem Ervits' answer in https://community.hortonworks.com/questions/14080/hadoop-nodes-with-different-characteristics.html on this question. Ambari has "config groups" features that will help you out here.

Good luck and happy Hadooping!

avatar
Contributor

Tthat's great I will try use config groups in the ambari thank you very much

avatar
Contributor

Please follow this Document by Hortonworks to set up config groups: https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.1.0/bk_ambari-user-guide/content/using_host_con...