question Re: slave nodes with different hardware in Archives of Support Questions (Read Only)

slave nodes with different hardware

shota — Sat, 03 Jun 2017 11:58:53 GMT

What if I have nodes with different hardware configurations? for example I have 10 slave nodes and 5 each of them have 64 gb ram and 24 core cpu and rest has 32 gb ram and 12 core cpu, can I have some optimal configuration for yarn? for example "Memory allocated for all YARN containers on a node" - can I set it more than 32GB, or I have to remove all slave nodes with low hardware configuration in this case and use only servers which has 64 GB ram?

Is it must to have slave nodes with identical hardware configurations?

Please link me some documentation about this question

Thank you for advice

😉

Re: slave nodes with different hardware

LesterMartin — Sat, 03 Jun 2017 21:55:32 GMT

See @Artem Ervits' answer in https://community.hortonworks.com/questions/14080/hadoop-nodes-with-different-characteristics.html on this question. Ambari has "config groups" features that will help you out here.

Good luck and happy Hadooping!

Re: slave nodes with different hardware

shota — Mon, 05 Jun 2017 16:33:39 GMT

Tthat's great I will try use config groups in the ambari thank you very much

Re: slave nodes with different hardware

dhirajk — Tue, 18 Jul 2017 01:27:50 GMT

Please follow this Document by Hortonworks to set up config groups: https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.1.0/bk_ambari-user-guide/content/using_host_config_groups.html