Created 11-20-2017 10:33 AM
Hi everybody,
We have a cluster with 3 VM nodes on HP servers(64 GB ram and 10 TB capacity and 8 cores). Vsphere 5.5 has been used in this project to create virtual machines. Now we need some extra capacity to add to HDFS, but there is no space on the HP server and new VMs can not be constructed. The question is this: could I add a PC or a laptop with the same operating system as a new node to my cluster? Maybe, it is good to ask in this way: what kind of systems can be used together for constructing hdp clusters?
thanks a million,
Shanghoosh
Created 11-20-2017 01:08 PM
Regarding your queries:
1. Could I add a PC or a laptop with the same operating system as a new node to my cluster?
>>> Yes, we can use PC/Laptop. Hadoop supports large-scale distributed data analysis on commodity servers.
As long as the newly added host (laptop/PC) meets the minimum System Requirements that are documented here (based on your HDP/Ambari) version you can browse the link for the correct version: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.3/bk_support-matrices/content/ch_matrices-amb...
.
2. What kind of systems can be used together for constructing hdp clusters?
>>> If you want to know in terms of Hardware then you might want to take a look at : https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_cluster-planning/content/conclusion.html
If you are planning to add "Master" components on the newly added hosts then please take a look at: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_cluster-planning/content/hardware-select...
Similarly for "Slave" hosts the recommendations can be found at: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_cluster-planning/content/hardware-for-sl...
.
Created 11-20-2017 01:08 PM
Regarding your queries:
1. Could I add a PC or a laptop with the same operating system as a new node to my cluster?
>>> Yes, we can use PC/Laptop. Hadoop supports large-scale distributed data analysis on commodity servers.
As long as the newly added host (laptop/PC) meets the minimum System Requirements that are documented here (based on your HDP/Ambari) version you can browse the link for the correct version: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.3/bk_support-matrices/content/ch_matrices-amb...
.
2. What kind of systems can be used together for constructing hdp clusters?
>>> If you want to know in terms of Hardware then you might want to take a look at : https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_cluster-planning/content/conclusion.html
If you are planning to add "Master" components on the newly added hosts then please take a look at: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_cluster-planning/content/hardware-select...
Similarly for "Slave" hosts the recommendations can be found at: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_cluster-planning/content/hardware-for-sl...
.
Created 11-21-2017 08:18 AM
thanks