question Re: Multi-node cluster installation, can master and slave be on same host? in Archives of Support Questions (Read Only)

Multi-node cluster installation, can master and slave be on same host?

varun85 — Fri, 16 Sep 2022 09:37:59 GMT

Sorry if my question appears to be naïve. We are planning to use CDH 5.3.0 or 5.4.0. We want to implement a multi-node cluster.

The example multi-node installations that I have seen/read on different blogs/resources have master and slaves on different hosts.

However, we are restrained by the number of hosts. We have only 2 powerful hosts ( 32 cores 400+ GB RAM), so if we decide to have master

on one and slave on other, we will end up with only one slave. My questions are :

1. Is it possible to have master and slave on the same hosts?

2. Can I have more than one slave node on a single host.

3. Also does one need to pay to use Cloudera Manager or it is open-source like the rest of the components.

If you can point me in the direction of some resource which would help me understand above scenarios it would be helpful.

Thanks for your help.

Regards,

Varun

Re: Multi-node cluster installation, can master and slave be on same host?

Josh — Fri, 21 Aug 2015 13:48:53 GMT

It is possable to run all CDH services on a single host so mixing "Master" services and "Slave" services is possable. So yes you can build a cluster with just 2 nodes. You will likely have a bit or resource contention.

If you are just looking to test out Hadoop and CDH this kind of enviroment it just fine but it is not recomeneded for production use.

Another option would be to build VMs and deploy in a virtual enviroment allowing for better control of resources and resource contention.

You can use most of the features in Cloudera Manager for free with Cloudera Express.

What region are you in? We could have a local representative contact you.

Thanks

Josh

Re: Multi-node cluster installation, can master and slave be on same host?

varun85 — Sat, 22 Aug 2015 21:56:23 GMT

Hi,
Thanks for your response.
I am based in Glasgow UK.