Support Questions
Find answers, ask questions, and share your expertise

Install DataNode Role on NameNode/SNN machine

Solved Go to solution
Highlighted

Install DataNode Role on NameNode/SNN machine

New Contributor

Hi all,

can I install an HDFS datanode role in machine with installed HDFS NameNode or into machine with SecondaryNameNode?

I use CDH 6.3.2

 

Thanks,

Francesco

2 ACCEPTED SOLUTIONS

Accepted Solutions
Highlighted

Re: Install DataNode Role on NameNode/SNN machine

Expert Contributor

@fransyk 

 

Yes, you can have datanode and namenode role together on a host as long as the hardware requirements are met for the service to avoid any out of memory issues.

 

Please refer 

https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_hardware_requirements.h...

 

Hope this helps,
Paras
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

View solution in original post

Highlighted

Re: Install DataNode Role on NameNode/SNN machine

Expert Contributor

@fransyk 

 

It is not compulsory to have both the roles on different hosts. 

Having said that, in production environments it is recommended to differentiate worker hosts and master hosts.

 

Please refer below document for recommended role allocations for different cluster sizes:

 

https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_ig_host_allocations.html#concept...

 

Hope this helps,
Paras
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

 

View solution in original post

4 REPLIES 4
Highlighted

Re: Install DataNode Role on NameNode/SNN machine

Expert Contributor

@fransyk 

 

Yes, you can have datanode and namenode role together on a host as long as the hardware requirements are met for the service to avoid any out of memory issues.

 

Please refer 

https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_hardware_requirements.h...

 

Hope this helps,
Paras
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

View solution in original post

Highlighted

Re: Install DataNode Role on NameNode/SNN machine

New Contributor
Highlighted

Re: Install DataNode Role on NameNode/SNN machine

Expert Contributor

@fransyk 

 

It is not compulsory to have both the roles on different hosts. 

Having said that, in production environments it is recommended to differentiate worker hosts and master hosts.

 

Please refer below document for recommended role allocations for different cluster sizes:

 

https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_ig_host_allocations.html#concept...

 

Hope this helps,
Paras
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

 

View solution in original post

Highlighted

Re: Install DataNode Role on NameNode/SNN machine

Cloudera Employee

The data node question has been answered, but one tangental comment - you say you are using the Secondary Name Node service. You almost certainly do not want to be using that. You do not get any HA with the SNN. What you probably want is the Standby Namenode. In Cloudera Manager you can enable HA from the HDFS service actions and that will replace your Secondary Name Node with a Standby Name Node.