Reply
Expert Contributor
Posts: 105
Registered: ‎07-17-2017
Accepted Solution

HDFS High Availability - is the Active & standby NN must have the same hardware configuration!?!

[ Edited ]

Hi,

I found this phrases in the HDFS High Availability (HA) documentation, and I want to know if it obligatory or it's just a recommendation !!!?

source: https://www.cloudera.com/documentation/enterprise/5-14-x/topics/cdh_hag_hdfs_ha_hardware_config.html 

NameNode hosts - These are the hosts on which you run the active and standby NameNodes. They should have equivalent hardware to each other

the host that is chosen should have the same hardware configuration (RAM, disk space, number of cores, and so on) as the active NameNode.

source: https://www.cloudera.com/documentation/enterprise/5-14-x/topics/cdh_hag_hdfs_ha_enabling.html#cmug_t...

Thanks in adcance.

Highlighted
Champion
Posts: 731
Registered: ‎05-16-2016

Re: HDFS High Availability - is the Active & standby NN must have the same hardware configuratio

Atleast most of the production cluster that i have seen have the unformity interms of hardware configurations and their version , same Vcores , Hard disk is madatory . Because you basically have a copy of the active namenode in the stand by . hope it  helps . 

Posts: 465
Topics: 14
Kudos: 77
Solutions: 41
Registered: ‎09-02-2016

Re: HDFS High Availability - is the Active & standby NN must have the same hardware configuratio

@AcharkiMed

 

Basically this is a recommendation, still it will be considered as Mandatory or Optional depends upon the environment that you are using


Ex:
*) For Prod Env - It is mandatory. Otherwise it will create performance difference if there is any switch between active and standby NN


*) For test/POC Env - It is optional if you don't have right choice

Expert Contributor
Posts: 105
Registered: ‎07-17-2017

Re: HDFS High Availability - is the Active & standby NN must have the same hardware configuratio

Hi @saranvisa and @csguna
Thanks for your answers,

But I still must to make a disicion about configuring a HDFS HA or not!
My quesion is, if I will configure the HDFS HA with 2 diferent NN is it WORK or NOT ?!
For performence I'll not have a problem because the two servers are very strong (in fact all the ressources in the two hosts far exceeds the recommendations configurations !).

Thanks.

Posts: 1,664
Kudos: 325
Solutions: 262
Registered: ‎07-31-2013

Re: HDFS High Availability - is the Active

It is a recommendation based on the fact that active and standby are merely
states of the NameNode and not different daemons.

The NameNode doesn't check it's own hardware to be the same as other
NameNodes if that's what you are worried about.
Announcements