Support Questions

Find answers, ask questions, and share your expertise

HDFS High Availability - is the Active & standby NN must have the same hardware configuration!?!

avatar
Master Collaborator

Hi,

I found this phrases in the HDFS High Availability (HA) documentation, and I want to know if it obligatory or it's just a recommendation !!!?

source: https://www.cloudera.com/documentation/enterprise/5-14-x/topics/cdh_hag_hdfs_ha_hardware_config.html 

NameNode hosts - These are the hosts on which you run the active and standby NameNodes. They should have equivalent hardware to each other

the host that is chosen should have the same hardware configuration (RAM, disk space, number of cores, and so on) as the active NameNode.

source: https://www.cloudera.com/documentation/enterprise/5-14-x/topics/cdh_hag_hdfs_ha_enabling.html#cmug_t...

Thanks in adcance.

1 ACCEPTED SOLUTION

avatar
Mentor
It is a recommendation based on the fact that active and standby are merely
states of the NameNode and not different daemons.

The NameNode doesn't check it's own hardware to be the same as other
NameNodes if that's what you are worried about.

View solution in original post

4 REPLIES 4

avatar
Champion

Atleast most of the production cluster that i have seen have the unformity interms of hardware configurations and their version , same Vcores , Hard disk is madatory . Because you basically have a copy of the active namenode in the stand by . hope it  helps . 

avatar
Champion

@AcharkiMed

 

Basically this is a recommendation, still it will be considered as Mandatory or Optional depends upon the environment that you are using


Ex:
*) For Prod Env - It is mandatory. Otherwise it will create performance difference if there is any switch between active and standby NN


*) For test/POC Env - It is optional if you don't have right choice

avatar
Master Collaborator

Hi @saranvisa and @csguna
Thanks for your answers,

But I still must to make a disicion about configuring a HDFS HA or not!
My quesion is, if I will configure the HDFS HA with 2 diferent NN is it WORK or NOT ?!
For performence I'll not have a problem because the two servers are very strong (in fact all the ressources in the two hosts far exceeds the recommendations configurations !).

Thanks.

avatar
Mentor
It is a recommendation based on the fact that active and standby are merely
states of the NameNode and not different daemons.

The NameNode doesn't check it's own hardware to be the same as other
NameNodes if that's what you are worried about.