Reply
Explorer
Posts: 6
Registered: ‎01-29-2014
Accepted Solution

fsimage NFS backup with HDFS HA QJM

Is it still recommended to add a NFS mount to dfs.namenode.name.dir for off node fsimage backups if using HDFS HA with QJM?

 

Thanks,

-Shane

Posts: 1,524
Kudos: 265
Solutions: 232
Registered: ‎07-31-2013

Re: fsimage NFS backup with HDFS HA QJM

This is not really required in a HA setup, since you already have two
independent fsimage copies being made at 2x NNs.

Backline Customer Operations Engineer
Highlighted
New Contributor
Posts: 1
Registered: ‎06-21-2017

Re: fsimage NFS backup with HDFS HA QJM

Hello, harsh.

 

I have a question about this subject. ( I know this is pretty old issue ... )

 

I'm using namenode HA(QJM). And for more redundancy, I set "dfs.namenode.name.dir" to multiple directories and one of them is a nfs mounted on other server( especially on master node ).

 

But in this post and on the Cloudera's deploying guide site( https://www.cloudera.com/documentation/enterprise/5-4-x/topics/cdh_ig_hdfs_cluster_deploy.html ), they say "If you are using HA, you should not configure these directories on an NFS mount".

 

Why Cloudera says that?

Is it just "no more required" NFS under HA? 

or Is there any potential problem using NFS directory under HA?

Announcements