question Re: Multiple NFS Gateways for HDFS in Archives of Support Questions (Read Only)

Multiple NFS Gateways for HDFS

bsaini — Fri, 12 Feb 2016 08:10:36 GMT

Is it possible to have multiple NFS Gateways on different nodes on a single cluster?

Re: Multiple NFS Gateways for HDFS

nsabharwal — Mon, 19 Aug 2019 08:34:27 GMT

@bsaini

Yes, I just added 2 NFS gateways using ambari in the same cluster.

Re: Multiple NFS Gateways for HDFS

aervits — Fri, 12 Feb 2016 09:08:43 GMT

@bsainiIn the first phase, we have enabled NFSv3 interface access to HDFS. This is done using NFS Gateway, a stateless daemon, that translates NFS protocol to HDFS access protocols as shown in the following diagram. Many instances of such daemon can be run to provide high throughput read/write access to HDFS from multiple clients. As a part of this work, HDFS now has a significant functionality that supports inode ID or file handles, that was done in Apache JIRA HDFS-4489.

Source: http://hortonworks.com/blog/simplifying-data-management-nfs-access-to-hdfs/

Re: Multiple NFS Gateways for HDFS

maykiwogno — Mon, 30 May 2016 19:46:53 GMT

Hi,

If I understand we can start multiple nfs gateway server on multiple servers (datanode, namenode, client hdfs).

if we have (servernfs01, servernfs02, servernfs03) and (client01, client02)

client01# : mount -t nfs servernfs01:/ /test01
client02# : mount -t nfs servernfs02:/ /test02

My question is how to avoir a service interruption ? What's happened if servernfs01 is failed ?

How to keep access to hdfs for client01, in this case ?