How to improve the performance of NFS Server?

[#1]

A customer is experiencing slowness with NFS when copying large files through NFS.

Question:

1) Is NFS recommended for large files?

2) What performance tuning options are available for NFS Server?

[#2]

Are you talking about HDFS NFS Gateway ?.

[#3]

Yes. The HDFS gateway

[#4 · Accepted solution]

Did the customer use the 'sync' option while mounting the share on the NFS client? Large file transfers (few GBs and larger) are slow without 'sync' and often stall completely.

https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HdfsNfsGateway.html#Mount_the_...

'sync' ensures that the client will not reorder writes. Reordered writes force the NFS gateway to buffer data since HDFS only supports sequential writes (appends). You can also try increasing 'nfs.rtmax' and 'nfs.wtmax' in the NFS gateway configuration as recommended in the same link.

It looks like we are missing NFS Gateway documentation in the the HDP docs. I'll make sure we get that updated.