I am trying to improve NFS Gateway Performance for hortonworks HDP 2.6 on ubuntu14.04. The following tuning parameters are defined:
/etc/hadoop/conf/hadoop-env.sh:
HADOOP_NFS3_OPTS="-Xmx4096m -Dhadoop.security.logger=ERROR,DRFAS ${HADOOP_NFS3_OPTS}"
/etc/hadoop/conf/hdfs-site.xml:
<property>
<name>dfs.nfs.rtmax</name>
<value>16777216</value>
</property>
<property>
<name>dfs.nfs.wtmax</name>
<value>16777216</value>
</property>
Next, I mount the NFS volume from a linux client:
# mount -t nfs -o vers=3,proto=tcp,nolock,sync,<strong>rsize=16777216,wsize=16777216</strong> my-nfs-gateway.internal:/nfsvol /localdir
The problem is that listing the mounts shows that rsize and wsize is incorrectly set:
# mount
my-nfs-gateway.internal:/nfsvol on /localdir type nfs (rw,relatime,sync,vers=3,<strong>rsize=1048576,wsize=1048576</strong>,namlen=255,hard,nolock,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.0.2.1,mountvers=3,mountport=4242,mountproto=tcp,local_lock=all,addr=10.0.2.1)
How do I set rsize and wsize to 16777216 on the linux client?
I can only get around 40MB/sec during my testing...
# time dd if=/dev/zero of=/localdir/testfile bs=7M
232+0 records in
232+0 records out
1702887424 bytes (1.7 GB) copied, 41.1506 s, 41.4 MB/s
How can I improve this transfer rate?
regards,
Ryan
