Created 07-29-2019 08:20 PM
Using HDFS NFS gateway and seeing weird behavior where getting permission errors when trying to write to HDFS via NFS path on a first try, but then able to successfully write immediately after on a second attempt, eg.
$me # tail -n +2 \
/nfsbase/hdfsbase/tests/storage/ACCOUNT/tsv/1_0_0.tsv > \
/nfsbase/hdfsbase/tests/storage/ACCOUNT/tsv/1_0_0.TEST.tsv
zsh: permission denied: /nfsbase/hdfsbase/tests/storage/ACCOUNT/tsv/1_0_0.TEST.tsv
$me #
$me #
$me # tail -n +2 \
/nfsbase/hdfsbase/tests/storage/ACCOUNT/tsv/1_0_0.tsv >
\
/nfsbase/hdfsbase/tests/storage/ACCOUNT/tsv/1_0_0.TEST.tsv
$me #
$me #
$me # hadoop fs -stat /hdfsbase/tests/storage/ACCOUNT/tsv/1_0_0.TEST.tsv 2019-07-29 20:02:22
Is this normal? Maybe due to network latency (if so, any fixes / workarounds)? Any way to stop this and run on first attempt? Any debugging suggestions or fixes?