https://community.cloudera.com/t5/Support-Questions/Distributed-I-O-Benchmark-of-HDFS/m-p/237183#M198996 <P><BR /></P><P>hi all</P><P><BR /></P><P>DFSIO is a built-in benchmark tool for HDFS I/O test. </P><H2>we created the Base Directory to Store Test Results<A href="https://bdaafall2015.readthedocs.io/en/latest/dfsio.html#base-directory-to-store-test-results"></A></H2><P><CODE>/benchmarks/TestDFSIO</CODE></P><P><BR /></P><P>and when we run the test we get:</P><P><BR /></P><PRE> hadoop jar /usr/hdp/2.6.4.0-91/spark2/jars/hadoop-mapreduce-client-jobclient-2.7.3.2.6.4.0-91.jar TestDFSIO -write -nrFiles 16 -fileSize 1GB -resFile /tmp/USER-dfsio-write.txt 19/03/31 05:39:57 INFO fs.TestDFSIO: TestDFSIO.1.8 19/03/31 05:39:57 INFO fs.TestDFSIO: nrFiles = 16 19/03/31 05:39:57 INFO fs.TestDFSIO: nrBytes (MB) = 1024.0 19/03/31 05:39:57 INFO fs.TestDFSIO: bufferSize = 1000000 19/03/31 05:39:57 INFO fs.TestDFSIO: baseDir = /benchmarks/TestDFSIO 19/03/31 05:39:59 INFO fs.TestDFSIO: creating control file: 1073741824 bytes, 16 files java.io.IOException: Permission denied: user=root, access=WRITE, inode="/benchmarks/TestDFSIO/io_control/in_file_test_io_0":hdfs:hdfs:drwxr-xr-x</PRE><P><BR /></P><P>where we are wrong?</P> Sun, 31 Mar 2019 13:13:41 GMT mike_bronson7 2019-03-31T13:13:41Z https://community.cloudera.com/t5/Support-Questions/Distributed-I-O-Benchmark-of-HDFS/m-p/237183#M198996 <P><BR /></P><P>hi all</P><P><BR /></P><P>DFSIO is a built-in benchmark tool for HDFS I/O test. </P><H2>we created the Base Directory to Store Test Results<A href="https://bdaafall2015.readthedocs.io/en/latest/dfsio.html#base-directory-to-store-test-results"></A></H2><P><CODE>/benchmarks/TestDFSIO</CODE></P><P><BR /></P><P>and when we run the test we get:</P><P><BR /></P><PRE> hadoop jar /usr/hdp/2.6.4.0-91/spark2/jars/hadoop-mapreduce-client-jobclient-2.7.3.2.6.4.0-91.jar TestDFSIO -write -nrFiles 16 -fileSize 1GB -resFile /tmp/USER-dfsio-write.txt 19/03/31 05:39:57 INFO fs.TestDFSIO: TestDFSIO.1.8 19/03/31 05:39:57 INFO fs.TestDFSIO: nrFiles = 16 19/03/31 05:39:57 INFO fs.TestDFSIO: nrBytes (MB) = 1024.0 19/03/31 05:39:57 INFO fs.TestDFSIO: bufferSize = 1000000 19/03/31 05:39:57 INFO fs.TestDFSIO: baseDir = /benchmarks/TestDFSIO 19/03/31 05:39:59 INFO fs.TestDFSIO: creating control file: 1073741824 bytes, 16 files java.io.IOException: Permission denied: user=root, access=WRITE, inode="/benchmarks/TestDFSIO/io_control/in_file_test_io_0":hdfs:hdfs:drwxr-xr-x</PRE><P><BR /></P><P>where we are wrong?</P> Sun, 31 Mar 2019 13:13:41 GMT https://community.cloudera.com/t5/Support-Questions/Distributed-I-O-Benchmark-of-HDFS/m-p/237183#M198996 mike_bronson7 2019-03-31T13:13:41Z https://community.cloudera.com/t5/Support-Questions/Distributed-I-O-Benchmark-of-HDFS/m-p/237184#M198997 <P><A rel="user" href="https://community.cloudera.com/users/26229/uribarih.html" nodeid="26229">@Michael Bronson</A>, Permission issue <span class="lia-unicode-emoji" title=":slightly_smiling_face:">🙂</span> Either run this command with <STRONG>hdfs </STRONG>user or change the ownership of /benchmarks/TestDFSIO to root. </P><PRE><P>java.io.IOException: Permission denied: user=root, access=WRITE, inode="/benchmarks/TestDFSIO/io_control/in_file_test_io_0":hdfs:hdfs:drwxr-xr-x&nbsp;</P></PRE> Mon, 01 Apr 2019 16:53:10 GMT https://community.cloudera.com/t5/Support-Questions/Distributed-I-O-Benchmark-of-HDFS/m-p/237184#M198997 sandyy006 2019-04-01T16:53:10Z