I check the configuration and start/restart the HDFS services. No luck ..still seeing the same problem. I even try the different path and mount the storage to a different location. Still same problem. Old /dfs/dn new /dn01 root@hadoop-dn01:/# ll /dn01 total 24 drwx------ 3 hdfs hdfs 4096 Sep 26 16:19 ./ drwxr-xr-x 27 root root 4096 Oct 3 18:01 ../ drwx------ 2 hdfs hdfs 16384 Sep 26 16:19 lost+found/ root@hadoop-dn01:/# --------------------- Oct 3, 6:45:31.023 PM DEBUG org.apache.htrace.core.Tracer span.receiver.classes = ; loaded no span receivers Oct 3, 6:45:31.161 PM DEBUG org.apache.hadoop.io.nativeio.NativeIO Initialized cache for IDs to User/Group mapping with a cache timeout of 14400 seconds. Oct 3, 6:45:31.161 PM WARN org.apache.hadoop.hdfs.server.datanode.DataNode Invalid dfs.datanode.data.dir /dn01 : EPERM: Operation not permitted at org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmodImpl(Native Method) at org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmod(NativeIO.java:230) at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:708) at org.apache.hadoop.fs.ChecksumFileSystem$1.apply(ChecksumFileSystem.java:500) at org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:481) at org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:497) at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:140) at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:156) at org.apache.hadoop.hdfs.server.datanode.DataNode$DataNodeDiskChecker.checkDir(DataNode.java:2458) at org.apache.hadoop.hdfs.server.datanode.DataNode.checkStorageLocations(DataNode.java:2500) at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2482) at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2374) at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2421) at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2598) at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2622) Oct 3, 6:45:31.164 PM FATAL org.apache.hadoop.hdfs.server.datanode.DataNode Exception in secureMain java.io.IOException: All directories in dfs.datanode.data.dir are invalid: "/dn01/" at org.apache.hadoop.hdfs.server.datanode.DataNode.checkStorageLocations(DataNode.java:2509) at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2482) at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2374) at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2421) at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2598) at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2622) Oct 3, 6:45:31.166 PM INFO org.apache.hadoop.util.ExitUtil Exiting with status 1 Oct 3, 6:45:31.169 PM INFO org.apache.hadoop.hdfs.server.datanode.DataNode SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down DataNode at hadoop-dn01.fhmc.local/10.29.1.4 ************************************************************/ -------------------- Same problem!! -
... View more
