HDFS not start ( after new cluster installation )

[#1]

we installed new HDP cluster version 2.6

meanwhile HDFS and yarn are down and when we start the HDFS we get:

2017-10-23 16:39:35,510 ERROR datanode.DataNode (DataNode.java:secureMain(2691)) - Exception in secureMain org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 5, volumes failed: 5, volume fail ures tolerated: 0 at org.apache.hadoop.hdfs.server.datanode.checker.StorageLocationChecker.check(StorageLocationChecker.java:216) at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2583) at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2492) at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2539) at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2684) at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2708) 2017-10-23 16:39:35,512 INFO util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting with status 1 2017-10-23 16:39:35,515 INFO datanode.DataNode (LogAdapter.java:info(47)) - SHUTDOWN_MSG:

what we need to check in this case ?

[#2 · Accepted solution]

@uri ben-ari

This looks like a mount issue or due to some reasons the data.dir is not readable/accessible. Can you please check from the OS side if there any disk/mount issue?

Please check for Bad Mounts. A system admin can help better in mount/disk related issues. May be looking at the "/var/log/messages" can give some idea.

Also can you please check the "dfs.datanode.data.dir" directory to findout if there is any issue. Please share value of this property and also check the permission.

.