/var/log/hadoop/hdfs/hadoop-hdfs-datanode-mpdemo-118-2-1.log 2017-01-05 16:54:29,364 INFO ipc.Server (Server.java:run(1045)) - IPC Server Responder: starting 2017-01-05 16:54:29,365 INFO ipc.Server (Server.java:run(881)) - IPC Server listener on 8010: starting 2017-01-05 16:54:29,683 INFO common.Storage (DataStorage.java:getParallelVolumeLoadThreadsNum(384)) - Using 1 threads to upgrade data directories (dfs.datanode.parallel.volumes.load.threads.num=1, dataDirs=1) 2017-01-05 16:54:29,697 INFO common.Storage (Storage.java:tryLock(774)) - Lock on /tmp/hadoop-hdfs/dfs/data/in_use.lock acquired by nodename 8335@mpdemo-118-2-1.field.hortonworks.com 2017-01-05 16:54:29,701 WARN common.Storage (DataStorage.java:loadDataStorage(449)) - Failed to add storage directory [DISK]file:/tmp/hadoop-hdfs/dfs/data/ org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Directory /tmp/hadoop-hdfs/dfs/data is in an inconsistent state: Can't format the storage directory because the current/ directory is not empty. at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.checkEmptyCurrent(Storage.java:480) at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.analyzeStorage(Storage.java:585) at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadStorageDirectory(DataStorage.java:299) at org.apache.hadoop.hdfs.server.datanode.DataStorage.loadDataStorage(DataStorage.java:438) at org.apache.hadoop.hdfs.server.datanode.DataStorage.addStorageLocations(DataStorage.java:417) at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:595) at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1483) at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1448) at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:319) at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:267) at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:740) at java.lang.Thread.run(Thread.java:745) 2017-01-05 16:54:29,706 ERROR datanode.DataNode (BPServiceActor.java:run(752)) - Initialization failed for Block pool (Datanode Uuid unassigned) service to mpdemo-118-1-0.field.hortonworks.com/172.26.235.48:8020. Exiting. java.io.IOException: All specified directories are failed to load. at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:596) at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1483) at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1448) at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:319) at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:267) at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:740) at java.lang.Thread.run(Thread.java:745) 2017-01-05 16:54:29,707 WARN datanode.DataNode (BPServiceActor.java:run(776)) - Ending block pool service for: Block pool (Datanode Uuid unassigned) service to mpdemo-118-1-0.field.hortonworks.com/172.26.235.48:8020 2017-01-05 16:54:29,812 INFO datanode.DataNode (BlockPoolManager.java:remove(103)) - Removed Block pool (Datanode Uuid unassigned) 2017-01-05 16:54:31,813 WARN datanode.DataNode (DataNode.java:secureMain(2637)) - Exiting Datanode 2017-01-05 16:54:31,815 INFO util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting with status 0 2017-01-05 16:54:31,819 INFO datanode.DataNode (LogAdapter.java:info(47)) - SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down DataNode at mpdemo-118-2-1.field.hortonworks.com/172.26.235.50 ************************************************************/