<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>question Re: Fail to start HDFS in Cluster Setup in Support Questions</title>
    <link>https://community.cloudera.com/t5/Support-Questions/Re-Fail-to-start-HDFS-in-Cluster-Setup/m-p/65300#M55950</link>
    <description>&lt;P&gt;I have the issue&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;DIV class="description"&gt;&lt;SPAN&gt;Creating HDFS /tmp directory&lt;/SPAN&gt;&lt;/DIV&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;PRE&gt;Command (Create /tmp Directory (241)) has failed&lt;/PRE&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;---------&lt;/P&gt;&lt;PRE&gt;Mon Mar 12 16:22:02 +03 2018
Current working directory: /run/cloudera-scm-agent/process/115-hdfs-NAMENODE-createtmp
Launching one-off process: /usr/lib64/cmf/service/hdfs/hdfs.sh mkdir /tmp hdfs supergroup 1777
Mon Mar 12 16:22:02 +03 2018
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
using /usr/java/jdk1.7.0_67-cloudera as JAVA_HOME
using 5 as CDH_VERSION
using /run/cloudera-scm-agent/process/115-hdfs-NAMENODE-createtmp as CONF_DIR
using  as SECURE_USER
using  as SECURE_GROUP
CONF_DIR=/run/cloudera-scm-agent/process/115-hdfs-NAMENODE-createtmp
CMF_CONF_DIR=/etc/cloudera-scm-agent
unlimited
2018-03-12 15:22:04 WARN  NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Directory /tmp does not currently exist.
2018-03-12 15:22:04 WARN  CreateHdfsDirUtil:377 - Connection failed 1 time(s). Trying again...
Directory /tmp does not currently exist.
2018-03-12 15:22:05 WARN  CreateHdfsDirUtil:377 - Connection failed 2 time(s). Trying again...
Directory /tmp does not currently exist.
2018-03-12 15:22:06 WARN  CreateHdfsDirUtil:377 - Connection failed 3 time(s). Trying again...
Directory /tmp does not currently exist.
2018-03-12 15:22:07 WARN  CreateHdfsDirUtil:377 - Connection failed 4 time(s). Trying again...
Directory /tmp does not currently exist.
2018-03-12 15:22:08 WARN  CreateHdfsDirUtil:377 - Connection failed 5 time(s). Trying again...
Directory /tmp does not currently exist.&lt;/PRE&gt;&lt;P&gt;-----&lt;/P&gt;&lt;P&gt;There is enough space but gives error:&lt;/P&gt;&lt;TABLE&gt;&lt;TBODY&gt;&lt;TR&gt;&lt;TD&gt;2:33:51.723 PM&lt;/TD&gt;&lt;TD&gt;WARN&lt;/TD&gt;&lt;TD&gt;NameNodeResourceChecker&lt;/TD&gt;&lt;TD&gt;&lt;PRE&gt;Space available on volume '/dev/mapper/centos_node1-root' is 0, which is below the configured reserved amount 104857600&lt;/PRE&gt;&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;2:33:51.723 PM&lt;/TD&gt;&lt;TD&gt;WARN&lt;/TD&gt;&lt;TD&gt;FSNamesystem&lt;/TD&gt;&lt;TD&gt;&lt;PRE&gt;NameNode low on available disk space. Already in safe mode.&lt;/PRE&gt;&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;2:33:51.724 PM&lt;/TD&gt;&lt;TD&gt;INFO&lt;/TD&gt;&lt;TD&gt;StateChange&lt;/TD&gt;&lt;TD&gt;&lt;PRE&gt;STATE* Safe mode is ONResources are low on NN. Please add or free up more resources then turn off safe mode manually. NOTE:  If you turn off safe mode before adding resources, the NN will immediately return to safe mode. Use "hdfs dfsadmin -safemode leave" to turn safe mode off.&lt;/PRE&gt;&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;2:33:53.138 PM&lt;/TD&gt;&lt;TD&gt;WARN&lt;/TD&gt;&lt;TD&gt;UserGroupInformation&lt;/TD&gt;&lt;TD&gt;&lt;PRE&gt;PriviledgedActionException as:hdfs (auth:SIMPLE) cause:org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /tmp/.cloudera_health_monitoring_canary_files. Name node is in safe mode.
Resources are low on NN. Please add or free up more resources then turn off safe mode manually. NOTE:  If you turn off safe mode before adding resources, the NN will immediately return to safe mode. Use "hdfs dfsadmin -safemode leave" to turn safe mode off.&lt;/PRE&gt;&lt;/TD&gt;&lt;/TR&gt;&lt;TR&gt;&lt;TD&gt;2:33:53.139 PM&lt;/TD&gt;&lt;TD&gt;INFO&lt;/TD&gt;&lt;TD&gt;Server&lt;/TD&gt;&lt;TD&gt;&lt;PRE&gt;IPC Server handler 8 on 8020, call org.apache.hadoop.hdfs.protocol.ClientProtocol.mkdirs from 10.0.0.1:52192 Call#447 Retry#0: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /tmp/.cloudera_health_monitoring_canary_files. Name node is in safe mode.
Resources are low on NN. Please add or free up more resources then turn off safe mode manually. NOTE:  If you turn off safe mode before adding resources, the NN will immediately return to safe mode. Use "hdfs dfsadmin -safemode leave" to turn safe mode off.&lt;/PRE&gt;&lt;/TD&gt;&lt;/TR&gt;&lt;/TBODY&gt;&lt;/TABLE&gt;</description>
    <pubDate>Fri, 16 Sep 2022 12:57:41 GMT</pubDate>
    <dc:creator>Michael</dc:creator>
    <dc:date>2022-09-16T12:57:41Z</dc:date>
  </channel>
</rss>

