Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 05-04-2017 12:53 AM
Hi, I am installing CDH with CM (Path C) , but I can't create HDFS directory /tmp successfully. The log shows:
2017-05-03 22:17:27,838 WARN org.apache.hadoop.hdfs.server.namenode.NameNodeResourceChecker: Space available on volume '/dev/disk/by-uuid/526841aa-13c2-4953-94ee-992b7f2fe6c9' is 0, which is below the configured reserved amount 104857600
2017-05-03 22:17:27,838 WARN org.apache.hadoop.hdfs.server.namenode.FSNamesystem: NameNode low on available disk space. Already in safe mode.
2017-05-03 22:17:27,838 INFO org.apache.hadoop.hdfs.StateChange: STATE* Safe mode is ONResources are low on NN. Please add or free up more resources then turn off safe mode manually. NOTE: If you turn off safe mode before adding resources, the NN will immediately return to safe mode. Use "hdfs dfsadmin -safemode leave" to turn safe mode off.
+ /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-hdfs/bin/hdfs --config /opt/cloudera-manager/cm-5.4.7/run/cloudera-scm-agent/process/60-hdfs-NAMENODE-createtmp dfs -mkdir -p /tmp mkdir: Cannot create directory /tmp. Name node is in safe mode.
+ '[' 1 -eq 0 ']' + echo 'Unable to create directory /tmp; see stderr log.'
+ exit 1
but when I check with 'df -h' , it shows I should have enough disk space:
lrwxrwxrwx 1 root root 10 Apr 22 09:35 /dev/disk/by-uuid/526841aa-13c2-4953-94ee-992b7f2fe6c9 -> ../../sda1
Filesystem Size Used Avail Use% Mounted on
udev 32G 4.0K 32G 1% /dev
tmpfs 6.3G 1.6M 6.3G 1% /run
/dev/sda1 212G 124G 78G 62% /
......
BTW, I have re-installed several times.
Any suggestion will be appreciated.
Created 05-05-2017 05:42 AM
Got it fixed!
Directory '/dfs/nn' has been removed before, but 'dfs/dn' is still there! After I removed all these directories, it works!
Created 05-04-2017 02:50 AM
Could you check your hdfs-site.xml
for the below parameter
dfs.namenode.resource.du.reserved
looks like you have allocated only 100MB - i can see that in you error log.
Increase it accordingly and restart the namenode . it should fix the problem
Created 05-04-2017 07:23 AM
Go to the path it mentioned and run the command "du -sh" and make sure it is greater than reserved amount 104857600
Created 05-05-2017 05:42 AM
Got it fixed!
Directory '/dfs/nn' has been removed before, but 'dfs/dn' is still there! After I removed all these directories, it works!