Support Questions

Find answers, ask questions, and share your expertise

HDFS storage space

avatar
Explorer

I used the count command to view the HDFS directory of the cluster, and there is still 9T of storage space left. However, when I upload a 2MB file, I will report that the space is insufficient. Has anyone encountered this situation before

2 REPLIES 2

avatar
Explorer

My HDFS version number is 3.0.0+cdh6.3.2. Is this a bug?

avatar
Expert Contributor

Hi Team,

Did you use hdfs dfsadmin -report command to check the dfs and non-dfs used, dfs is used by HDFS so i blieve 9TB is complete storage with dfs and nondfs. Now when you copying the file to hdfs have you enable the debug

HADOOP_ROOT_LOGGER=DEBUG,console

Also try to run the below command it will copy the file from local to hdfs

hdfs dfs -Ddfs.replication=#noofdatanodes -put /tmp/<3mbfile> /tmp