@Ricky Chen Ideally 3 data nodes with 2 disks is the good option for storage and compute purpose , in case one data node goes down you can relay on other two node . This with HDFS replication factor set to 2 will help to avoid data loss, is safe option . Make sure you follow same filesystem mount points naming on all data nodes. As an example if you name /grid/0 and /grid/1 mount points then follow same naming convention all three node . List /grid/0 and /grid/1 under dfs.datanode.data.dir property. HDFS disk balancer will take care of cluster wide data balancing. ... View more

Limit ls to few, I mean hdfs dfs -ls /tmp/hive/hive/14* The directory under is of zero bytes drwx------ - hive hdfs 0 2017-09-04 17:10 /tmp/hive/hive/149e8d6a-ad2a-433e-87be-6cb5b27e2b7b/_tmp_space.db Find out older one and start purging them manually till you get a breather !!!. After that get permission to implement Automatic approach ... View more