We recently noticed that our cluster namenode UI showed there were almost 100 million blocks pending for deletion and our cluster running out of free space. Apperently the threads which handle block deletion hung or died. The problem was fixed by rebooting the hdfs cluster.
Our cluster is not busy when this problem happend, is this a known issue to cloudera? We didn't find other problems with the cluster.