hi i noticed there is error message"java.io.FileNotFoundException: /u01/dfs/dn/current/BP-773447714-10.214.1.199-1508409724077/current/rbw/blk_1077240000_3499210.meta (No space left on device)" on my datanodes, while there is enough disk space on the machine:
/dev/mapper/vg_root-lv_root 1.8T 34G 1.7T 2% /
tmpfs 63G 0 63G 0%
/dev/shm
/dev/mapper/vg_root-lv_u01 20T 12T 7.9T 59% /u01
/dev/sda1 190M 39M 142M 22% /boot
and i checked hdfs as well, there are more than 30TB remaining.
could anyone point out what i was missing?