question hdfs datanode one volume full in Archives of Support Questions (Read Only)

hdfs datanode one volume full

bigdatacn — Sun, 19 Jun 2016 07:34:55 GMT

I used HDP2.2.0GA and yesterday I found one volume of datanode is full. each datanode has 24volumes. then I checked the full volume and found below information:

1.2T current

539G dncp_block_verification.log.curr

154G dncp_block_verification.log.prev

0 tmp

#########df -h##########

Filesystem Size Used Avail Use% Mounted on

/dev/xvda1 504G 42G 437G 9%

/ tmpfs 58G 0 58G 0% /dev/shm

/dev/xvdb1 1.9T 1.9T 20K 100% /data01

/dev/xvdc1 1.9T 1.2T 682G 64% /data02

/dev/xvdd1 1.9T 1.2T 667G 65% /data03

/dev/xvde1 1.9T 1.2T 675G 64% /data04

.......

#########################

my questions is that how can I balance /dev/xvdb1 with other volumes. is it safe I removed dncp_block_verification.log* ?

Re: hdfs datanode one volume full

pminovic — Sun, 19 Jun 2016 08:17:24 GMT

Your issue is described here. Yes, you can stop your DN, delete dncp_block_verification log files, and restart DN. The issue was fixed in Hadoop-2.7 but I guess you are using an older version.

Re: hdfs datanode one volume full

bigdatacn — Sun, 19 Jun 2016 09:45:18 GMT

I used hdp 2.2 the hadoop version is 2.6 @Predrag Minovic thanks. I did as you said.