No worries @PR_224  Glad it's fixed : ) ... View more

Did you get a solution to this issue? Would be grateful for your response. ... View more

To add,   For sizing a datanode heap it's similar to namenode heap, its recommend 1GB per 1M blocks. As a block could be as small a 1byte or as large as 128MB, the requirement of heap space is the same. ... View more

Hi @Harsh J,   Yesterday, I cleaned 50GB worth files from HDFS using fs -rm. The daily incoming size on HDFS is almost 13-15GB(including replication) however today again the size of dfs has increased almost 30-55 GB more. I dont understand why?   Only, on one Datanode the dfs files generated almost 15GB.   [root@DataNode1 finalized]# ls -lrt| grep "Dec 13" drwxr-xr-x 208 hdfs hdfs 4096 Dec 13 05:59 subdir130 drwxr-xr-x 195 hdfs hdfs 4096 Dec 13 06:52 subdir132 drwxr-xr-x 210 hdfs hdfs 4096 Dec 13 07:24 subdir134 drwxr-xr-x 188 hdfs hdfs 4096 Dec 13 07:32 subdir135 drwxr-xr-x 187 hdfs hdfs 4096 Dec 13 08:30 subdir138 drwxr-xr-x 210 hdfs hdfs 4096 Dec 13 09:09 subdir139 drwxr-xr-x 234 hdfs hdfs 12288 Dec 13 09:46 subdir173 drwxr-xr-x 234 hdfs hdfs 12288 Dec 13 10:07 subdir174 drwxr-xr-x 258 hdfs hdfs 12288 Dec 13 15:30 subdir211 ... View more

1. hadoop fs -put <url folder> <target> 2. hadoop jar <deployment-jar> <classname> other_params ... View more

Ok @mbigelow thanks. I also reasearched more and found this hortonworks link, https://community.hortonworks.com/questions/45962/dataxceiver-error-processing-write-block-operation.html where they say we can ignore this error.  This issue has been already fixed in 2.3 version of ambari but of course I am using CDH.   Thanks, Shilpa ... View more

Hi @pdvorak,   thanks a lot for you answer, I've already checked that page and it helped.   Thanks again. DB ... View more

After increasing the Heap size of Datanode role on my NN, I have not seen Hprof files getting created. The issue is resolved.   Thanks @mathieu.d ... View more