question Re: Percentage under replicated blocks: 100.00% in Archives of Support Questions (Read Only)

Percentage under replicated blocks: 100.00%

richie78 — Tue, 31 Oct 2017 15:55:01 GMT

Brand new to Cloudera I have used Cloudera manager to install on a single node for trial purposes. After install there is a helth warning on HDFS -
Under-Replicated Blocks:

283 under replicated blocks in the cluster. 283 total blocks in the cluster. Percentage under replicated blocks: 100.00%. Critical threshold: 40.00%.

Not sure what could cause this I have Googled around and not really found anything.

Re: Percentage under replicated blocks: 100.00%

Darren — Wed, 01 Apr 2015 22:51:56 GMT

Your default replication factor is probably 3. Since you only have one node, that's impossible to satisfy.

On single-node clusters, you should reduce the replication factor to 1 in HDFS configuration in Cloudera Manager. Note that this only affects newly created files. Your existing files will still try to replicate to 3 hosts unless you change them explicitly (you should be able to google how to change a file's replication factor).

Thanks,
Darren

Re: Percentage under replicated blocks: 100.00%

Guru007 — Mon, 02 Nov 2015 10:33:59 GMT

Please use below command to chang ethe replication factor for existing data on Hadoop FS

$ hadoop fs -setrep -R -w 2 /

Note: You may mention number according to your requirement to have the replication factor.

$ hdfs fsck / -delete

Re: Percentage under replicated blocks: 100.00%

KannanAK — Sat, 09 Jul 2016 06:26:17 GMT

I faced the same issue, even though I changed the replication factor, the error still showed up.

After running , hadoop fs -setrep -R -w 2, the error is fixed.

Can you please let us know what's the purpose of hdfs fsck / -delete command? It will delete under-replicated or corrupted blocks?

Re: Percentage under replicated blocks: 100.00%

Jeno — Wed, 25 Oct 2017 12:18:04 GMT

Hi!

Yes - from documentation (https://hadoop.apache.org/docs/r1.2.1/commands_manual.html#fsck😞

fsck

Runs a HDFS filesystem checking utility.

COMMAND_OPTION	Description
-delete	Delete corrupted files.

Re: Percentage under replicated blocks: 100.00%

Manindar — Wed, 18 Jul 2018 10:14:16 GMT

I had a 3 node cluster, in that node#1 has both DN + NN and node#2 & node#3 has only DN.

Now Node#2 & Node#3 were down. And i had free RAM and free disk space available in Node#1.

Ideally Hadoop should replicate the blocks from dead nodes i.e. Node#2&3 and should be recreated in Node#1 itself to maintain replication factor 3. But it is not happening. I had waited for hours, but not seeing any progress and showing the same health issues in cloudera manager.

Note: The same behaviour is also observed when only Node#3 is down and Node#1 & Node#2 are up and running.

Can someone please respond why this is happening?

Re: Percentage under replicated blocks: 100.00%

manuroman — Wed, 18 Jul 2018 10:43:32 GMT

Hi @Manindar,

The replication data just happens on other dataNodes, hadoop does not replicate in the same host.

If you only have one node Up, you only will hava one copy of data.

Can you post your nameNode log?? Thanks.

Regards,

Manu.

Re: Percentage under replicated blocks: 100.00%

bgooley — Wed, 18 Jul 2018 21:21:16 GMT

@Manindar,

Indeed, if you have a replication factor of 3 and only one DataNode is alive, then there is nowhere to replicate. 3 nodes with a replication factor of 3 means the blocks are already on that one node and there is nothing to replicate/move.