Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

"Pending Deletion Blocks:[276861]" What does this mean?

Highlighted

"Pending Deletion Blocks:[276861]" What does this mean?

Explorer

One of the disks on one of my data nodes was failing, so I replaced it with the instructions:

1. Stop all services on datanode.

2. shut down the machine.

3. replace the disk

4. power on the machine.

5. mount the disk onto its data point.

6. start all services on HDFS.

Now, I get an alert "Pending Deletion Blocks:[276861]" on Ambari. Did I do something wrong? I can I revert it?

4 REPLIES 4
Highlighted

Re: "Pending Deletion Blocks:[276861]" What does this mean?

Rising Star
@kskp

This is a strange problem. I would check the following things.

1. Check if anyone has done a massive delete operation?

2. Did you mount a disk with data already -- that is a set of data blocks pull out from some other machine/cluster?

3. Please keep the cluster in safe mode, till you puzzle out what happened.

Re: "Pending Deletion Blocks:[276861]" What does this mean?

Explorer

@aengineer Hi, thanks for your reply. It seems someone did perform a massive delete operation on the cluster. The issue is resolved.

Highlighted

Re: "Pending Deletion Blocks:[276861]" What does this mean?

Expert Contributor

@kskp @aengineer

Hi,

I wanted to know how this got resolved? by itself? Actually i dropped a huge table yesterday and today morning i did some config changes and restarted services, after restart i get an alert on ambari saying hdfs block deletion pending... its been more than 30 min, ithe alert is still there on one of the namenode in HA.

Highlighted

Re: "Pending Deletion Blocks:[276861]" What does this mean?

Rising Star

@PJ

I am guessing that it could be related to "dfs.namenode.startup.delay.block.deletion" value since you mention that you restarted the cluster.

Don't have an account?
Coming from Hortonworks? Activate your account here