question Is there a command to find the number of blocks pending deletion in HDFS? in Support Questions https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175292#M137551 <P>I am currently deleting a large amount of small files and am needing to monitor the number of blocks pending deletion so I do not put too much of a load on the cluster. I know this number can be viewed in the NameNode UI, but I would like to run a command instead which I can then use in combination with `watch` so I can get continuous updates. Does such a command exist?</P> Wed, 29 Aug 2018 19:49:20 GMT josh_nicholson 2018-08-29T19:49:20Z Is there a command to find the number of blocks pending deletion in HDFS? https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175292#M137551 <P>I am currently deleting a large amount of small files and am needing to monitor the number of blocks pending deletion so I do not put too much of a load on the cluster. I know this number can be viewed in the NameNode UI, but I would like to run a command instead which I can then use in combination with `watch` so I can get continuous updates. Does such a command exist?</P> Wed, 29 Aug 2018 19:49:20 GMT https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175292#M137551 josh_nicholson 2018-08-29T19:49:20Z Re: Is there a command to find the number of blocks pending deletion in HDFS? https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175293#M137552 <P>Hi <A href="https://community.hortonworks.com/questions/215061/is-there-a-command-to-find-the-number-of-blocks-pe.html#">@Josh Nicholson</A></P><P>This works for me, "PendingDeletionBlocks" is what you're looking for in the output if you're looking for pending deletes only.</P><PRE>watch curl --silent <A href="http://&lt;your-name-node&gt;:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem" target="_blank">http://&lt;your-name-node&gt;:50070/jmx?qry=Hadoop:service=NameNode,name=FSNamesystem</A></PRE> Wed, 29 Aug 2018 20:13:48 GMT https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175293#M137552 JonathanSneep 2018-08-29T20:13:48Z Re: Is there a command to find the number of blocks pending deletion in HDFS? https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175294#M137553 <P>I didn't think of querying the JMX, this works fantastically, thanks!<BR /><BR />Actually <A rel="user" href="https://community.cloudera.com/users/84313/jsneep.html" nodeid="84313">@Jonathan Sneep</A> I am not able to curl to the JMX as I need authorization. This cluster is kerberized and using SSL. I tried searching around on how to pass credentials but couldn't find anything. Any ideas?</P> Wed, 29 Aug 2018 20:17:12 GMT https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175294#M137553 josh_nicholson 2018-08-29T20:17:12Z Re: Is there a command to find the number of blocks pending deletion in HDFS? https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175295#M137554 <P>Hey <A rel="user" href="https://community.cloudera.com/users/48501/joshnicholson.html" nodeid="48501">@Josh Nicholson</A><BR />curl --negotiate -u should work, I will test this myself in a bit. </P> Wed, 29 Aug 2018 21:06:07 GMT https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175295#M137554 JonathanSneep 2018-08-29T21:06:07Z Re: Is there a command to find the number of blocks pending deletion in HDFS? https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175296#M137555 <P>That worked, thanks.</P> Wed, 29 Aug 2018 21:19:24 GMT https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175296#M137555 josh_nicholson 2018-08-29T21:19:24Z Re: Is there a command to find the number of blocks pending deletion in HDFS? https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175297#M137556 <P>Perfect, glad to hear!</P> Wed, 29 Aug 2018 21:22:58 GMT https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175297#M137556 JonathanSneep 2018-08-29T21:22:58Z Re: Is there a command to find the number of blocks pending deletion in HDFS? https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175298#M137557 <P>goto Ambari --&gt; HDFS --&gt; QuickLinks --&gt; Master(Active) ... a new page will open ... search "Number of Blocks Pending Deletion"... you will find the pending deletion blocks.. refresh page after 30 sec. counts will be changed... enjoy</P> Tue, 13 Nov 2018 15:08:27 GMT https://community.cloudera.com/t5/Support-Questions/Is-there-a-command-to-find-the-number-of-blocks-pending/m-p/175298#M137557 Burhan33 2018-11-13T15:08:27Z