https://community.cloudera.com/t5/Archives-of-Support-Questions/AMBARI-HDFS-is-100/m-p/202786#M71825 <P>from the article - How to identify what is consuming space in HDFS </P><P>* ( link <A href="https://community.hortonworks.com/articles/16846/how-to-identify-what-is-consuming-space-in-hdfs.html">https://community.hortonworks.com/articles/16846/how-to-identify-what-is-consuming-space-in-hdfs.html</A> ) , </P><P>by running the script ( from the article ) , we can see who take the most space </P><P>so in our case - spark-history take the most space , and we deleted the logs/files from Ambari-GUI </P><H1> </H1> Sun, 26 Nov 2017 21:08:17 GMT mike_bronson7 2017-11-26T21:08:17Z https://community.cloudera.com/t5/Archives-of-Support-Questions/AMBARI-HDFS-is-100/m-p/202785#M71824 <P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="42761-capture.png" style="width: 208px;"><img src="https://community.cloudera.com/t5/image/serverpage/image-id/17334i59A5A557B86A42BE/image-size/medium?v=v2&amp;px=400" role="button" title="42761-capture.png" alt="42761-capture.png" /></span></P><P>from ambari dashboard we can see that HDFS is 100%</P><P>I start with</P><PRE>hadoop fs -du -h / | grep spark2-history 60.9 G /spark2-history</PRE><P>* other way to see who take space is from - <A href="https://community.hortonworks.com/articles/16846/how-to-identify-what-is-consuming-space-in-hdfs.html" target="_blank" rel="nofollow noopener noreferrer">https://community.hortonworks.com/articles/16846/how-to-identify-what-is-consuming-space-in-hdfs.html</A></P><P>is it mean that spark-history take from HDFS 60.9G ?</P><P>if not how the know what need to clean from the HDFS ?</P><P>we have 5 workers machine</P><P>and each worker have the following:</P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="42762-capture.png" style="width: 399px;"><img src="https://community.cloudera.com/t5/image/serverpage/image-id/17335i0041FE57294B8079/image-size/medium?v=v2&amp;px=400" role="button" title="42762-capture.png" alt="42762-capture.png" /></span></P> Sun, 18 Aug 2019 05:18:30 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/AMBARI-HDFS-is-100/m-p/202785#M71824 mike_bronson7 2019-08-18T05:18:30Z https://community.cloudera.com/t5/Archives-of-Support-Questions/AMBARI-HDFS-is-100/m-p/202786#M71825 <P>from the article - How to identify what is consuming space in HDFS </P><P>* ( link <A href="https://community.hortonworks.com/articles/16846/how-to-identify-what-is-consuming-space-in-hdfs.html">https://community.hortonworks.com/articles/16846/how-to-identify-what-is-consuming-space-in-hdfs.html</A> ) , </P><P>by running the script ( from the article ) , we can see who take the most space </P><P>so in our case - spark-history take the most space , and we deleted the logs/files from Ambari-GUI </P><H1> </H1> Sun, 26 Nov 2017 21:08:17 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/AMBARI-HDFS-is-100/m-p/202786#M71825 mike_bronson7 2017-11-26T21:08:17Z