<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>question Re: How to troubleshoot slow NameNode start up? in Support Questions</title>
    <link>https://community.cloudera.com/t5/Support-Questions/How-to-troubleshoot-slow-NameNode-start-up/m-p/281606#M209476</link>
    <description>&lt;P&gt;&lt;a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/52124"&gt;@Elephanta&lt;/a&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Okay, now with that information I get a better understanding and picture. By default, HDP 2.6 has a replication factor of 3&amp;nbsp; so it's looking to place the other 2 copies on different data nodes that the existing unless you create new files with a replication factor of 1 you will continue to get the unreplicated block errors &lt;span class="lia-unicode-emoji" title=":slightly_smiling_face:"&gt;🙂&lt;/span&gt; but now that you know it's manageable.&lt;/P&gt;&lt;P&gt;Maybe next time you delete files in &lt;STRONG&gt;hdfs&lt;/STRONG&gt; use the&amp;nbsp;&lt;SPAN&gt;&lt;STRONG&gt;-skipTrash&lt;/STRONG&gt; option&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;&lt;SPAN class="pln"&gt;hdfs dfs &lt;/SPAN&gt;&lt;SPAN class="pun"&gt;-&lt;/SPAN&gt;&lt;SPAN class="pln"&gt;rm &lt;/SPAN&gt;&lt;SPAN class="pun"&gt;-&lt;/SPAN&gt;&lt;SPAN class="pln"&gt;skipTrash &lt;/SPAN&gt;&lt;SPAN class="pun"&gt;/&lt;/SPAN&gt;&lt;SPAN class="pln"&gt;path&lt;/SPAN&gt;&lt;SPAN class="pun"&gt;/&lt;/SPAN&gt;&lt;SPAN class="pln"&gt;to&lt;/SPAN&gt;&lt;SPAN class="pun"&gt;/hdfs/&lt;/SPAN&gt;&lt;SPAN class="pln"&gt;file&lt;/SPAN&gt;&lt;SPAN class="pun"&gt;/&lt;/SPAN&gt;&lt;SPAN class="pln"&gt;to&lt;/SPAN&gt;&lt;SPAN class="pun"&gt;/&lt;/SPAN&gt;&lt;SPAN class="pln"&gt;remove&lt;/SPAN&gt;&lt;SPAN class="pun"&gt;/&lt;/SPAN&gt;&lt;SPAN class="pln"&gt;permanently&lt;/SPAN&gt;&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;or emtpyting the existing .Trash&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;Options:&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;Change the replication factor of a file&amp;nbsp; at creatio:&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;hdfs dfs –setrep –w 1&amp;nbsp; /user/hdfs/file.txt&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Or&amp;nbsp; change the replication factor of a directory&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;STRONG&gt;hdfs dfs -setrep -R 1&amp;nbsp; /user/hdfs/your_dir&lt;/STRONG&gt;&lt;/P&gt;&lt;P&gt;&lt;BR /&gt;Changing the replication factor for a directory will only affect the existing files and the new files under the directory will get created with the default replication factor&amp;nbsp; in &lt;STRONG&gt;dfs.replication&lt;/STRONG&gt; from&lt;STRONG&gt; hdfs-site.xml&amp;nbsp; &lt;/STRONG&gt;maybe in your case this is what you should change to 1 as this takes effect cluster-wide for your Dev environment&lt;BR /&gt;Happy hadooping&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Wed, 30 Oct 2019 05:19:35 GMT</pubDate>
    <dc:creator>Shelton</dc:creator>
    <dc:date>2019-10-30T05:19:35Z</dc:date>
  </channel>
</rss>

