question Re: HDFS data is not decreasing after reducing the replication from 3 to 2 in Support Questions

HDFS data is not decreasing after reducing the replication from 3 to 2

ramsriramadm9 — Thu, 07 Feb 2019 13:51:41 GMT

Re: HDFS data is not decreasing after reducing the replication from 3 to 2

hariprasanthmad — Thu, 07 Feb 2019 14:36:33 GMT

@ram sriram

Changing replication will only apply to new files you need to run this Command to change replication factor for files that already exist

hdfs dfs -setrep -w 1 -R /

Re: HDFS data is not decreasing after reducing the replication from 3 to 2

ramsriramadm9 — Thu, 07 Feb 2019 15:32:41 GMT

@Hariprasanth Madhavan

Thanks for u r reply.i ran that command but still its showing size.

Re: HDFS data is not decreasing after reducing the replication from 3 to 2

hariprasanthmad — Thu, 07 Feb 2019 15:42:51 GMT

Check your snapshot details

hdfs dfs -ls $DIR/.snapshot/

hdfs dfs -setrep -w 2 -R / then restart hdfs services

Re: HDFS data is not decreasing after reducing the replication from 3 to 2

Shelton — Thu, 07 Feb 2019 16:05:38 GMT

@ram sriram

The below command sets your replication factor to 1 for all new files you will create, with a potential data loss unless you are running HDP 3.x which has a new HDFS algorithm EC erasure coding

$ hdfs dfs -setrep -w 1 -R /

As responded above the changes only affect new files you will create. After changing the replication factor you won't see any hdfs size changes until the trash time interval which was set on 360 minutes configured by the hdfs trash interval has been reached

fs.trash.interval

Once the NameNode metadata has been updated, it is the DataNodes which would actually do the operation. There could be some delay, but space is definitely reclaimed.

HTH

Re: HDFS data is not decreasing after reducing the replication from 3 to 2

ramsriramadm9 — Fri, 08 Feb 2019 13:35:46 GMT

Hi @Geoffrey Shelton Okot Thank you for your valuable reply.

Can you please send me a document for Ambari installation on ubuntu.

Re: HDFS data is not decreasing after reducing the replication from 3 to 2

Shelton — Fri, 08 Feb 2019 16:45:49 GMT

@ram sriram

If you found this answer addressed your question, please take a moment to log in and click the "accept" link on the answer.

Can you tag me for "Can you please send me a document for Ambari installation on ubuntu thread" so I see the information you already received.