Created 04-29-2020 02:49 AM
Hello,
Is there a way to check the replication factor of a particular folder in HDFS?
While we have default replication set to 3 in CM for some reason files being uploaded in a particular folder shows up with replication factor of 1.
Regards
Wert
Created on 04-30-2020 10:31 AM - edited 04-30-2020 10:33 AM
Created on 04-29-2020 05:14 AM - edited 04-29-2020 05:16 AM
@wert_1311 You can use the HDFS command line to ls the file.
The second column of the output will show the replication factor of the file.
For example,
$ hdfs dfs -ls /usr/GroupStorage/data1/out.txt
-rw-r--r-- 3 hadoop test 11906625598 2020-04-29 17:31 /usr/GroupStorage/data1/test
Here the replication factor is 3.
Created 04-29-2020 11:35 PM
Thanks for your reply, what I am trying to zero in, is why some files (recently put) are getting created with RF 1 rather than RF 3. I have checked multiple sites but failed to get some answers, and hitting the wall. Would appreciate if there are any suggestions / pointer that I could check to fix this issue.
My Issue is as below:
/User 1/logs/User1Logs >>> files under this folder have replication factor of 1.
/User 2/logs/User2Logs >>> files under this folder have replication factor of 1
/User 3/logs/User3Logs >>> files under this folder have replication factor of 3
Regards
Wert
Created on 04-30-2020 10:31 AM - edited 04-30-2020 10:33 AM