Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Why hdfs dfs -setrep -w 2 / keeps waiting?

avatar
New Contributor

In my hadoop system, there are some files which are under replicated.

hdfs dfs -setrep -w 2 /user/oozie/tmp/test2/workflow.xml

5.png
Waiting for /user/oozie/tmp/test2/workflow.xml..............................................................................................................................................................................................................................
I wait the whole day, but it keeps waiting. it its a small file.

this is my env:

2.png3.png4.png

and I use fsck and recoverLease, but not helpful.

6.png7.png

 

Why hdfs dfs -setrep -w 2 / keeps waiting?

1 REPLY 1

avatar
Contributor

Can you run fsck with -blocks option to get the datanode address. 

hadoop fsck /user/oozie/tmp/test2/workflow.xml -files -blocks 


Login to the datanode and check/grep for that particular blockId/filename on the datanode log. Also grep for blockId/filename on the namenode log.