Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Why hdfs dfs -setrep -w 2 / keeps waiting?

New Contributor

In my hadoop system, there are some files which are under replicated.

hdfs dfs -setrep -w 2 /user/oozie/tmp/test2/workflow.xml

5.png
Waiting for /user/oozie/tmp/test2/workflow.xml..............................................................................................................................................................................................................................
I wait the whole day, but it keeps waiting. it its a small file.

this is my env:

2.png3.png4.png

and I use fsck and recoverLease, but not helpful.

6.png7.png

 

Why hdfs dfs -setrep -w 2 / keeps waiting?

1 REPLY 1

Cloudera Employee

Can you run fsck with -blocks option to get the datanode address. 

hadoop fsck /user/oozie/tmp/test2/workflow.xml -files -blocks 


Login to the datanode and check/grep for that particular blockId/filename on the datanode log. Also grep for blockId/filename on the namenode log.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.