Created on 02-10-2021 10:14 PM - edited 09-16-2022 07:40 AM
Hello,
I am trying to execute hdfs fsck command and am getting below error:
[root@server1 root]# hdfs fsck / > /home/test/fsck_output_2-11-21
Connecting to namenode via http://server1.com:50070/fsck?ugi=hdfs&path=%2F
Exception in thread "main" java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:704)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:647)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1569)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)
at org.apache.hadoop.hdfs.tools.DFSck.doWork(DFSck.java:363)
at org.apache.hadoop.hdfs.tools.DFSck.access$000(DFSck.java:72)
at org.apache.hadoop.hdfs.tools.DFSck$1.run(DFSck.java:161)
at org.apache.hadoop.hdfs.tools.DFSck$1.run(DFSck.java:158)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
at org.apache.hadoop.hdfs.tools.DFSck.run(DFSck.java:157)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
at org.apache.hadoop.hdfs.tools.DFSck.main(DFSck.java:406)
Thanks
wert
Created 02-11-2021 03:22 AM
Want to get a detailed solution you have to login/registered on the community
Register/LoginCreated 02-11-2021 03:22 AM
Want to get a detailed solution you have to login/registered on the community
Register/LoginCreated 02-14-2021 06:31 PM
@GangWar Thanks !!! that works
Created on 07-26-2021 04:56 AM - edited 07-26-2021 05:09 AM
Hey @GangWar Thank you for the solution but when I use this comman:
hdfs fsck / -showprogress
It shows all the corrupted blocks but not delete these block I check the blocks status form my CM UI its still the same. I run this command for 2 hours but none of missing block is delete.
When I use this Command:
hdfs fsck / | egrep -v '^\.+$' | grep -v replica
hdfs fsck / -delete
Its give the same error that highlighted by @wert_1311 in the above post. First time this commands works and it delete some blocks but after some time I am facing this issue while running this command.
Here I am attaching the snapshot
Created 07-30-2021 06:58 AM