Member since
04-10-2018
4
Posts
0
Kudos Received
0
Solutions
04-10-2018
03:48 AM
I ended up restarting the offending DataNodes on the IPs that appeared in the log and the warning/info went away. I wonder what it was ...
... View more
04-10-2018
12:58 AM
I did see a similar issue reported here by another user, but the problem he said he had isn't what I have (AFAIK) nor did I understand how to carfully find the source of the problem. I had to remove some IPs for privacy. 2018-04-10 08:44:48,583 WARN org.apache.hadoop.ipc.Server: Requested data length 76026807 is longer than maximum configured RPC length 67108864. RPC came from 10.3.108.191 2018-04-10 08:44:48,583 INFO org.apache.hadoop.ipc.Server: Socket Reader #1 for port 8020: readAndProcess from client <REMOVED!> threw exception [java.io.IOException: Requested data length 76026807 is longer than maximum configured RPC length 67108864. RPC came from <REMOVED!>]
java.io.IOException: Requested data length 76026807 is longer than maximum configured RPC length 67108864. RPC came from <REMOVED!>
at org.apache.hadoop.ipc.Server$Connection.checkDataLength(Server.java:1476)
at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1538)
at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:774)
at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:647)
at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:618) I don't really understand the source of the problem "Requested data length". Which "request"? What is this "request"? What does it contain? Why is it 76026807? I'm using hadoop-2.6.0+cdh5.7.0+1280-1.cdh5.7.0.p0.92.el6.x86_64 [root@<REMOVE!> ~]# hdfs fsck /
Connecting to namenode via http://<REMOVE!>:<REMOVE!>
FSCK started by root (auth:SIMPLE) from /<REMOVE!> for path / at Tue Apr 10 08:40:20 BST 2018
Status: HEALTHY
Total size: 67288369548598 B (Total open files size: 15569256448 B)
Total dirs: 57673
Total files: 193390
Total symlinks: 0 (Files currently being written: 6)
Total blocks (validated): 662967 (avg. block size 101495805 B) (Total open file blocks (not validated): 116)
Minimally replicated blocks: 662967 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 0 (0.0 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 3
Average block replication: 2.0007422
Corrupt blocks: 0
Missing replicas: 0 (0.0 %)
Number of data-nodes: 6
Number of racks: 2
FSCK ended at Tue Apr 10 08:40:24 BST 2018 in 4021 milliseconds
The filesystem under path '/' is HEALTHY
... View more
Labels:
- Labels:
-
HDFS