Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Proxy for /jmx failed - Connection Error In Cloudera

Highlighted

Proxy for /jmx failed - Connection Error In Cloudera

New Contributor

I am using cloudera 5.5.2. I have deployed an HDFS multi-node cluster. I constantly see the below exception trace logged at INFO log level in the log files

 

Feb 25, 10:10:14.350 PM	INFO	org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer	
Proxy for /jmx failed. cause: 
java.io.IOException: Connection reset by peer
	at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
	at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
	at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
	at sun.nio.ch.IOUtil.read(IOUtil.java:192)
	at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
	at com.cloudera.io.netty.buffer.UnpooledUnsafeDirectByteBuf.setBytes(UnpooledUnsafeDirectByteBuf.java:446)
	at com.cloudera.io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:881)
	at com.cloudera.io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:225)
	at com.cloudera.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:119)
	at com.cloudera.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511)
	at com.cloudera.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
	at com.cloudera.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
	at com.cloudera.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
	at com.cloudera.io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116)
	at com.cloudera.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
	at java.lang.Thread.run(Thread.java:745)

Probably this is reason why the health checks fail on this node.

What could be the root cause of this and a possible resolution?

 

Thanks,

Amit. 

1 REPLY 1

Re: Proxy for /jmx failed - Connection Error In Cloudera

Expert Contributor

Hello AmitShah,

 

Please check ssh setting between the members.