Support Questions
Find answers, ask questions, and share your expertise

Storm is not picking the Active node of HDFS

Storm is not picking the Active node of HDFS

Contributor

Using HDP 2.3.2

In my application, Storm Topology is writing Data to HDFS. If active HDFS node of a topology is restarted then that Storm topology started throwing Write Sync error. But when I restart the storm topology it again starts working perfectly by picking the ActiveNode of HDFS.

Error Log:

2016-12-28 10:07:27.019 c.MyHdfsBolt [ERROR] write/sync failed. java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[?:1.7.0_95] at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744) ~[?:1.7.0_95] at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) ~[hadoop-common-2.7.1.2.3.2.0-2950.jar:?] at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531) ~[hadoop-common-2.7.1.2.3.2.0-2950.jar:?] at org.apache.hadoop.hdfs.DFSOutputStream.createSocketForPipeline(DFSOutputStream.java:1577) ~[hadoop-hdfs-2.7.1.2.3.2.0-2950.jar:?] at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.transfer(DFSOutputStream.java:1034) ~[hadoop-hdfs-2.7.1.2.3.2.0-2950.jar:?]