Support Questions

Find answers, ask questions, and share your expertise

Problems writing to hdfs from storm bolt

avatar

Hi experts

I have written a topology that aims to write the results to HDFS. I am choosing Sequence file to do it, but I am getting the below error:

org.apache.hadoop.ipc.Client handleConnectionTimeout

INFO: Retrying connect to server: 35.176.11.138/35.176.11.138:50075. Already tried 0 time(s); maxRetries=45

Here is the code snippet

SequenceFileBolt boltseq = new SequenceFileBolt() .withFsUrl("hdfs://35.176.11.138:50075") .withFileNameFormat(fileNameFormat) .withSequenceFormat(format) .withRotationPolicy(rotationPolicy) .withSyncPolicy(syncPolicy);

.....

b.setBolt("HDFS", boltseq).shuffleGrouping("WordCounterBolt");

I am not sure what I am doing wrong, because when I open a browser and run http://35.176.11.138:50075, I can see the datanode.

Please can somebody help?

Thank you

Regards

Naveen

1 ACCEPTED SOLUTION

avatar
Contributor

I think you are using datanode url, you should be using namenode url.

View solution in original post

1 REPLY 1

avatar
Contributor

I think you are using datanode url, you should be using namenode url.