Put HDFS Error writing to Remote HDFS

[#1]

Hi,

I have two EC2 machine the first one is HDF machine and the another one is HDP machine, I could put data into hbase in HDP, but is not possible to putHDFS into the HDP server, see below you will see the error that I'm having and my configuration,

the error is Failed to write HDFS due to prg.apache.nifi.processor.exception.ProcessException: IOException thrown from PutHDFS[id=]: File /user/openagro/.197111111 could onlu be replicated to 0 nodes instead of minReplication(=1). there are 1 datanode(s) runninf and 1 node(s) are excluded in this operation

errorlog.png

puthdfsconfiguration.png

thanks you for your help

[#2]

@Diego Ayala

Make sure datanode is not available to Name Node,if the datanode is not configured add the hostname to conf/slaves.

Please Refer to below solutions will be helpful to resolve your issue.

https://stackoverflow.com/questions/5293446/hdfs-error-could-only-be-replicated-to-0-nodes-instead-o...

https://stackoverflow.com/questions/36015864/hadoop-be-replicated-to-0-nodes-instead-of-minreplicati...

https://community.hortonworks.com/questions/16837/cannot-copy-from-local-machine-to-vm-datanode-via....

[#3]

Hi @Shu,

I formatted the namenode, I started again but the putHDFS is still doing the same error, do you have any idea, do i need to give permissions to the remote user or something like that.

Also I changed my sandbox-hdp address to public addres and the namenode is not able to start.

thanks a lot for your help

[#4]

Hi,

I found that the port 50010 is not the only one that you need to open, because the natanode use another port 50470 and other ones, look through your config over ambari and you will find those ports, or hdfs-site.xml and core-site.xml

thanks