@kwabstian53
I am not sure how your recently reported error is linked to the originally reported error in this thread.
However i will try to respond to your later error (as earlier error does not have much context)
We see this error:
resource_management.core.exceptions.ExecutionFailed: Execution of 'curl -sS -L -w '%{http_code}' -X PUT --data-binary @/var/lib/ambari-agent/tmp/hdfs-service-check -H 'Content-Type: application/octet-stream' 'http://localhost:50070/webhdfs/v1/tmp/id940a6b28_date521919?op=CREATE&user.name=hdfs&overwrite=True' 1>/tmp/tmpbc0udk 2>/tmp/tmpOdlga7' returned 7. curl: (7) Failed connect to thdfc-slave-03:50075; Connection timed out 307
Which indicates that a simple webhdfs call made to NameNode "localhost:50070" is failing because during the webhdfs call when it is trying to connect to a DataNode in order to actually create a data that time it is not able to get a response from the DataNode running/listening to "thdfc-slave-03:50075".
NameNode host is not able to connect to DataNode on port 50075 due to "Connection timed out 307". Which indicates some communication/Network issue.
1. So please check if that DataNode is actually running or do we see any error in the DataNode log on that host?
2. On the DataNode host please check if the port "50075" is actually opened and listening? Or if the Firewall/IPTables is disabled ?
# ps -ef | grep -i DataNode
# netstat -tnlpa | greop $DATANODE_PID
# service iptables status
# systemctl status firewalld
3. From the Active NameNode host where you see this error please try to run the following telnet command in order to verify the port access (just to isolate any firewall issue)
# telnet thdfc-slave-03 50075
(OR)
# nc -v thdfc-slave-03 50075
.
.
