question Re: HDFS port 8020 not accessible from outside. in Archives of Support Questions (Read Only)

HDFS port 8020 not accessible from outside.

therainmaker — Fri, 27 Jul 2018 19:40:19 GMT

Followed all the instructions to set up the Hadoop 3.0 cluster and Ambari 2.7. HDFS port not accessible from outside.

1. The output of "netstat -tulapn | grep 8020 " from inside the server

tcp 0 0 127.0.1.1:8020 0.0.0.0:* LISTEN 11892/java

tcp 0 0 127.0.1.1:8020 127.0.0.1:52128 ESTABLISHED 11892/java

tcp 0 0 127.0.0.1:55998 127.0.1.1:8020 TIME_WAIT -

tcp 0 0 127.0.0.1:52128 127.0.1.1:8020 ESTABLISHED 11608/java

tcp 0 0 127.0.0.1:56118 127.0.1.1:8020 ESTABLISHED 13891/java

tcp 0 0 127.0.1.1:8020 127.0.0.1:56118 ESTABLISHED 11892/java

2. The output of "nc -zv mighadoop01.mydomain 8020" from outside.

nc: connectx to mighadoop01.mydomain port 8020 (tcp) failed: Connection refused

3. The output of "nc -zv mighadoop01.mydomain 8020" from inside the server.

Connection to mighadoop01.mydomain 8020 port [tcp/*] succeeded!

4. Server's /etc/hosts file

127.0.0.1localhost localhost.localdomain

::1ip6-localhost ip6-loopback

172.31.16.140mighadoop01 mighadoop01.mydomain

Any pointers would be much appreciated.

Re: HDFS port 8020 not accessible from outside.

pkadam — Fri, 27 Jul 2018 20:00:28 GMT

Please check the below property value in file hdfs-site.xml

<name>dfs.namenode.rpc-address</name>

</property>

if it is set as server hostname:8020 then ensure that server hostname is resolving to proper IP address

Re: HDFS port 8020 not accessible from outside.

stevenmatison — Fri, 27 Jul 2018 20:11:36 GMT

Please confirm SELINUX is disabled and Firewall is off/disabled.

Re: HDFS port 8020 not accessible from outside.

TimothySpann — Fri, 27 Jul 2018 20:27:49 GMT

Are you running on AWS or another cloud provider? They often block ports.

is your domain setup properly?

is it available in DNS?

are the machines able to communicate over other ports?

it /etc/hosts setup correct

is there an external firewall between them?

Can you SSH between them?

Re: HDFS port 8020 not accessible from outside.

therainmaker — Fri, 27 Jul 2018 20:34:46 GMT

Yes. From outside the server, I could resolve the other ports.

nc -zv mighadoop01.mydomain 8080

Output:

found 0 associations

found 1 connections: 1:flags=82<CONNECTED,PREFERRED> outif utun1 src 172.141.0.6 port 61294 dst 172.31.16.140 port 8080 rank info not available TCP aux info available Connection to mighadoop01.mydomain port 8080 [tcp/http-alt] succeeded!

Re: HDFS port 8020 not accessible from outside.

therainmaker — Fri, 27 Jul 2018 20:36:58 GMT

Yes to all your questions. And yes, we are on AWS. Machines can communicate over other ports. Please see my response to the previous answer.

Re: HDFS port 8020 not accessible from outside.

therainmaker — Fri, 27 Jul 2018 20:37:21 GMT

Yes. SELINUX and firewall is off/disabled.

Re: HDFS port 8020 not accessible from outside.

therainmaker — Fri, 27 Jul 2018 20:39:42 GMT

Not sure if this is helpful. But, netstat on say port 9000, seems to deliver different results.

netstat -tulapn | grep 9000

Output:

tcp        0      0 172.31.16.140:40174     172.31.16.140:9000      TIME_WAIT   -
tcp6       0      0 :::9000                 :::*                    LISTEN      11114/java
tcp6       0      0 172.31.16.140:9000      172.31.16.140:40180     TIME_WAIT   -
tcp6       0      0 172.31.16.140:9000      172.31.16.140:40176     TIME_WAIT   -
tcp6       0      0 172.31.16.140:9000      172.31.16.140:40178     TIME_WAIT   -

Re: HDFS port 8020 not accessible from outside.

pkadam — Fri, 27 Jul 2018 20:58:34 GMT

bind address is the main issue if you saw the port 8020 is bind to IP address 127.0.1.1:8020 while your other working ports are bind to IP address 172.31.16.140:9000 correctly hence please check dfs.namenode.rpc-address property from hdfs site file

Re: HDFS port 8020 not accessible from outside.

therainmaker — Fri, 27 Jul 2018 21:02:52 GMT

My dfs.namenode.rpc-address is below:

<property>
      <name>dfs.namenode.rpc-address</name>
      <value>mighadoop01.mydomain:8020</value>
</property>

Re: HDFS port 8020 not accessible from outside.

therainmaker — Fri, 27 Jul 2018 22:46:18 GMT

This issue is now fixed. The problem was when I changed the rpc-address, I was just restarting the ambari server and agent. I was not restarting all the HDFS components, which was the issue. Thanks for all your suggestions.

Re: HDFS port 8020 not accessible from outside.

shiyongsway — Mon, 29 Apr 2019 20:15:08 GMT

Don't Write 127.0.0.1 node01 in your hosts file,Write 192.168.3.5 instead