Private and public IP's of hosts are messed up in Ambari UI of my Hadoop cluster

[#1]

I have just noticed that private and public IP's are messed up in Ambari UI.

I don't understand why the public IP appears next to my master host, while the slave nodes have private IP. Is it correct? If not, how can I fix it?

[#2 · Accepted solution]

@Liana Napalkova

Are you using some cloud environment like AWS to setup your cluster?

Can you please share the output of the following command from master1 and any of the slave host like "slave1"?

# cat /etc/hosts
# ifconfig

.

[#3]

No, I am building my cluster in OpenStack (centos 7).

Master

# cat /etc/hosts

127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4

::1 localhost localhost.localdomain localhost6 localhost6.localdomain6

192.168.0.9 eureambarimaster1.local.eurecat.org eureambarimaster1

192.168.0.10 eureambarislave1.local.eurecat.org eureambarislave1

192.168.0.11 eureambarislave2.local.eurecat.org eureambarislave2

# ifconfig

eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450

inet 192.168.0.9 netmask 255.255.255.0 broadcast 192.168.0.255

inet6 fe80::f816:3eff:fe64:9948 prefixlen 64 scopeid 0x20<link>

ether fa:16:3e:64:99:48 txqueuelen 1000 (Ethernet)

RX packets 4886387 bytes 9326946742 (8.6 GiB)

RX errors 0 dropped 0 overruns 0 frame 0

TX packets 3961905 bytes 3114838916 (2.9 GiB)

TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536

inet 127.0.0.1 netmask 255.0.0.0

inet6 ::1 prefixlen 128 scopeid 0x10<host> loop txqueuelen 1 (Local Loopback)

RX packets 4326060 bytes 2524451944 (2.3 GiB)

RX errors 0 dropped 0 overruns 0 frame 0

TX packets 4326060 bytes 2524451944 (2.3 GiB)

TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

Slave 1

# cat /etc/hosts

127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4

::1 localhost localhost.localdomain localhost6 localhost6.localdomain6

192.168.0.9 eureambarimaster1.local.eurecat.org eureambarimaster1

192.168.0.10 eureambarislave1.local.eurecat.org eureambarislave1

192.168.0.11 eureambarislave2.local.eurecat.org eureambarislave2

Initially I installed Ambari when /etc/hosts was containing public IP's of hosts. In this case most of the services of Ambari were not working. Then I changed IP's to private ones, and most of the services started working (excluding ResourceManager and HiveServer2). Maybe, public IP of a master node was written automatically in some configs? Is it better to completely reinstall Ambari or is there any workaround?

[#4]

@Liana Napalkova

Usually the ambari agent sends registration request to ambari server everytime when we restart the ambari agent.

So can you please check if you have restarted the ambari agent after making the IP Address changes?

[#5]

Ok, I restarted ambari agents in all hosts (including the master host) and now IP are listed correctly. Thanks!

ResourceManager and HiverServer2 still do not work. I will revise logs and open a new issue, if needed.