Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hadoop Cluster failed on AWS using cloudera manager.

Hadoop Cluster failed on AWS using cloudera manager.

Hi All,

 

The Error I'm getting is

Installation failed. Failed to receive heartbeat from agent.

  • Ensure that the host's hostname is configured properly.
  • Ensure that port 7182 is accessible on the Cloudera Manager server (check firewall rules).
  • Ensure that ports 9000 and 9001 are free on the host being added.
  • Check agent logs in /var/log/cloudera-scm-agent/ on the host being added (some of the logs can be found in the installation details).


And my host files details here

 

ubuntu@ip-10-203-134-227:/var/log$ cat /etc/hosts
127.0.0.1 localhost
127.0.0.1  ec2-54-227-252-56.com
54.227.252.56 ec2-54-227-252-56.compute-1.amazonaws.com master
23.21.104.142 ec2-23-21-104-142.compute-1.amazonaws.com slave1
23.21.192.224 ec2-23-21-192-224.compute-1.amazonaws.com slave2

# The following lines are desirable for IPv6 capable hosts
::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
ff02::3 ip6-allhosts
Internal Ip details:


ubuntu@ip-10-203-134-227:/var/log$ ifconfig -a
eth0      Link encap:Ethernet  HWaddr 22:00:0a:cb:86:e3
          inet addr:10.203.134.227  Bcast:10.203.134.255  Mask:255.255.255.192
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:1488331 errors:0 dropped:0 overruns:0 frame:0
          TX packets:119372 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:2179725706 (2.1 GB)  TX bytes:11799249 (11.7 MB)
          Interrupt:26

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:46546 errors:0 dropped:0 overruns:0 frame:0
          TX packets:46546 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:7400236 (7.4 MB)  TX bytes:7400236 (7.4 MB)

 

Disabled the firewall by using the following command:

 sudo ufw disable

 

 

Can anyone help me out to fix this issue.Highly appreciated

2 REPLIES 2

Re: Hadoop Cluster failed on AWS using cloudera manager.

Expert Contributor
Can you try pinging the hostname from hostname and see you get any response ?
Em Jay

Re: Hadoop Cluster failed on AWS using cloudera manager.

I fixed the issue by adding ipaddress,fully qualified name and hostname in the etc file and also in AWS has two IP'S one is public ip and other is internal ip.In the host file need to write internal ip.Anyway thanks a lot for your reply