I managed to install Ambari server 2.2.1. The normal practice is using the internal IP/DNS addresses for clusters. I am trying to supply the public (EIP) dns for the nodes. It does not go through as it failed at the host check stage -- "host checks were skipped on 2 hosts that failed to register". I manually installed ambari and started on the data node. I did edit the /etc/hosts file and provided the internal ip and public dns on the master and slave. Is there any guidance or notes available to use the public dns please? ... View more

Morning all, Since this post has not received any further response, is it fair to assume the users have not gone down using public dns route for internal applications within ec2-vpc? This does address most of the problems one could face -- losing the internal IP, charges for using EIP internally, stop/restart. I found an article on this subject. How do Ambari and HDP behave if I provide the public dns to ambari at cluster deployment stage? Has anyone tried this before please? https://alestic.com/2009/06/ec2-elastic-ip-internal/ Thanks, ... View more

The questions is: Could the public (eip) dns be used (in /etc/hosts as well as at the HDP node address specfication stage) to address the connectivity / loss of internal ip/dns for a variety of reasons including stop/restart please? Using Elastic IP is straight forward. But the clusters would access each other internally over the external network. This will attract data transfer/bandwidth to/from ec2 at the rate of $0.01/gb and/or $0.09/gb upto 10TB transfer out from ec2 to internet. Any help and examples to resolve this would be greatly appreciated as I have not installed Ambari/deployed HDP. ... View more

I need some help please in making config changes in /etc/sysconfig/network and /etc/hosts. I have named the instances as NameNode and DataNode. I have an elastic IP address, which gets a fixed public DNS as follows: 1 : ec2-xx.xx.xxx.xx-compute-1-amazon.com. the public IP and Elastic IP for this Name Node are the same (xx....) 2: ec2-yy.yy.yyy.yy-compute-1.amazon.com. /etc/sysconfig/network \etc\systemconfig\network networking = yes nozeroconf = yes set HOSTNAME=NameNode.hdp.hadoop # namenode is the name given to an intance id set HOSTNAME=DataNode.hdp.hadoop # datanode is the name given to an instance id /etc/hosts I used the public DNS route in the hosts file. I am not sure if this is correct. Because, ntp, which always autostarted, no longer autostarts now. I tried to set the auto start. But it does not autostart on boot. 127.0.0.1 localhost.localdomain localhost ::1 localhost6.localdomain6 localhost6 ec2-xx.xx.xxx.xx.compute-1.amazonaws.com NameNode.hdp.hadoop NameNode ec2-yy.yy.yyy.yy.compute-1.amazonaws.com DataNode.hdp.hadoop DataNode The idea is since the public DNS uses elastic IP, using them to let the internal servers to talk to each other (ec2-VPC) would address the problem of losing the connectivity if the internal IPs were to change for a variety of reasons. Thanks, Sundar ... View more

@Ancil: Is this guide still valid for ambari - hdp 2.3 deployment on ec2 please? The description states: "**** Just an Initial Place Holder for an Old KB on Ambari on EC2 to be updated". The manual does not mention the details like "configure nodes - especially /etc/network" and "set up hosts" as we find in this post. Thanks, Sundar ... View more

no worries. I have manually cleaned them out from the respective directories. I will post again after install. thanks ... View more

Sorry for not coming back. I tried cleaning out Ambari/HDP before reinstall. While most of the components have been cleaned out, I can still see packs like hadoop, accumulo, tez, spark, etc in the directory. I followed this post https://gist.github.com/nsabharwal/f57bb9e607114833df9b For some of the hadoop components/services, I am getting "no match for argument: hadoop*). Trying with or without 'sudo' does not work. ... View more

No. that was the recent problem. Please see my reply below. thanks ... View more

Please note that i do not want to uninstall Java or MySql. They are working fine. thanks ... View more

Thanks Neeraj Sabharwal. I am sorry I am aware of that. We are somewhere in between, where ambari could not start hadoop services initially and now it is not available! I am looking to (a) remove ambari-server/agent, hadoop services, etc and (b) reinstall, where I can map the elastic IP dns to address stop/start associated problems. A detailed guidance will be greatly appreciated. Thanks again SS ... View more