Ambari setup stuck at step 3

[#1]

Hi,

While installing Ambari 2.6 to setup a 2 node HDP cluster i was stuck at step 3 saying "Please wait while the hosts are being checked for potential problems..". i have checked the ambari-server.log and it says "Unable to lookup the cluster by ID; assuming that there is no cluster and therefore no configs for this execution command: Cluster not found, clusterName=clusterID=-1"

Here is the excerpt from the ambari-server.log

13 Nov 2017 13:09:24,422 WARN [ambari-action-scheduler] ExecutionCommandWrapper:225 - Unable to lookup the cluster by ID; assuming that there is no cluster and therefore no configs for this execution command: Cluster not found, clusterName=clusterID=-1 13 Nov 2017 13:09:25,427 WARN [ambari-action-scheduler] ExecutionCommandWrapper:225 - Unable to lookup the cluster by ID; assuming that there is no cluster and therefore no configs for this execution command: Cluster not found, clusterName=clusterID=-1 13 Nov 2017 13:11:11,433 INFO [pool-18-thread-1] MetricsServiceImpl:65 - Attempting to initialize metrics sink 13 Nov 2017 13:11:11,434 INFO [pool-18-thread-1] MetricsServiceImpl:81 - ********* Configuring Metric Sink ********** 13 Nov 2017 13:11:11,434 INFO [pool-18-thread-1] AmbariMetricSinkImpl:95 - No clusters configured. 13 Nov 2017 13:16:11,434 INFO [pool-18-thread-1] MetricsServiceImpl:65 - Attempting to initialize metrics sink 13 Nov 2017 13:16:11,435 INFO [pool-18-thread-1] MetricsServiceImpl:81 - ********* Configuring Metric Sink ********** 13 Nov 2017 13:16:11,435 INFO [pool-18-thread-1] AmbariMetricSinkImpl:95 - No clusters configured.

pls help

i have followed the steps in hortonworks youtube channel on setting up the cluster but dont know what i am missing.

Thanks

Rahul

[#2]

@Geoffrey Shelton Okot its already updated to point my local repository

i thought that the repository url that i define in step 1 of install wizard will be used. But anyways my ambari.repo and hdp.repo in all my nodes are updated to point to local repo .

should i create the directory as mentioned in the documents for the baseurl as the tar that i downloaded when extracted was not in that pattern. does it really matters.

[#3]

@Rahul Narayanan

It's very important to stick to the official documentation see link

Defining a repository during the install step wont force Ambari to pick up that location it will always read from the /etc/yum.repos.d/*

Yes you should create the /var/www/html/ directory and unzip as stated in the document. Remember to copy the repos to all the nodes in the cluster!

Good luck

[#4]

@Geoffrey Shelton Okot Can you please clarify on this

The tar that i downloaded

ambari-2.6.0.0-centos6.tar.gz when extracted the directory looks like "/<webserver>/ambari/centos6/2.6.0.0-267"

HDP-2.6.3.0-centos6-rpm.tar.gz when extracted looks like "/<webserver>/HDP/centos6/2.6.3.0-235"

HDP-UTILS-1.1.0.21-centos6.tar.gz when extracted does not create structure its just extracts in the same directory

whereas in the doc it says

Ambari Base URL

http://<web.server>/Ambari-2.6.0.0/<OS>;

HDP Base URL

http://<web.server>/hdp/HDP/<OS>/2.x/updates/<latest.version>;

HDP-UTILS Base URL

http://<web.server>/hdp/HDP-UTILS-<version>/repos/<OS>;

so should i manually go ahead and create these directories to look like above.

[#5]

@Geoffrey Shelton Okot

The main issue that i am facing is "Unable to lookup the cluster by ID; assuming that there is no cluster and therefore no configs for this execution command: Cluster not found, clusterName=clusterID=-1"

The only error that i see in ambari-server.log is during ambari-server start which is

1. ERROR [main]StackContext:217-Couldnot load repo results
2. java.net.UnknownHostException:public-repo-1.hortonworks.co

even though i have set up my local yum repo as mentioned in the doc.

i get success at step 3 of confirm hosts but the checking for additional warning is looping for infinite and when i see the log it gives unable to find cluster by iD

[#6]

@Rahul Narayanan

Can you share your ambari/hdp.repos in /etc/yum.repos.d/*, because the error just confirms that installation is pointing to an public repo

Clean out all packages and metadata from cache

yum clean all

Ensure your ambari & hdp repos point to the internal repos above

Check enabled repos

yum repolist

Retry the installation

[#7]

@Geoffrey Shelton Okot

I have attached the hdp.repo and ambari.repo that i have in all my nodes.

i have also done yum clean all and yum repolist before installing.

The urls in the hdp.repo and ambari.repo is accesible from both the host as well

hdprepo.txt

ambarirepo.txt

[#8]

@Rahul Narayanan

When you hit the below URL's can you see the bits you downloaded and unzipped earlier?

http://xxxxmaapl685.ad.infosys.com/Ambari-2.6.0.0/centos6 
http://xxxxmaapl685.ad.infosys.com/hdp/HDP-UTILS-1.1.0.21/repos/centos6 
http://xxxxmaapl685.ad.infosys.com/hdp/HDP/centos6/2.x/updates/2.6.3.0 

Please see this 2 videos

localrepo1

localrepo2

Ensure your setup matches this short demo

[#9]

@Geoffrey Shelton Okot

Yes My local repository setup matches with the one that was shown in both the videos

i am able to browse the files in the browser when i hit the following urls

1. http://xxxxmaapl685.ad.infosys.com/Ambari-2.6.0.0/centos6
2. http://xxxxmaapl685.ad.infosys.com/hdp/HDP-UTILS-1.1.0.21/repos/centos6
3. http://xxxxmaapl685.ad.infosys.com/hdp/HDP/centos6/2.x/updates/2.6.3.0

Also i am using the default postgres that ambari installed. will that be a problem or should i configure Mysql

[#10]

@Rahul Narayanan

Good news, you can now proceed using postgres doesn't cause any problems at all, but if you are a fan of MySQL then see link.

if you intend to use the embedded postgres then choose option 1 when running

ambari-server setup

Using Postgres is straightforward and easy

[#11]

@Geoffrey Shelton Okot

So far my configuration is proper as per all of yours suggestion I don’t know what I am missing or what is going wrong how can I debug this to solve so that I can create a successful cluster and does not have to see the “unable to find cluster by ID” again.