question Re: Ambari stuck with "Install Pending" when creating cluster thru api in Archives of Support Questions (Read Only)

Ambari stuck with "Install Pending" when creating cluster thru api

gbraccialli3 — Mon, 19 Aug 2019 12:45:17 GMT

version: Ambari 1.7.0

Have anyone seen error below when trying to deploy a new cluster using ambari api.

30 Nov 2015 17:24:06,826  WARN [ambari-action-scheduler] ActionScheduler:200 - Exception received
java.lang.RuntimeException: org.apache.ambari.server.ClusterNotFoundException: Cluster not found, clusterName=clusterID=6
        at org.apache.ambari.server.actionmanager.ExecutionCommandWrapper.getExecutionCommand(ExecutionCommandWrapper.java:116)
        at org.apache.ambari.server.actionmanager.ActionScheduler.isStageHasBackgroundCommandsOnly(ActionScheduler.java:428)
        at org.apache.ambari.server.actionmanager.ActionScheduler.filterParallelPerHostStages(ActionScheduler.java:416)
        at org.apache.ambari.server.actionmanager.ActionScheduler.doWork(ActionScheduler.java:246)
        at org.apache.ambari.server.actionmanager.ActionScheduler.run(ActionScheduler.java:195)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.ambari.server.ClusterNotFoundException: Cluster not found, clusterName=clusterID=6
        at org.apache.ambari.server.state.cluster.ClustersImpl.getClusterById(ClustersImpl.java:250)
        at org.apache.ambari.server.actionmanager.ExecutionCommandWrapper.getExecutionCommand(ExecutionCommandWrapper.java:74)
        ... 5 more
30 Nov 2015 17:24:09,931  WARN [ambari-hearbeat-monitor] HeartbeatMonitor:146 - Heartbeat lost from host brtlvlts0233pl.redecorp.br
30 Nov 2015 17:24:09,931  WARN [ambari-hearbeat-monitor] HeartbeatMonitor:146 - Heartbeat lost from host brtlvlts0234pl.redecorp.br
30 Nov 2015 17:24:09,932  WARN [ambari-hearbeat-monitor] HeartbeatMonitor:146 - Heartbeat lost from host brtlvlts0232pl.redecorp.br
30 Nov 2015 17:24:09,932  WARN [ambari-hearbeat-monitor] HeartbeatMonitor:146 - Heartbeat lost from host brtlvlts0237pl.redecorp.br
30 Nov 2015 17:24:09,932  WARN [ambari-hearbeat-monitor] HeartbeatMonitor:146 - Heartbeat lost from host brtlvlts0235pl.redecorp.br
30 Nov 2015 17:24:09,932  WARN [ambari-hearbeat-monitor] HeartbeatMonitor:146 - Heartbeat lost from host brtlvlts0236pl.redecorp.br
30 Nov 2015 17:24:13,274 ERROR [alert-event-bus-1] AmbariJpaLocalTxnInterceptor:114 - [DETAILED ERROR] Rollback reason:

If we log in ambari webui, cluster stuck with install pending:

Re: Ambari stuck with "Install Pending" when creating cluster thru api

nsabharwal — Tue, 01 Dec 2015 22:36:21 GMT

@Guilherme Braccialli

java.lang.RuntimeException: org.apache.ambari.server.ClusterNotFoundException:Clusternot found, clusterName=clusterID=6

check if agents are running. Verify the commands again.

Re: Ambari stuck with "Install Pending" when creating cluster thru api

jstraub — Tue, 01 Dec 2015 23:07:45 GMT

Can you share the commands that you used to setup the cluster?

Re: Ambari stuck with "Install Pending" when creating cluster thru api

gbraccialli3 — Tue, 01 Dec 2015 23:09:20 GMT

@Jonas Straub I'll try to get the commands, it's from Vmware Big Data Extension.

Re: Ambari stuck with "Install Pending" when creating cluster thru api

jspeidel — Fri, 08 Jan 2016 04:07:50 GMT

Can you please confirm that you are deploying the cluster using the blueprint API and not the lower level 'primitive' API's? I see that this is for a rather old version "1.7.0", which was one of the first versions to support blueprint installs. I don't remember ever seeing this error with 1.7.0 BP installs so you will need to attach the ambari server log as well as confirm the API calls that resulted in this issue.

Re: Ambari stuck with "Install Pending" when creating cluster thru api

jspeidel — Fri, 08 Jan 2016 04:15:14 GMT

With Ambari 1.7.0, all hosts must be registered prior to submitting a blueprint cluster creation request. If the necessary hosts aren't available in 1.7.0, the request will immediately fail and indicate to the user that the necessary hosts aren't available. In more recent Ambari versions, it is possible to submit a cluster create request prior to any hosts being available and until "the minimal required hosts" become available, you are correct that the request state will remain "PENDING".

Re: Ambari stuck with "Install Pending" when creating cluster thru api

aervits — Sat, 06 Feb 2016 03:47:17 GMT

@Guilherme Braccialli are you still having issues with this? Please close.

Re: Ambari stuck with "Install Pending" when creating cluster thru api

gbraccialli3 — Wed, 17 Feb 2016 19:50:04 GMT

@Artem Ervits

we moved to ambari 2.1.2 and issue never happened again.

Re: Ambari stuck with "Install Pending" when creating cluster thru api

dpnctl — Tue, 03 Jan 2017 18:41:46 GMT

@jspeidel

so if we want to install few additional services ABC after a cluster is setup with few XYZ services , it is not possible?? I am unsure of the technicalities but this way it will be a problem for companies running analytics as a service

Re: Ambari stuck with "Install Pending" when creating cluster thru api

dpnctl — Tue, 03 Jan 2017 19:36:17 GMT

I tried restarting (stop & start) all services in the cluster , during that process, the pending installation kicked off and wassuccessful I am not sure of the internal architecture

Re: Ambari stuck with "Install Pending" when creating cluster thru api

girish28mane — Fri, 22 Sep 2017 01:00:53 GMT

@Neeraj Sabharwal I am still facing the same issue, can you please help. Ambari version been used here is 2.2.2.0 with postgresql 9.2.18 on rhel 7. This happens to us most of the time. I have made sure that agents on all hosts are running and are pointing toward the ambari server, iptables, selinux are disabled. /etc/hosts are updated correctly. I am registering Ambari blueprint via API through Ansible and then cluster creation template also via API through Ansible in automated way. What could be the reason behind this?