11/14/2017 8:47:58 PM prod-dataeng-mr-cluster - create in progress: Setting up HDP image
11/14/2017 8:47:59 PM prod-dataeng-mr-cluster - create in progress: Creating infrastructure
11/14/2017 8:48:59 PM prod-dataeng-mr-cluster - update in progress: Infrastructure creation took 60 seconds
11/14/2017 8:49:01 PM prod-dataeng-mr-cluster - update in progress: Infrastructure metadata collection finished
11/14/2017 8:49:36 PM prod-dataeng-mr-cluster - available: Infrastructure successfully provisioned
11/14/2017 8:49:37 PM prod-dataeng-mr-cluster - update in progress: Bootstrapping infrastructure cluster
11/14/2017 8:50:16 PM prod-dataeng-mr-cluster - update in progress: Setting up infrastructure metadata
11/14/2017 8:50:17 PM prod-dataeng-mr-cluster - update in progress: Starting Ambari cluster services
11/14/2017 8:53:21 PM prod-dataeng-mr-cluster - update in progress: Building Ambari cluster; Ambari ip:10.*.*.*''
11/14/2017 8:53:22 PM prod-dataeng-mr-cluster - update in progress: Execute recipes: client:[install-consul];master3:[sqljdbc,install-piggybank];task:[install-opencv];worker:[install-opencv]
11/14/2017 9:10:02 PM prod-dataeng-mr-cluster - available: Ambari cluster built; Ambari ip:10.*.*.*
11/14/2017 9:16:53 PM prod-dataeng-mr-cluster - available: Synced instance states with the cloud provider.
11/14/2017 9:16:53 PM prod-dataeng-mr-cluster - update in progress: Adding 25 new instances to the infrastructure
11/14/2017 9:18:43 PM prod-dataeng-mr-cluster - available: Infrastructure metadata extension finished
11/14/2017 9:18:43 PM prod-dataeng-mr-cluster - update in progress: Bootstrapping new nodes
11/14/2017 9:19:41 PM prod-dataeng-mr-cluster - available: Stack successfully upscaled
11/14/2017 9:19:42 PM prod-dataeng-mr-cluster - update in progress: Scaling up the Ambari cluster
11/14/2017 9:28:38 PM prod-dataeng-mr-cluster - available: Ambari cluster scaled up
1/3/2018 1:18:51 PM prod-dataeng-mr-cluster - available: Deleted host ip-*-*-*-*.us-west-2.compute.internal from Ambari as it is marked as terminated by the cloud provider.
1/3/2018 1:18:51 PM prod-dataeng-mr-cluster - available: Deleted instance i-0dde8e164eb (ip-10-96-56-62.us-west-2.compute.internal) from Cloudbreak metadata because it couldn't be found on the cloud provider.
1/3/2018 1:19:00 PM prod-dataeng-mr-cluster - available: Deleted host '********' from Ambari as it is marked as terminated by the cloud provider.
1/3/2018 1:19:01 PM prod-dataeng-mr-cluster - available: Deleted instance i-0e247502d31 ('********') from Cloudbreak metadata because it couldn't be found on the cloud provider.
1/3/2018 1:19:01 PM prod-dataeng-mr-cluster - available: Synced instance states with the cloud provider.
1/3/2018 1:19:01 PM prod-dataeng-mr-cluster - update in progress: Adding 1 new instances to the infrastructure
1/3/2018 1:22:27 PM prod-dataeng-mr-cluster - available: Infrastructure metadata extension finished
1/3/2018 1:22:28 PM prod-dataeng-mr-cluster - update in progress: Bootstrapping new nodes
1/3/2018 1:24:30 PM prod-dataeng-mr-cluster - available: Stack successfully upscaled
1/3/2018 1:24:31 PM prod-dataeng-mr-cluster - update in progress: Scaling up the Ambari cluster
1/3/2018 2:02:44 PM prod-dataeng-mr-cluster - update failed: New node(s) could not be added to the cluster. Reason com.sequenceiq.cloudbreak.core.CloudbreakException: com.sequenceiq.cloudbreak.orchestrator.exception.CloudbreakOrchestratorFailedException: Timeout: Orchestrator component failed to finish in 7.500000 mins, last message: There are missing nodes from job result: [10.*.*.*]
1/3/2018 2:09:40 PM prod-dataeng-mr-cluster - update in progress: Started stack repair. Detecting unhealthy instances.
1/3/2018 2:09:43 PM prod-dataeng-mr-cluster - update in progress: Found unhealthy instances, attempting to repair stack.
1/3/2018 2:09:44 PM prod-dataeng-mr-cluster - update in progress: Stack repair triggered.
1/3/2018 2:09:58 PM prod-dataeng-mr-cluster - available: Deleted host '********'.us-west-2.compute.internal from Ambari as it is marked as terminated by the cloud provider.
1/3/2018 2:09:58 PM prod-dataeng-mr-cluster - available: Deleted instance i-09475fd671('********'.us-west-2.compute.internal) from Cloudbreak metadata because it couldn't be found on the cloud provider.
1/3/2018 2:09:58 PM prod-dataeng-mr-cluster - available: Synced instance states with the cloud provider.
1/3/2018 2:10:13 PM prod-dataeng-mr-cluster - available: The cluster state synchronized with Ambari: Services are installed and running.
1/3/2018 2:10:15 PM prod-dataeng-mr-cluster - available: Synced instance states with the cloud provider.
1/3/2018 2:10:16 PM prod-dataeng-mr-cluster - update in progress: Adding 1 new instances to the infrastructure
1/3/2018 2:10:24 PM prod-dataeng-mr-cluster - available: Infrastructure metadata extension finished
1/3/2018 2:10:25 PM prod-dataeng-mr-cluster - update in progress: Bootstrapping new nodes
1/3/2018 2:11:16 PM prod-dataeng-mr-cluster - available: Stack successfully upscaled
1/3/2018 2:11:16 PM prod-dataeng-mr-cluster - update in progress: Scaling up the Ambari cluster
1/3/2018 2:18:59 PM prod-dataeng-mr-cluster - available: Ambari cluster scaled up
2/1/2018 3:15:19 PM prod-dataeng-mr-cluster - available: The state of one or more instances couldn't be determined. Try syncing later.
2/1/2018 3:16:14 PM prod-dataeng-mr-cluster - available: The state of one or more instances couldn't be determined. Try syncing later.
2/1/2018 3:16:56 PM prod-dataeng-mr-cluster - update in progress: Started stack repair. Detecting unhealthy instances.
2/1/2018 3:16:57 PM prod-dataeng-mr-cluster - available: Completed stack repair. No unhealthy instances found.
2/1/2018 3:17:09 PM prod-dataeng-mr-cluster - available: The state of one or more instances couldn't be determined. Try syncing later.
2/1/2018 3:20:16 PM prod-dataeng-mr-cluster - available: The state of one or more instances couldn't be determined. Try syncing later.
2/1/2018 3:22:28 PM prod-dataeng-mr-cluster - available: The state of one or more instances couldn't be determined. Try syncing later.
2/1/2018 3:24:53 PM prod-dataeng-mr-cluster - update in progress: Started stack repair. Detecting unhealthy instances.
2/1/2018 3:24:54 PM prod-dataeng-mr-cluster - available: Completed stack repair. No unhealthy instances found.
2/1/2018 3:55:03 PM prod-dataeng-mr-cluster - update in progress: Started stack repair. Detecting unhealthy instances.
2/1/2018 3:55:04 PM prod-dataeng-mr-cluster - available: Completed stack repair. No unhealthy instances found.
2/1/2018 4:00:20 PM prod-dataeng-mr-cluster - update in progress: Started stack repair. Detecting unhealthy instances.
2/1/2018 4:00:21 PM prod-dataeng-mr-cluster - available: Completed stack repair. No unhealthy instances found.
2/1/2018 4:27:53 PM prod-dataeng-mr-cluster - available: The state of one or more instances couldn't be determined. Try syncing later.
2/1/2018 4:29:36 PM prod-dataeng-mr-cluster - available: The state of one or more instances couldn't be determined. Try syncing later.
2/1/2018 4:35:50 PM prod-dataeng-mr-cluster - update in progress: Started stack repair. Detecting unhealthy instances.
2/1/2018 4:35:52 PM prod-dataeng-mr-cluster - available: Completed stack repair. No unhealthy instances found.
2/1/2018 4:37:44 PM prod-dataeng-mr-cluster - available: The state of one or more instances couldn't be determined. Try syncing later.
2/1/2018 4:44:19 PM prod-dataeng-mr-cluster - update in progress: Started stack repair. Detecting unhealthy instances.
2/1/2018 4:44:20 PM prod-dataeng-mr-cluster - available: Completed stack repair. No unhealthy instances found.
2/1/2018 4:57:15 PM prod-dataeng-mr-cluster - available: The state of one or more instances couldn't be determined. Try syncing later.
2/1/2018 4:59:43 PM prod-dataeng-mr-cluster - update in progress: Started stack repair. Detecting unhealthy instances.
2/1/2018 4:59:44 PM prod-dataeng-mr-cluster - available: Completed stack repair. No unhealthy instances found.
2/1/2018 4:59:58 PM prod-dataeng-mr-cluster - available: The state of one or more instances couldn't be determined. Try syncing later.
2/1/2018 5:03:35 PM prod-dataeng-mr-cluster - available: The state of one or more instances couldn't be determined. Try syncing later.
2/2/2018 10:41:31 AM prod-dataeng-mr-cluster - available: The state of one or more instances couldn't be determined. Try syncing later.