Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Cloudbreak stuck in creating AWS HDF Cluster

Highlighted

Cloudbreak stuck in creating AWS HDF Cluster

New Contributor

Trying to create a HDF cluster in AWS using cloudbreak but the process is stuck in "Create in Progress". AWS console show the servers are created and they up and running. Was able to ssh from cloudbreak VM so there are connectivity issues.


Cloudbreak logs shows no errors. These messages repeat over and over again. Checked the Ambari server and nginx was up and running.

2019-06-24 16:50:02,992 [reactorDispatcher-85] pollWithTimeout:32 INFO  c.s.c.s.PollingService - [owner:e315477d-074c-4ed1-ad47-1367a19b0567] [type:STACK] [id:10] [name:data-ingestion-hdf-dev] [flow:21049f09-4326-4668-b391-8972b1dfeccd] [tracking:40e8f3bf-54ad-4cd0-9307-ca4179bd2886] Polling attempt 3.
2019-06-24 16:50:02,993 [reactorDispatcher-85] checkStatus:25 INFO  c.s.c.s.s.f.NginxCertListenerTask - [owner:e315477d-074c-4ed1-ad47-1367a19b0567] [type:STACK] [id:10] [name:data-ingestion-hdf-dev] [flow:21049f09-4326-4668-b391-8972b1dfeccd] [tracking:40e8f3bf-54ad-4cd0-9307-ca4179bd2886] Check if nginx is running on 130.x.xx.xx:9443.
2019-06-24 16:50:12,274 [http-nio-8080-exec-8] <init>:57 INFO  c.s.c.f.MDCContextFilter - [owner:spring] [type:springLog] [id:] [name:] [flow:] [tracking:] No trackingId in request. Adding trackingId: '1d7362b4-ad15-46ee-8c6e-06ccb4ad86d4'
2019-06-24 16:50:12,276 [http-nio-8080-exec-8] getAllForAutoscale:311 INFO  c.s.c.s.StackCommonService - [owner:undefined] [type:Autoscale] [id:] [name:] [flow:] [tracking:1d7362b4-ad15-46ee-8c6e-06ccb4ad86d4] Get all stack, autoscale authorized only.
2019-06-24 16:50:14,357 [scheduledExecutor-1] distributeFlows:166 INFO  c.s.c.s.h.HeartbeatService - [owner:spring] [type:springLog] [id:] [name:] [flow:] [tracking:] Active CB nodes: (1)[[CloudbreakNode{uuid='52c98d7e-a196-4ec1-8378-5b8adfc2f83a', lastUpdated=1561395000002}]], failed CB nodes: (0)[[]]
2019-06-24 16:50:22,273 [http-nio-8080-exec-13] <init>:57 INFO  c.s.c.f.MDCContextFilter - [owner:spring] [type:springLog] [id:] [name:] [flow:] [tracking:] No trackingId in request. Adding trackingId: '71f18ec4-a5e4-4307-8fca-e6766fd8f6e6'
2019-06-24 16:50:22,275 [http-nio-8080-exec-13] getAllForAutoscale:311 INFO  c.s.c.s.StackCommonService - [owner:undefined] [type:Autoscale] [id:] [name:] [flow:] [tracking:71f18ec4-a5e4-4307-8fca-e6766fd8f6e6] Get all stack, autoscale authorized only.
4 REPLIES 4

Re: Cloudbreak stuck in creating AWS HDF Cluster

Cloudera Employee
Hi! After Cloudbreak successfully provisioned the cluster instances (they are green on AWS console), you still need to wait until Ambari and Hadoop components are set up.

Re: Cloudbreak stuck in creating AWS HDF Cluster

New Contributor

The status of the cluster creation has not changed and it's been like that for over 2 days. I am thinking the issue is the proxy setup but not sure where the issues could be since cloudbreak was able to install on the VM and was able to contact aws to create the servers.

Re: Cloudbreak stuck in creating AWS HDF Cluster

Cloudera Employee

These are notifications on cluster page in case of successful cluster creation (screenshot is not complete, because I didn't want to show the IP address of Ambari):

109581-screenshot-2019-06-25-at-175310.png


Re: Cloudbreak stuck in creating AWS HDF Cluster

Cloudera Employee

And have you checked if every port on security group are configured well? Check this doc to make sure: https://docs.hortonworks.com/HDPDocuments/Cloudbreak/Cloudbreak-2.9.1/security/content/cb_default-cl...