Created on 12-08-2017 06:15 PM - edited 09-16-2022 05:37 AM
Running HDC on AWS (version 2.0.0) and the UI is not pulling through info from my AWS account which is making it impossible for me to deploy a cluster. The cluster deployment fails with error:
Infrastructure creation failed. Reason: Unrecognized service response for the dry-run request.
Analysis of the trace in log /var/lib/cloudbreak-deployment/cbreak.log shows that the reason for this is that it is trying to deploy into the default VPC for my account which has no subnets and not where I want the nodes to live. This is a showstopper for me right now:
/cbreak_cloudbreak_1 | Caused by: com.amazonaws.services.ec2.model.AmazonEC2Exception: No subnets found for the default VPC 'vpc-XXXXXXXX'. Please specify a subnet. (Service: AmazonEC2; Status Code: 400; Error Code: MissingInput; Request ID: 00b599bd-f7b9-450d-88ea-f0790ceb10f8)
The above shows why i need to specify the VPC and Subnet.
I am very new to Hortonworks and am following the guides for setting this up - http://hortonworks.github.io/hdp-aws/create/index.html - having setup my HDC via the CloudFormation template provided by Hortonworks.
Thanks for the help.
Created 12-08-2017 10:49 PM
Where are you getting the information that you are using 2.0.0 from? Can you click the cog on the top right and click 'About'? What version does it say there? I just spun up an HDCloud using the github link and it says 1.16.5. Want to make sure it is the same for you.
Created 12-10-2017 10:42 AM
Thanks for the response @anarasimham. I got the 2.0.0 from the bottom left hand corner of the Cloud Controller Web UI. I have since destroyed the stack so cannot confirm via your request above - i will spin up a new instance and confirm. For reference i was using the Advance Deployment Cloud Formation template which also shows 2.0.0 in the title - https://s3.amazonaws.com/hdc-cfn/hdcloud-advanced-shared-services-TP-2.0.0.template
Created 12-10-2017 11:10 AM
@anarasimham confirmed that the CF Template installs HDC 2.0.0 (see image). Do you know if there is a CF template for the 1.6 still available?
Created 12-11-2017 02:24 PM
I tried installing 2.0.0 as well, and it is working for me. I can see a list of all VPCs in my account. Is this a permissions issue within your AWS configuration? Is it something else inside of AWS - are you launching the HDCloud stack in the same region as where you have your VPCs defined? You will not see your VPCs if you are launching HDCloud in a separate region from where you usually do your work. Make sure you click the right HDCloud link for your region: http://hortonworks.github.io/hdp-aws/launch/index.html#obtaining-the-cloud-controller-url
Created 12-11-2017 05:23 PM
Hi @Andy Kelly,
if you are starting from scratch, I would encourage you to use the supported 1.16.5 version of HDCloud instead of the technical preview 2.0. 1.16.5 is available here: https://docs.hortonworks.com/HDPDocuments/HDCloudAWS/HDCloudAWS-1.16.5/bk_hdcloud-aws/content/launch...
Created on 12-11-2017 06:12 PM - edited 08-17-2019 07:13 PM
I just deployed a 1.16.5 version as per your suggestion - thank you for the link as i couldn't find that. The issue is exactly the same in this release too - none of the fields from AWS are in the UI (SSH Key to use, Subnet ID or VPC ID).
I have tried using the CLI to create the cluster but receive the error:
panic: runtime error: slice bounds out of range [recovered]