question Re: HDP Sandbox on AWS? in Support Questions

HDP Sandbox on AWS?

MCarter — Fri, 16 Sep 2022 09:41:48 GMT

Is the Hortonworks Sandbox available on Amazon Web Services as well?

Re: HDP Sandbox on AWS?

nsabharwal — Fri, 25 Sep 2015 08:26:12 GMT

@MCarter@hortonworks.com This is old guide that I found http://hortonworks.com/wp-content/uploads/2012/09/Using_Hortonworks_AMI_HDP11-2012-09-11.pdf

Based on my latest search in Amazon AMI , I could not find HDP Sandbox.

Re: HDP Sandbox on AWS?

pardeep_kumar — Tue, 29 Sep 2015 16:07:15 GMT

AFAIK, HDP sandbox AMI is no longer available on AWS EC2 now. http://hortonworks.com/community/forums/topic/hdp-sandbox-ami/

Re: HDP Sandbox on AWS?

azeltov — Fri, 02 Oct 2015 23:12:32 GMT

HI @MCarter@hortonworks.com ,

You can setup your own HDP sandbox image on AWS. Follow these steps:

Download the VMWare version of our sandbox from the website.
Rename the OVA file to .tar extension, extract it.
Create an S3 bucket under your personal AWS account. Remember the name of the bucket!
Install EC2 command line tools. Make sure they're in path.
cd to the directory you extracted with the tar file.
run: ec2-import-instance -t m3.large Hortonworks_Sandbox_2.X-disk1.vmdk -f VMDK -o <ACCESS_KEY> -w <SECRET_KEY> -b <BUCKET NAME FROM STEP 2> -a x86_64 -p Linux
Wait ...
Log into your AWS console, go to EC2, locate the new instance it created (it'll be stopped).
Select instance, Action, Create Image. Switch to AMI view.
Send AMI image ID to anyone. It creates an EBS volume in your account, don't remove it! It will cost about $5/month.

Re: HDP Sandbox on AWS?

guzu92 — Mon, 21 Mar 2016 02:52:11 GMT

Worked for me. I had to create and attach an EBS volume with /dev/sda1 (root) drive prior image creation.

Re: HDP Sandbox on AWS?

veerat — Wed, 06 Apr 2016 07:16:23 GMT

Hi,

I was creating amazon ami from sandbox to launch ec2-instance. I followed all the above steps correctly with HDP 2.3.2 and 2.4 sandbox versions. I created an amazon ami but I was not able to get Hadoop running on ec2 instance. Even I was not able to access ambari server at port 8080. I tried changing hostname of ec2-instance to "sandbox.hortonworks.com", gave security groups open to all ports but no use. When I looked at the processes started after bootstrap, I found some process like HDFS, Mapred are not started in ec2-instace which are started in sandbox in virtual box. Can someone please help me in this?

Thanks!

Re: HDP Sandbox on AWS?

amit1 — Mon, 19 Aug 2019 13:00:52 GMT

Hello Azeltov, thank you for the instructions. I've managed to start sandbox on an EC2 instance. Logged into Ambari however, it says Heartbeat lost against most services. See screenshot below. I believe I'm very close to exploring HDP Sandbox so any advice on this problem will be really helpful. Also I noticed on the hosts tab that the RAM allocated is 7.69GB. I've configured an m3.xlarge instance which has 15GB memory so how do I reallocate more memory to the sandbox?

Thanks,

Amit

Re: HDP Sandbox on AWS?

joby_johny — Fri, 03 Feb 2017 04:03:18 GMT

Hi Azeltov,

I am trying to upload the hdp2.5 vm file ec2-import-instance-command.png into aws via cli.

I have tried the same and getting an error in step6. ec2-import-instance command is not showing up in cli

aws cli version is aws-cli/1.11.44 Python/2.7.9 Windows/8 botocore/1.5.7.

Tried the below command

$aws ec2-import-instance -t m3.large HDP_2.5_docker_vmware_25_10_2016_08_59_25_hdp_2_5_0_0_1245_ambari_2_4_0_0_1225-disk1.vmdk -f VMDK -o xxxx-w xxxxxxxxxx -b creditcardtxn1 -a x86_64 -p Linux

it says that invalid choice of command.Please let me know the correct command to execute.

Re: HDP Sandbox on AWS?

joby_johny — Fri, 03 Feb 2017 06:28:05 GMT

Hi Neeraj,

I am trying to setup the hortonworks hdp2.5 in AWS. This is test the webapplication https://community.hortonworks.com/content/kbentry/38457/credit-fraud-prevention-demo-a-guided-tour.html. This application uses Kafka,Storm,Hive,Hbase and many more stuffs. Could you please suggest what is the best way to go ahead ?