Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

HDP Sandbox on AWS?

avatar
Contributor

Is the Hortonworks Sandbox available on Amazon Web Services as well?

1 ACCEPTED SOLUTION

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
8 REPLIES 8

avatar
Master Mentor

@MCarter@hortonworks.com This is old guide that I found http://hortonworks.com/wp-content/uploads/2012/09/Using_Hortonworks_AMI_HDP11-2012-09-11.pdf

Based on my latest search in Amazon AMI , I could not find HDP Sandbox.

avatar
Contributor

Hi Neeraj,

I am trying to setup the hortonworks hdp2.5 in AWS. This is test the webapplication https://community.hortonworks.com/content/kbentry/38457/credit-fraud-prevention-demo-a-guided-tour.h.... This application uses Kafka,Storm,Hive,Hbase and many more stuffs. Could you please suggest what is the best way to go ahead ?

avatar

AFAIK, HDP sandbox AMI is no longer available on AWS EC2 now. http://hortonworks.com/community/forums/topic/hdp-sandbox-ami/

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login

avatar
New Contributor

Worked for me. I had to create and attach an EBS volume with /dev/sda1 (root) drive prior image creation.

avatar
New Contributor

Hi,

I was creating amazon ami from sandbox to launch ec2-instance. I followed all the above steps correctly with HDP 2.3.2 and 2.4 sandbox versions. I created an amazon ami but I was not able to get Hadoop running on ec2 instance. Even I was not able to access ambari server at port 8080. I tried changing hostname of ec2-instance to "sandbox.hortonworks.com", gave security groups open to all ports but no use. When I looked at the processes started after bootstrap, I found some process like HDFS, Mapred are not started in ec2-instace which are started in sandbox in virtual box. Can someone please help me in this?

Thanks!

avatar
New Contributor

Hello Azeltov, thank you for the instructions. I've managed to start sandbox on an EC2 instance. Logged into Ambari however, it says Heartbeat lost against most services. See screenshot below. I believe I'm very close to exploring HDP Sandbox so any advice on this problem will be really helpful. Also I noticed on the hosts tab that the RAM allocated is 7.69GB. I've configured an m3.xlarge instance which has 15GB memory so how do I reallocate more memory to the sandbox?

Thanks,

Amit

6941-ambari.png

avatar
Contributor

Hi Azeltov,

I am trying to upload the hdp2.5 vm file ec2-import-instance-command.png into aws via cli.

I have tried the same and getting an error in step6. ec2-import-instance command is not showing up in cli

aws cli version is aws-cli/1.11.44 Python/2.7.9 Windows/8 botocore/1.5.7.

Tried the below command

$aws ec2-import-instance -t m3.large HDP_2.5_docker_vmware_25_10_2016_08_59_25_hdp_2_5_0_0_1245_ambari_2_4_0_0_1225-disk1.vmdk -f VMDK -o xxxx-w xxxxxxxxxx -b creditcardtxn1 -a x86_64 -p Linux

it says that invalid choice of command.Please let me know the correct command to execute.